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In  an  effort  to  analyze  ^fhat  management  policies  ar-d 
technologies  froai  other  disciplines  can  be  applied  to  the  field  of 
educat4.on ,  this  re^j^prt  describes^  the  development  ot^  an  anaiyt^ical 
frameiforlt  and  its  use  to  explore  implications  for  policy  development* 
The  present  work  seeks  to  synthesize  the  available  literature  on  ^ 
management  policies  and  to  apply  the  authors*  understandmy  of 
research,  development^  ar.d  innovation   (P/D&Il   systems  m  ^eueral  to 
th€  identification  of  po-icy  issues  and  options  ior  strengthening 
educational,  research  and  development*  The  volume  comprises  19 
chapters  discussing  the  x'ey  generic  features  of  en  E/D62  system*  Part 
1  treats  general  leatures  of  the  system^  part  2  focuses  on  an 
historic  overview  of  Et/Dt^I  development  and  functions,  part  3 
discusses  R/D&I  ir  education  and  ^identifi^s  three  as^^ects  of 
educational  B/D&I  that  have  been  largely  neglected,  ana  pa^-*-^ii 
considers  tha  state  of  development  of  E/D&I  systeci  studies  as  well  as 
future"  goals ,  funaing,  and  capacity^  (Author/WD) 
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PREFACE 

^t^ou^h  R6D  managemenc  is  a  well-  developed  specialty  in  several  other 
fields,  it  has  been  virtually  non-existent^  in  education  and  badly  neede^Sl. 
It  has  been  our  continuing  belief  chat  there  is  much  that  could  potentially 
be  applied  from  these  other  fields*    This  vould  require  a  comparative 
management  knovledge  base  about  research,  development  and  innovation 
(R/DS(I)  formulated  in  a  manner  that  made  it  useful  for  application.  An 
uTxierstanding  would  also  be  required  of  those  aspects  of  system  functioning 
which  should  be  viewed  as  generic  across  all  R/Dfid    systetrs  and  those^ 
at  tributes,  which  are  derived  from  the  particular  contextual  conditions 
characterizing  R/D£(I  in  specific  sectors  —  such  as  education.    With  th"^* 
V.i^A  of  unlerF.tandin^,  ye  could  th^n  deteir^.in^  which  managepeny  policies 
and  technologies  could  be  transferred  *^as  is''  from  other  sectors,  which 
others  needed  modification,  and  what  sorts  of  modifications  were  required. 
Consequently,  we  developed  an  analytical  framev^rk  that  might  permit  us 
to  appLy  Onderscandings  and  ir?anagement  technologies  from  R/D&I  systems 
in  other  sectors,  ^xaniine  r/D£(I  system  features  across  ^sectors  to  determine 
what  aspects  of  system  functioning  were  generic  across  R/D&I  systems  and 
which  others  were  contextual,  and  what  che  ir:plications  of  ttiis  might  be 
for  policy  development.  • 


s 


In  the  last  *few  years,  we  have  carried  out  many  analysed  and  produced 

several  volumes  describing  our  analytical  framework  and  applying  it  to  '  * 

2 

specific  policy  issues  , in  education  and  other  fields  as  well.  Ourinf^ 
this  tiuje,  we  have  been  developing  this  descriptive  volume  on  the  PVDSI 
system  in  education,  attempting  both  to  synthesize  t^e  available  literature 
and  to  appl^  pur  undesrstanding  of  r/d&I  systems  in  general  toward'^  id^^n" 
tifying  policy  issues  end  options  for  strengthening  educational  R/d^^1. 


This  voltime  is  comprised^  of  nineteen  chapters,  i:hich  discuss  the  \'^^y 
generic  features  of  an  R/D&I  system  as  Identified  in  our  analytical  frnme- 


We  use  the  term  Research,  Development  and  Innovation  to  connot<i! 

a  total  process  of  innovation  which  includes  various  knowledge  production 
functional  {research,  development,  production)  ,  various  knowlod^e  utilization 
'functions  (acquisition,  Implementation/ utilization ,  support  services) ,  and 
various  functions  which  sBrve  to  link  knox^^ledge  users  (need  identification, 
diss^emlnation,  evaluatlorTresearch)  *    This  emphrtsi^  on  a  total*  proct^.ss  of 
innovation  has  been  a  growing  emphasis  in  recent  years,  and  often  iy 
referred  to  by  the  term  KP/KU  or  KPU  (knowledge  production/utilization)- 
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work-    ^Part  1  covers  olghc  overview  fea£urc?s  that  pertain  to  t\\L*    .  ^sten 

a  whol^;     its  historical  development  (Chaot^^r  1);     its  envir/.^n- jTl".  fCffifUtr 

2)  ;     sy(^e:n  goal^  a;,  they  have  evolved ^fitj  shifted  ovcf  the  year-  (Criapter 

3)  ;     the^systen's  institutional  base  (Chapter       r    it^  persor:^^^l  b^^e 

(Chapter  5);     funding  patterns  and  policies  (Ch^nptor  6);     i^f  urr-^ation  f  low.s, 

(Chapter  7);     and  research  and  RID  outputs  -the  systcn  has  produced  (Chapter  8) 

•t 

In  Part  II,  wfe  focus  on  eight  R/D£.I  functions:     need  identification  (Chapter 
9) :     research  (Chaoter  10) ;     developrient  (Chapter  ll)-;     dissemination  4 
(Chapter  12);     acquisition  (Chapter  13);     ir.plementatlon  and  utilization, 
wrlch  we  treat  together  i^^  a  single  chapter  (Chaptt^r  1^);     and  evah:ation 

In  Part   III,  ::e  n:;te  three  ^>spe:ts  of  educational  R/D6T  that  have  received 
little  if  any  treatment  in  the  educational  literature:    administration  and 
manage.Tient   (Chapter  1&)  ;     production  (Chac)ter  17) ;     and  support  s:^rvices 
(Chapter  13). 

Finally,  in  Part  IV,  j^-e  consider  a  final  R/D£fl  feature  of  particularly 
keen  interest  to  us,  th^e  state  of  developr^ent  of  R^C&I  systeri  studies  — 
the  analysis  of  the  various  corr^ponents  of  the  R/D6I  system  and  the  pro- 
cesses through  which  It  functions,  so  as  to  understand  the  underlying 
dyna^nics  of  what  is  Qccurring  and  provide  a  sound  empirical  and  aoalytical 
basis  for  policy  develop'aent  to  strengthen  system  functioning*  ^ 

We  have  used  the  terms  "system",  "s^ster^  nanageiftent,"  "R/DiiX*"*  apd  R/D6I  ' 
"community"  repeatedly  in  our  discussions,  and  this  usage  clearly  requires 
some  elabor^ition  since  we^  are  well  '^vare  of  the  substantial  potential  for 
plsund'^rsta^di  ng  vhich  surrounds  these  terrr^s. 

System:    Our  analyses  have  all  ^been  premised  oif  the  assumption  that  the 
con  f  Lgura  t  ion  of  ins  ti  tut  Ions,  personnel ,  1  inkar.es »  information  flows 
etc.  that  comprise  the  education\l  R/D^I  enterprise;  can  best  understood 
.13  D  "sv^iter:^"    i'albeit  j  wc^ik,  diffustr,   iT^.nnturo,  loosely  lin^t'd,  hit'.hly 
decentralized  syst€:ni)  m.ide  up  Lir^ely  of  autonorrjius  elements  with  rol-'itivel^ 


little  concrol  or  direction  fro^.  any  central  authority  in  n  position  to 
"manage"  the  sy^te::.    t^e  are^  also  well  aware  that  beer-use  o£  thi^  cliffuhe- 
ness,  plurdlj^[n,  autono-^y  of  ele-.ents,  etc,<  the  c:i2rac teriza t ioa  of  this 
enterprise  as^  a  ''configuration"  rather  than  a  s>sten  has  gained  so^.e  pro- 
minance.     However,  we  have  argued  in  several  o£  our  analyses  that  the  system  ^ 
notion  has  many  advantages  i£  it  is  viewed  as  a  helpful'  constr\j|Skt  raTher 
than  as  a  description  of  eripirical  reality. 

For  one  thin^,  the^syster^.  perspective  orients  one  toward  the  dynanic  qianner 
in  which  different  ele"ients  or  the  Oyster?,  interacr',  such  that  policies  ^ 
designed  zo  affect  one  syste^i  corponent  have  inevitable  side-effects  on 
othfjr  co^'jo?.-^t:Z^  ^    ThL:3^  the  i/ic-j"  yi^rso^zi'-^  o^^ier-.'s  the  policy  ^cker 
toward  potep/tial  interact  ions ,  and  fociisas  policy  thinking  on  likely  im- 
pacts of  a  giv^n  policy  option  throughout  the  VjD^i  systen.     Our  analytical 

*       *  '  »*  ' 

f-rar^worU    -^as  designed  to  help  the  policy  raker  :hink  through  the  potential 
/  *  , 

interactions,  alr.ost  in  checklist  fashion  anoj.g  and  across  the  system  ■ 
features  that  rr^^ght  be  affected  by  any  giver/policy  optlcJn.     Thus,   the  * 
policy  l^ker  is  led  to  ask:  -  wh^ch  features  are  affected  by  the  option 
under  con^ide^Tatlorij  and  what  insight  on  the  wisdom  of  this  particular 
option  is  provided  by  whaf  v/e  kno'^  about  the  interactions  an^ong  these 
system  features  in  other  R/Diil  systerns? 

I 

A  second  advantage  of  the  s^rstein  perspective  (especially  when  one  has  some 
comparative  Understanding  of  R/Di^I  systems  in  a  range  of  sectors)  is  x^e 
jTianner  in  w^ich  it  directs  attention  to  maturational  issues.    Analysis  of 
R/D&I  systems  has  suggested  that  they  evolve  through  Various  historical 
stages/from  birth  to  a  transitional  phase,  to  increasing  progress  toward 
maturity  —  whi  lei^^ecognising 'tha  t  fixation  at  a  given  stage  and/or 
regression  can  also  occur.-    Certain  difficulties         characteristic  of 
R/DSl  syst^,Tis  at  .certain  stages  o:  their  historical  deveJopnfent,  but 
becor^e  less  serious  or  even  disappear  altogether  as  problems  as  the  systein 
matures.     Other  ^d^f  ficul ties  , ■  however,  are  tr^ceal^le  to  factors  inherent  . 
in  the  n<^ture  of  cer>:ain  contexts^  and  therefore  are  not  likely,  to  be  sub^ 
?;tantiall:/  affectf'd  by  i^icre^isin^  syst^n  natTirntion  over  timei     For '  ins tancc, 
education  by  its  very  nature. is  built  on  ^  social  sci'iSnce  knowledge  base 
rather  than  p  physical  science  knowledge  base,  and  this  has  enormous  rami- 
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fications  f-or,  the  conduct  andl  impncf  of  ^K/D^^I  activiCv.     E<JucaCion  is  a 
conjunctive  domain  of  knowled^e>  i.e.^  it  brin^^-  together  rany  differen: 
aisciplin£^^*anfl  applied  fi._4ds  in  the  solution  of  social  probU^n.^,  and  this 
too  has  substantial  ramifications  which  rake  educatianal  inquiry,  for 
inscance>  very  di'f f erent/f ron  inquiry  within  one  of  the  disciplines.  Kurther> 
"iCfa  effects  can  also,  be  seen  in  the  field's  personn^sl  and  ins ti tu t lotiai 
base>  its  inf orir^ation  flows>  and  outputSj  the  degre^of  consensus  achievable 
on  syst'^n  goals>  the  *S'j?porciveness  o^  the  system's  edyironment>  etc. 

Tt-beco*Ti^s  irr.portant  to  be  able  to  distinguish  t^etween  which  proble^is  of 
v.-sr^-^  f-jnctio'^.ln:^  are  ttace'iblc^  to  TpaturaLional  features  and  Vhich  are 
attributable  to  inherent  att^ributes  of  a  given  context.     Planning  to  over- 
co:?e  r^aturac ional "dif ficul t ies  must  take  time  into  account>  i^e.>  it  m-jst 
take  cognisance  of  the  fact  that  the'  configuration  of  clrcunst^nces  is 
likely  to  change  with-  tine  and  maturation.    Policies  appropriate  fo^strenth- 
ening  an  area  of  system  functioning  at  one  point  In  its  development  are  , 
not  likely  to  be  equally  appropriate  at  a  later  point  in  the  maturation 
pi^cess.     Initiatives  that  might  not  be  effective  at  one  time  may  be  highly 
effective  at  another  time.    Therefore^  the  policy  maker  who  thinks  in 
systen  maturation  terms  st^d  has  developed  some  understandings  of  the  accumu- 
latirtg  body  of  knowledge  on  comparative  R/D£tl  systems  will  focvjs  attention 
on  the  current  state  of  development  of  the  system  or  system  component  ©f 
concern.    A  giveii^policy  problem  will  be  viewed  with  a  broader  understanding 
of  the  configuration  of  conditions  that  are^most  effective  for  overcoming, 
those  *dif f iculties,  at  the  particular  stage  of  development  that  has  been 
reached. 

It  is  for  these  particular  reas<^ns  tha^  we  see  the  system-oriented  perspec* 
'tive  as  teing  highly  useful  for  policy  development.    This  brings  as  to 
another  term  likely  to  raise  some  eyebrows*    We  frequently  use  the  phrase 
"system  management"  to  describe  the  activities  of  KIE*  and  othe^  educational 
?JdlI  sponsors  to  orient  the  system  in  certain  functional  areas>  supporting 
  ^  *  ' 

At ^the  time  of  this  wrltlng>  the  new  Department  of  Education  was  just  " 
coming  into  being  and  of -course  this  will  lead  to  importnnt  changes  with 
respect  to  some  issues  we  discuss^.     However*  the  fundamental  issues 
remain  t^ie  same. 


the  development  o£ *cercaip  new  capabilities  in  the  institutional  and 
personnel  bases>  etc,    We  do  not  mean  by  our  usage  df  the  terfTH^system 
tnanageiaent^l  that  it  is  possible  to  manage  this  amorphous  system  in- the  same 
way  as  it  is  possible  to  manage  a  single  organisation  or  orj^anisational 
unit'     Clearly,  the*  description  of  the  loose  body  of  autononous  in.qti- 
tutions  described  in  the  conf igurational  perspective  is  a  reasonably 
valid  characterization  of  cejrtain  aspects  of  the  empirical  roality^of 
educational  R/D£il  today*  and  possibly  for  all  time.     Still,  we  believe 
strongly  in  the  lead  agencies  in  concert  with  other  R/Dil.  sponsors  and 
the  field  can       very  real  ways  oriant  the  system.     This  understanding 
oc  what       have  in  mfnd  wheri  we  use  the  tern  **system  managenent'*  is  vital, 

Sinilarly>  when  we  use  the  terr^  **comjnunity*'  (e.g.:     the  "research  com^itunity*, 
the  R/DLI  co-TLT.unity*' ,  the  '^practice  cdnmunity")?  we  are  using  the  term 
loosely  CO  describe  a  body  of  institutions  and  personnel  who  share  cornmon 
interests  and  tnay  one  day  Jbe  linked  more  effectively  through  better  developed 
information  flows^  corrununfcation  mechanisms^  social  structures,  etc.  We 
are  not  suggesting  that  either  a  s^nse  of  coiranunity  within  any  of  these 
groupings^  or  the  needed  linkages  and  information  flows,  etc,  actL'ally^ 
exist  today,  ■  ^  ^  ' 

Finally,  we  turn  to  our  use  of  the  term  *"R/D&I^'^    We  have  consistently 
used  the  term  '*Researchi  Development  and  Irjnovation*'  (r/D&I)-  to  describe 
what"  is^  increasingly  b'eipg  referred  to -by  others  as  KPU.    The  Rcse^irch, 
Developnent  and.  Innovation  usage  was  n^eant  to  make  clear  that  we  had  more 
than  sirr.ply  "RfiiD"  in  mind,  and  that  KU  activities  within  the  operating 
systen  and  linkages  between  the  KP  and  KU  ends  of  the  spectVum  were  very 
"^Tich  a  pnrt  of  ojr  concentiori  of  the  innovation  process.     Our  R/n^T  usa^^f* 
has  not  been  adopted  by  others  in  the  field  of  Education  where  the  Kl^'U 
us^^ge  is-  becoming  increasingly  popular.     It  is  however  (with  minor 
variations  such  as  R/D&I)  very  popular  outside  of ^Education  -  and  in 
th^e  context's  KPU  has  not  gained  much  currency.     It  is  difficult  to 
predict  which  will  survive,  in  ^^cneral ,  or  In  specif.tc  fields.  Since 
consensus  on  tenrinology  is  often  a  necessary  first  step  in  the  develop- 
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ment  of  a  new  field  of  knowledge,  we  would  be  willing  to  adopt  eltheV 
che  "R/DSI:  or  the  KPU  label  in  subj;t;que^t:  drafts  of  our  nritericiK   *  ^ 
Regardless,  ^'R/D^r\  throughout  th Is -volunne  should  clearly  be  under- 
stood to  be  analogous  to  "K?U"  and  not  ^  assumed  to  Eocui>  .on  "R^D" 
in 'the  narrow'  saase.     Our  interest  throughout  has  beun  on  the  total 
innovation  process>  and  this  point  should  not  be  misuuders tood, 

f 

The  analyses  presented  in  this  volume  are  part  of  an  ongoing  effort. 
Our  long  run  expectations  for  this  project  are  ambitious>  perhaps  overly 
so.     In  addition  to  the  analyticp.l  framework  developed  and  the  policy 
studies        conducted  applying  this  franework,  we  have  broad  es^pectatit^is 
;t  id -ir: ?.t  1  on-spec.if  1  c  coTipi^n^^nt  of  the  research  pro^rt^ 

vcul-^i  produce.     In  addiDion  to  producing  this  comprehensive;  synthesis 
of  the  available  literature  on  (or  rcilevant  to)  educational  R/Q^1>  ve 
would  hope  at  sor.e  future  date  to  develop:    an  annotated  bibliography 
of  the  voluriinous  literature;     a  discussion  of  hov  education  compares 
to  other  sectors  on*  Jcey  dimensions;    'a  sec  of  policy  and  research  agendas 
for  strengthening  educational  R/D&I;    and  conceptual  work  on  needed 
indicators  for  assessment  in  a  rpoA^toring  system  on  educational  R/DSI 
functioning,    Howev^er>  within  the  resources  available  to  ^i^y  it  has  only 
been  possible  to  complete  the  simple  research  and  synthesis  of  the 
available  literature,  in  the  comprehensive  fashion  we  desired.    Even  so  (as 
can  be  readily  .observed)  this  has  been  an  enormous  undertaking;  and 
even  in  this  voVme  th^fe^^are  chapters  that  merit  further  elaboration 
and  developnient ►    In  alidi/ion>  we  anticipate  producing  over  time  all  of 
the  elements  of  our  overlyj  ambitious  research  program, 


At  least  three  things  need  to  be  said  about  the  lengthy  tine  period  over 
*  which  thi^  work  ^^s  been  carried  out.     One  is  that  the  nineteen  chapters 
that  m^ke  up  this  volume  have,  been  written  at  different  times  over  a  four 
year  periods    As  a  consequence>  there  is  some  overlap  and  repetition  of 
material  that  we  would  expect  to  tee  elininated  after  editin^^  for  a  final 
version  of  this  material-  ■  ' 

Second*  our' understanding  of  educa^^ronal  R/I)SI  has  evolved  over  this  period> 
p^irticularly  in  certain  respects.     Like  the  rest  of  the  field>  we  too  h^ve 

ErJc  .  ',]()  • 
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come  to  a  j^roater  a^reclation  of  the  operating  system  *  s^^Mc  In^  educational 
R/D£tl  as  'involving  a  considerably  more  active  posture  than  simply  thsit  of 
"user"-    We  have  tried  to  take  cognizance  of  this^   for  instance^  by  ta^kin^ 
about  practice-base'd  development  work  in  addition  to  the  system^*tic  RiD 
carried  out  by  specialized  development* organiza tion /  and  about  infornatlon ^ 
flows  within  th-e  operating  system,  and'  between  t^  educational  R/DL1  and 
practice  communities >  as  well  as  amohg  research  coiTiTuniti^^s*  treat 
operation  system  roles  and  contexts  in  some  defElil  in  our  chapter  on  the 
impletnentatiojTi  ^^nd  utilisation  functions>  taking  cognizance  of  both  problen 
solution  and  KP  activities  that  caka  place  entirely  or  largely  within  ^the 
opt^ratin;^  svsten  as  well  as  operating  systerrt  adaptationj  iTi[!plo^entaiion> 
ar\d  use  of  outputs  developed  and^or  packaged  by  specialized  develoorert 
organizations.     And  'so  on.    UTiat  is  significant  to  our  discussion  here  Is 
tha^ts^ois  perspective  on  the  operating  system  has  evolved  over  the  several 
years  orTtTls  work  and  is  reflected  iRore  effectively  in  chapters  written 
recently  than  in  chapters  written  earlier  and  only  revised  in  minor  ways 
recently.    This  should  be  borne  clearly  in  mind  by  the  reader.     In  the 
final  version  of  our  volune^   the  material  will  be  redrafted  in  a  nanner 
that  consistently  reflects  this  greater  prominance  of  the  operating  systen 
in  our  conceptions  ot^/ULl  system  structure  and  functioning* 

And  finally,  we  owe  an  enormous  debt  of  gratitude  to  Ward  Mason^  head  of 
MIE's  R£(D  System  Support  Division>  who  has  patiently  and  helpfully  supported 
our  work  throughout  this  long  period.    Ward  Mason  and  his  staff  have 
seenied  to  us  to  be  perhaps  among  the  few  lone  voices  in  the  current  Wash- 
ingt'on  wilderness  calling  for  an  R&D  system  studies  capability  and  fi«ld 
of  inquiry,  to  provide  a  sound  conceptual  and  empirical  data  base  for 
educational  R/D^il  policy  development.    Hi^  commitment  to  this  area  has  ' 
^Lven  It  biuch  ar^d  kept  Lr  alive  (to  whatever  degree  It  still  is  alivc*)^ 
a^  a  viable  area  of\  fedefa-lT  educaCi,oi^  funding>  and  we  (ns  well        all  of 
our  colleagues  in  th^t^^-^erglng  fieJld)         heavily  in  his  debt  for  thi<;. 
'We  would  hope  to  be  able  to  provi(Je  him  with  some  dividend  on  his  consider- 
able Investment  of  t,lme  and  energy  in  this"effort>  and  liope  this  volume 
(in  this  and  sub^^quent  versions)  can  mhkii  som€>  cqntrlhution  to  the  develop- 
ment of  the  field  of  educational  R^D  system  stuSies  he  h^s  envisio^ied  and  ' 
supported^  *ind  to  which  in  a  very  real  sense  he  ^^^^  given  life. 
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An  understanding  oi  the  historical  development  of  any  r/D£cX  system 
is  essential  to  the  design  of  effective  policy  options  and  management 
strategies.    The  history  of  a  system  is  likely  to  be  one  of  the  most 
significant  constraints  that  needs  to  be  taken  into  account  as 
powerful  in  impact  on  attitudes,  expectations ^  institutional  configura- 
tions, and  operational  patterns  as  any  constraints  in  the  environment 
of  the  system.     Critical  events/iiNthat  history  inust  be  understood  in 


terras  of  the  ways  in  which  th^  affected  the  definitions  of  problems, 
stra^^^gies,  and  solucioi^ ,  ^nd  the  ways  in  which  they  created,  or 
closed  off,  potential  options  for  improving  KPU  functioning. 


Ve  have,  i^  our  work,  used'  a  conception  of  R/D&I  systems  going 
through  various  stages  of  growth  and  de^lopment        from"  the  un- 
certainties aaci  insecurities  of  Mrth  atii^arly  years,  to  a  tran- 
sitional perio^  of  striving  and  establishilig  themselves  and-  their 
legitimacy,  to  a  more  inat^ure  period  in  which  their  functions,  insti- 
tutions, and  linkages  a^e  well  established.    We  frequently  discuss 
policy  options  in  terms  of  what  we  see  as  needed  to  make  possible  ^ 
''further  maturation"  of  the  System,     We  hav^  no  precise  universal 
model  of  what  a  "mature"  r/D&I  system  looks  lifce ,    However,  our  famil- 
iarity with  r/D&I  systems  in  different  sectors  gives  us  some  sense  of  which 
attributes  systenw  demonstrate  (in  different  degrees)  that  suggest  to  ^ 
us  they  are  more  or  less  mature,    t^at  this  means  concretely  in  dif-  - 
fer^t  r/D&I  systems  is  likely  to  differ  from  sector  to  sector;  • 
but  t^ie  Saturation  notion  seems  to  us  to  be  one  that  is  highly  useful 
to  further  understanding  of  R/b&X  systems  and  dWelopraenc  of  feasible 
policy  options  an5l  management  strategist?. 

If  one  understands  the  history  of  the  educational  R^D£cI  system  to 
date  In  terms  of^  this  maturation  concept,  snd  in  relation,  to  the  * 


—7 


6 


experiences  of  other  systems,  then  several^ benefits  inay  be  forthcoming* 

, First,  viewing  the  system's  past  in  these  terms  tnay  help  observers 
to  be  more  charitable,  and  less  likely  t%  arrive  at  the  apparently 
all^too^cotnmon  conclusion  that  given  what  relatively  little  the 
system  ha^s  accomplished  to  date  there  is  little  reason  to  expect 
better  in  the  future.    Oai^  experience  with  young  R/D&T  systems  in 
Other  sectors  suggests  that  in  the  early  years  one  generally  finds 
unrealistically  high  expectations  and  over  optimistic  forecasts 
concerning  high  quality  results        to  be  delivered  quickly  and 
idpleiTiented  on  a  widespread  basis.     Since  in  reality  the  develop- 
ment of  an  R/d&T  system  (and  its  outputs)  fcakes  much  longer  and  . 
requires  much  laore  investment  than  is  ^usually  recognized  at  the 
timej  one  soon  also  finds  frustration  and  a  tendency  to  "overreact'* 
on  the  part  of  R/d&T  system  personnel,  funders  and  sponsors.  Thus, 
this  maturation  notion  suggests  the  advisability  of  assessing  the 
educational  R^D&I  system  at  the  present  time  in  terms  of  whether  or 
not  a  strong  basis  for^the  future  (and  future  returns)  has  been 
developed       not  in  terms  of  sunk  costs,  disappointments j  and 
unrealistic  early  expectations, 

A  second  persp^tive  gainfed  from  use  of  the  maturation  concept  revolves 
around  the  idea^that  ^/u&l  systems  evolve  through  three  rough  stages 
of  development  (introductor'y,  transitional  and  mature)  and  that 
R/D6rl  functioning  has  distinctive  attributes  at  each  stage  of  develop-  , 
ment<     If  this  Is  true,  then  it  has  several  Important  implications: 

1-      If  capacity-developing^  system-building  policies  and  "'^ 
programs  are  to  be  designed,  able  to  increase  the  * 
possibility  of  nudging  a  system  along  from  one  stage 
^  ■         of  development  to  the  next,  then  it  becomes  essential 
to  understand  how  the  attributes  of  R/d&I  functioning 
may  differ  from  stage  to  st^ige  and  where  the  critical 

r      ■  ■ 

1  o 


\ 


point^s  of  leverage  maV  be  as  the  targets  of  policy  inter- 
vention.    Insights  gained  from  other  sectors>  at  various" 

*  / 

stages  of  their  _own  hi^storlcal  development,  may  be 
useful  here.  ^ 

Consideration  of  policy  and  toanageTuent  options  must  take 
a  system's  stage  of  historical  developjment  into  account. 
It  would  be  clearly  inappropriate,  for  Instance,  to 
transfer  advanced  and  sophisticated  management"  tech- 
fKrlogies  from  mature  R'D&I  systeros  .td  other  systems 
that  are  in  only  the  introductory  stage  jof  development. 
(As  an  example  of  this^  the  use  of  PERT  for  program 
. planning  was  tried  in  regional  laboratories  early  in 
their  history,  with  rather  unsatisfactory  results. in 
many  of  them})      Equally  true'^  though,  pplicies  or 
approaches  tried  early  in  a  system's  histocy  with  little- 
success  may  still  be  appropriate  and  effective  later  in 
a  system's  history,  when  it  may  have  developed  needed 
capacities  or  acquired  requisite  resources  or  changed 
in  any. of  a  number  of  other  ways  making  the  earlier 
experience  less  relevant  to  judgments  of  'likely  future 
success.     One  cannot  validly  say,  policy  X  has  been 
tried  and  failed,  if  it  was  tried  under  the  wrong  con- 
ditions and  without  what/ was  needed  to  make  success 
possible. 


Clearly  then,  understanding  ^  system's  history  in  relation  to  this 
copception  of  historical  stages  of  system  development  can  be  of 
great  value  to  assessing  policy  options. 

Our  discussion  of  the^ historical  development  of " educat ional  R^D&I 
begins  with  a  consideration  of  the  available  literature  and  Jhe  sources 
from  which  a  picture  of  the  system's  history  can  be  constructed. 
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The  reminder  of  the  analysis  is  divided  into  "three  parts  examl- 
nation  of  the  system  s  ^>asC,  its  preseat^  and  its  future^  using  " 
descriptive  detail^  the  maturation  concept^  and  related  ideas  drawn 
from  our  analytical  framework.      What  critical  events >  historical 
trends,  and  tiine-bound  influences  shaped  the  system  anjj  brought  it 
to  its  present  state  of  development?    VJhich  of  these  continue  to 
be  felt  as  major  constraints  on  policy  fomulatlon  and  R^D^I 
functioning?    We  eKamln^  these  questions  in  the  course  of  an  overview 
of  the  system's  brief  ^stTs  We  then  consider  evidence  on  various 
indlc^t'^ors  of  the  system's  present  maturation  status.    We  attempt 
here  not  only  to  document  what  few  would  doubfc^  that  educational 
^  r/D^I  will  require  considerable  nurturing  and  evolution  befora  it 
^  can  become  (if  indeed  it  ever  can  become)  a  mature  system;  but 
beyond  tHat^  we  attempt  to  demonstrate  some  of  the  key  problems 
in  current  functloni^ng  fciiat  seegjto  block  sys  tem  maturation  into 
the  next  (/the  transitional)  stage  of  development  and  ultiHJate 
Biat^irity.  '^Finally,  we  consider  the  system^s  future  —  possible 
policy  options  that  might  'overcome  some  of  the  key  points  of  weak* 
.  ne^s  Identified  earlier^  especially  those  that  seem  to  be  of  major 
Importance  in  retarding  system  maturation.    We  also  suggest  a 
number"  of  research  questions  that  need  to  be  considered  usln^ 
historical  and  comparative  insights  from  oth^r  sectors ^  to  jlnform 
judgnients  of  the  viability  of  some  of  the  suggested  Interventions 
to  overcome  system  weaknesses ,     In  outflinlng  these  possible  policy 
options  and  research  Initiatives^  we  foreshadow  many  of  the  con- 
elusions  ye  reach  in  subsequent  chapters  analyzl^ig  aspects  of  edu- 
catlonal  R/D£cK 

0  -  ^ 

4 

I.      THE  AVAILABLE  LITERATURE  AND. SOURCES 

There  is  a  vast  literature  -of  souCce  documents  relevant  to  constructing 
a  history  of  the  institutionalization  of  educational  R^D&I  over  the 
■  last  decade  or  two       menios  produced  by  or  for  gove/nment  officials 
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presenting  their  thiqking;  reports  evaluating  the  institutions  chat 
were  produced^  a\no3t  from  the  outset  o£  their  creation;  articles 
explaining  to  th^  research  community. and  the  public  at  large  what 
was  done  and  commentary  in  various  kinds  of  publications  about 

one  or  another  a^patt  o£  the  system;  etcv      We  have  relied  heavily 
on  as  much  o£  (this  source  material  as  we  c^uld  obtain  in  constructing 
the  liistory  presented  here.  \J 

'^Y'addlt iorfj  th^re  are^a^few  chapter-lengtli  of  article-length 
histories  of  educational  research  over  the  last  century  or  afince 
the    *50s,  Dost  of  which  have  appeared  only  within  the  last  few 
years.      Those  that  cover  the  longer  period  #re  useful  in  giv^iig 
a  sense  of  educational  research  as  a  specialised  field  with  a  history 
thatf  goes  back  at  least  into  the  1890s,    with  stme  units  ^uch  as  ^the 
Office  of  Education  going  back  to  the  1860s,      Read  in  relation  to 
the  recent  period/of  15-20  years ^  these  histories  of  the  longer  period 
also  give  a  sieTjse  of  how  much  development  the  field  has-sudd^nly 
undergone  in  finly  the  very  recent  past. 

Clearly  J  trtie  single  most  Important, piece  of  ^^ork  on\hat  recent 

period  appeared  only  a  year  ago,  after  the  f^rst  draft  of  this 

chapter^was  already  completed,     Richard  Darshimer^    formerly  Execu-^ 

tive  Director  of  the  American  Educational  Research  Association, 

throughout  the  1960s    and  early  l97ds,  -has  written  an  eiy?fellent, 

insightful,  highly  useful  history  of  the  period  rich  in  detail,  welTl/ 

documented',  written  from  the  perspective  of  someone  well  connectecy 

to  what  -was  happening  in  Washington,  when  ^t  was  happening,  who  * 

knows  who  to  t^lk  to  in  order  to  find  out  what  really  happened  with 

regard  .to  this  and  that.    He  has  taken  pains  to  provide  'a  scholarly- 

treatment,  to  check  his  own  recollections  with  sources,  and  to 

present  his  hist^ory  in  a  way  that  can  be  i^ed  by  others  who  wish  to 

dig  further  into  the  history  of  the  period.    DershimerS  The 

5  ■ 

Teder^l  Government  and  Educational  R6D  -  is  ir^ust  reading  for  anyone 

/  ^  ■ 
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concerned  with  understanding  the    institutionalization  of  educational 
R/D&I^  one  of  the  relatively  few  volumes  we  would  place  in  this 
category.  have  taken  note  of  information  from  the  Deifshimer 

volume  at  a  number  of  points  in  this  chapter.    Subsequent  drafts 
are  likely  to  use  the  Dershimer, material  even  more*    Clearly*  if 
there  was  one  single  volume  to  be  recommended  for  understanding  the 
OE  years  of  leadership  of  educational  R/D&I*  this  would  be  It*'  It 
suggests  the  kind  of  history  needed  of  the  NIE  years  as  well  ^s  of 
other  agencies  and  their  roles  in  sponsoring  educational  K/l>Ll, 

II*      THE  HISTORICAL  PAST-     CRITICAL .EVENTS ,  LEGISLATION,  SPONSOR- 
SHIP PATTERNS,  DIRECTIOtjS,  ASSUi^PTIONS ,  AND  STRATEGIES 

A  truly  comprehensive  history  of*the  Institutionalization  of  edu- 
cational r/D&I  would  be  a  missive  undertaking*    Given  the  nature 
^_of  KPU  in  education  ^«rt*^ffii  key  role  played  by  the  operating  system 
in  much  of  the  KP  and  linkage  as  well  as  KU  that  impacts  on  educa- 
tional practice  --  such  a  comprehensive  history  should  consider  both 
specialized,  institutionalized  KPU  and  dther  leis  specialized>  non- 
ins  tltutionalized  >  practice-based  forms  of  educational  KPU-    At  the 
T^ery  leasts  such  ^  history  would  analyze  the  key  ideas  and  critical 
events  and  developments  that  determined  the  character  (or  more 
correcCly,  the  somewhat  diverse  character)  of  educational  R/d&I 
today       the  character  of  the  system  (or  *'conf Iguration*')  as  a 
whole  and  Its  various  parts  (e*g*^  the  academic  sector,  private 
sector*  regional  laboratories  and  other  Institutions  in  the  quasi- 
public  sector*  the  SEAs^^ISAs.*  and  LEAs)  and  each-of  the  comparative 
featuresr  in  our  analytical  framework  {e*g*>  funding^,  per^nnel^^ 
institutions  >  research >  development  >  dissemination^  etc  *) *  A 
truly  comprehensive  and  useful  history  would  probably  give  as  much 
attention  to  the  development  of  the  field's  knowledge  and  technology 
base  as  to  all  of  its.  other  systemic  properties* 
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We  have  not  attempted  sucK  an  imposing  task.'   Our  approach  .was 
considerably  more  r^odest  In  scope.    We  have  reviewed  some  of  the 
history  of  the  past  two  decades  with  a  view  toward  discerning  some^ 
of  the  underlying  assumptions  and  R/D&I  strategies  that  critically 
influenced  system  develofiroent,    ,We  have  not  attempted  to  analyze 
important  theoretical  or  empirical  contributions  that  shaped  the 
knowledge  and  technology  bas^  of  the  field,  \ 

■    ■     y  . 

The  focus  of  our  attention  on  this  analysis  has  be^^  the  fede^l 

role  In  institutionalized  R/D&I,  ^nd  specifically  the  involvement 

f 

,    of  the  Office  of  Education  (0£)  and  later  the  National  Institute 
of  Education  (NIE)  in  the  institutionalization  and  sponsorship  of 
educational  R^D&I.    We  do  not  discuss  here  other  federal  agencies 

-^-^who  have  been  sponsoring  educational  R/D&I  activities.     (We  con- 
sider these  and  other  non-federal' and  private  sector  sponsors 
briefly  in  a  subsequent  chapter  on  funding.)     Nor  even  do  we  discuss 
the  l^rge  number  of  relevant  units  and  programs  within  OE  relevant  to 
a  comprehensive  understanding  of  the  institutionalization  of  edu- 
cational R/d&I.    For  instan^j  we  do  not  consider  the  substantial 
R&D  resources  raanaged^'ty" OE  under  ^legislative "mandates  on  vocational 
education  and  special  education  (i.e.,  education  for  the  handicapped). 
In  discussing  OE,  our  attention  is ^limited  to  the  Bureau  of  Res^arch^ 
called  the  National  Center  for  Educational  Research  and  Development 
(NCERD)  beginning  in  1969.     It  J^hen  shifts  to  NIE  when  the  Institute 
was  created  to  play  a  leadership  role  in  educational  R/D&I  and 
absorSfed  much  of* the  role  of  the  NCERD.    The  picture  that  we  present^ 
therefore,  suggests  a  much  more  orderly,  "managed"  picture  of  the 
'  institutionalization  of  educational  R^D&I  than  was  in  fact  the  case: 
it  deals  with  only  that  small  part  established  and  managed  by  one  and 
then  another  federal  agency.    This  limitation  must  be  emphasized  at 
the  outset  atid  borne  in  mind  throughout.    We  are  looking  at  a  very 
small,  albeit  frpm  our  perspective  important^  part  of  the  whole,  which 
is  a  considerably  larger,  more  decentrali?.ed ,  less  orderly,  less 
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managed  J 'population  of  discrete^  autonomous  institutions.  Given 
that  proviS'o,  we  think  there  is  much  that  is  essential  for  the  field 
to  understand  ahout  the  segment  o£  the  system  (or  ^*conf iguration") 
ue  have  selected  to  focus  on  in  this  chapter. 

The  recent  history  of  educational  R/D6(I,  since  the  establishment 
of  NIE,  seetns  to  us  to  be  so  very  different  in  iinportant  respects 
from  the  previous  period  that  ue  have  divided  our  analysis  i*nto    '  - 

.two  parts.    We  examine  first  thfe  period  from  the  emergence  of  the 
federal  role  in  educational  R'dSI  in  the  mid   *50s    until  KIE  was 
created  in  1972.    Ue  then  turn  to  the  last  five  years  in  which 

V  the  Institute  has  been  the  primary  sponsor  of^  and  dominant  in- 
^ uence  on^  system  development. 

I.      OE  leadership:     195Qs  ^o  1972  .  <^ 


^  \ 

\  ' 

A.      The  19505:      Emergetice  of  the  Federal  Role  ► 

\ 

The  mid  *50s    set  the  stage  on  a  sEnall  scale  for  two  sets  of 
developments  that  were  to  intensify  in  the   '60s    and  have  a  major 
impact  on  educational  R/D6cl.    The  first  of  these  could  be  char- 
acterized as  the  emergence  of  race  (and  then  poverty)  as  social 
^d  political  issues  in  this  country,  in  combination  with  the 
assumption  that  the  schools  should  serve  as  on$  of  tJie  major 
vehicles  for  social  reform.    The  psychological  arguments  so 
fundamental  to  the  Brown  vs.  Board  of  EducatloA  desegregation 
deoision  of  1954  were  carried  further  in  the  '^cycle  of  i 
poverty"  arguments  of  the    *609.      Each  position  assumed  that 
active  intervention  in  the  education  sector  coald  produce 
major  social  reforms  and  enhance  the  opportunities  and  '*Iife- 
chances"  of  students.    Although  the  Brown  decision  itself  ' 
had  relatively  little  impact'  on  educational  R/d6cI  in  the  *50Sj 
its  legacy  in  the    *  60s  enormous.     Federal  legislation  and 


ERLC 


2o 


court  de^cisions  premised  in  part  on  this  pattern  o£  thinking 
have  had  a  'tremendous  impact  on  school  system  organization  and 
functioning  and  have  created  major  curriculum  and  frrograTO 
needs'  to  be  rnet  by^R/D£tI  activities,    K/l>&\  products  and  pro- 
grams targetted  at  racial,  ethnic/  and' linguistic  miijoritie? , 
and  at  the  economicallj^  disadvantaged,  have  received  the 
li6n*s  'share  of  r/D^I  resources  in  the  education  sector*^. 


Th^  second  development  of  the  ^SOg    that  was  .  to  have  a  major 
'    infpact  on  the  system  was  the  emergence  of  the  federal  govern- 
ment as. the  primary  sponsor  of  educational  R/D£tl.  Educational 
re'search  received  a  inajor  boost  from  the  passage  of  the  Coop- 
erative  Research  Act  in  1954,  authorizing  research  funding 
which  began  to  flow  into  the  educational  research  community 
by  1957,   ,S<ibsequent  Cooperative  Research  Act  ^endments  and 
authorizations  in  the  '6jfs,    along  with  the  Elementary  and 
'  Secondary  Education  Act,  created  major  new  funding  programs 
-and  the  network  of  federally-funded  RM)  centers  and  reg^ional 
laboratories  that  were  the  focus  of  federal  R/D£tl  strategies 
in  the  '60s. 

\ 

While  the  early  Cooperative  Research  Act  funding  of  the  '50s 
tended  to  be  allocated  to  di^creteyw  relat^ively  small-scale 
^educational  research  projects,  0.t;her  blocks  of  federal  funding 
in  the  '50s    came  to  be  concentrated  on  J^rger  scale  curriculum 
improvement  projects.    The  preponderance  of  federal  influence 
can  be  seen  in  the  history  Of  these  projects.    The  beginnings 
of  substantial  support  for  curriculu'tti  improvement  must  be  traced 
back  at  least  as  far  as  the  early  »50e    when  the  Carnfegie  Cor- 
poration sponsored  curriculum  design  and  teacher  training  pro- 
grazi  development  by  mathematicians  and  scientists.    Within  a 
few-years,  the  National  Science  Foundation  allocated  such  large 
Sums  to  the'work  of  scientist*  to  completely  overhaul  the  high 
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^     *  7 
school  curriculum  for  physicjs*,  chemistry-,  and  biology  that 

the  earlier  Carnegie  projects  were  dwarfed  rn  comparison. 

The  excitement  Q^atet}  by  the  science  curricula,  "textbooks, 

and  materials  cr^^tec^/so  much  support  for  this  kind  of' -develop- 

ment  work  that  major  curriculum  improvement  projects  were  de-  ^ 

OJeloped  in  mathe*matics ,  English  and  language  atts,  social 

8  * 

studies,  and  foreign  language^.      Most  o£  the  funding  for  these 

t 

projects  cams  from  the  federal  government,  under  authorizations 
from  the  Cooperative  Research  Act  or,  in  the  case  of  foreign 
languages,  the  National  Defense  Education  Act,    The  latter  was 
passed  in  1958  in  an  atmosphere  of  at  least  moderate  hysteria 
over  the  Soviet  Union's  launching  of  its  first  Sputnik,  an 
•event  interpreted  by  many  as  an  indication  that  this  country 
was  falling  behind  the  Soviet  Union  and  that  perhaps  the  quality 
of  American -education  was  inadequate  to. maintain  the  U,S,  position 
of  supremacy  in  the  world,  ^  ,  ' 

i  t? 

During  the  *5Gs,  and  even  more  so  in  the  '60s,  the  Office  of 
Education  was  the  primary'source  of  educational  R/D&I  funding. 
This  one  agency  controlled  not  only  the  funds  targetted  directly 
at  R6iD  institutions  but  also  the  large  sums  of  ESEA  money  avail- 
able to  eligible  school  districtswho  could  show  some  evidence;,^ 
of  prograij^development  for  the  economically  disadvantaged, 
Significant  funding  also  came  from  other  agencies  of  the 
federal  goVernment       e.fe. ,  the  National  Science  foundation, 
the  Office  of  Child  development,  the  Office  of  Econ^ic  Oppor- 
tunity, the  National  Institutes  of  Mental  Health,  and  the  Departl- 

ment  of  Defense,    The  additional  R^D6tI  funding  that  cam^  from 

9  ^ 

private  ^"foundations  was  quite  small  in  comparison. 

^  '  *    .  / 

■Clearly,  then,  jthe  federal  government  emerged  as  essentially  , 
ttie  sponsor  of  educational  R/D6tl.    T+iis  overwhelming  federal 
influ<snoe  has,  had  a. major  impact  on  system  development.  ■ 


^  27 
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Assumptions  of  federal  pollcymakaVs  Uba0t  tfi^Tcind^of  R/D6fl 
system  needecir  the  strategies  tol.be/us^d' in--sreating  that 
■  System^  and  the  Kinds  of  R^D&I  o«tputs^to^|^/produced  have 
;^etennlnad  the  directions  of  sysdtrfi^  de^elo^DjlSSpt .    These  ^' 
assumptions  J  strategies'  and  output  pr^lSVxties  warrant  some  ^ 
attention. 

'  fi.      Assumptions ^  Strategies^  and  Priorities 

/  a.      Weaknesses  of  Existing  Educational  Research 

^  '  Functioning 

/  / 

The  literature  contains  numerous  accounts  of  the  thinking 

''that  led  to  tha  creation  of  a  -wholly  new  sat  of  Instltu* 

10* 

tions  to  carry  out  educational  R/D6I  in  the  '60s* 
Several  years  of  funding  educational  research  under  the 
Cooperative  Research  Act  had  produced  few  theoretical 
or  eiopirical  contr^utions  of  major  significance  j  and 
little  if  any  discarnible  improvement  in  educational 
practice.    The  Outputs  of  educational  research  were 
assessed  as  f  ragtneptary  ^  noncumulative  ^  and  rfpt  directed 
toward  J  or  organized  in  a  w*y  likely  to  affect,  edu- 
cational  practice.    There  was  little  in  tha  , way  of 
rigorous  development  (in  the  R&D  sense)    and  Inadequate 
dissemination  and  diffusion  frofe  knowledge  produc?ing 
to  knowledge  utilizing  components  of  the  educational 


^  '  system.    The  educational  research  community  was ^^iented 

primarily  to  the  value  system  of  the  university,  stressing 


theoretical,  advances  and* publications  rather  than  less 
alegant  nuts-and-bolts  -yutputs  designed  to  improve 
educational  ^actice< 
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OrganizatLonal  Weaknesses  as  Assumed  Key  to  the 
Problem  -    "  . 


A  significant  part  of  the  problem  was  atttlbuted  to  the 
way  educational  research  was  organized*    Prior  to  1964, 
it  was  conducted  for  the  most  part  by  individual  researchers 
mostly  in  schools  of  education,  devoting  only  a  small 
percentage  of  their  time  to  the  conduct  of  research* 
Research-oriented  organizational . forms  such  as  research 
bureaus  were  ^^ncti^ning  in  a  number  of  schools  of  edu- 
cation*   However,  most  of  thesfe  bureaus  were  more  service-  ' 

oriented  than- research -olri'ented  ;  and  most  functioned 

f'  '  '  ^ 

simoly  as  umbrella  organizations  for  projects  of  individual 

^  .      '  '  V 

faculty  members.    There  were  relatively  few  programs  of 

interrelated  research  projects  functioning  undej:  bureau 

auspices.  '      ,  ^ 

The  focus  of  these  analyses  was  on  the  organizational 

weaknesses  of  educational  research*    Other  problems  were 

noted  as  well  —  for  instance,  th^  low  prestige  of  edu- 

cationaL  research  and  the  resultant  difficulties  in ^ 

12 

attracting  the  best  minds  to  the  field;      but  organiza- 
tional issu&s  were  paramount  in  the  thinking  of  r/dScI  policy 
makers  at  this  time,  and  this  focus  detenained  the  strat- 
egies  that  were  evolved  —  those  options  that  were  selected, 
and  others  thafcwere  closed  off. 

c,      Mission-Oriented  ^R&D  Programs  a&  the  Solution 

To  overcome  the  fragmentary,  noncumulative  character  of 
educational  research,  the  bulk  of  federal  funding  was  to 
be  concentrated  on -large  programs  of  research  long- 
range,  interrelated,  cumulative  research,  development, 
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and  evaluation.     To  overcom^the  field's  academic, 
theoret^al  emphasis^  its  concern  primarily  with 
a^^ncj^l  the  knowledge  base  o£  educational  research, 
ancfiits  orientation  t'qward  publications*  as  the  dominant 
research  output,  funding  priorities  were  to  emphasize 
problem-oriented,  mission-orie^ed  R6i)  programs,  designed 
to  create  tested  products  a j^d^ programs,  S^^sed  on  the 
ultimate  goal  of  Improvingjeducational  pract  ice}^^R&D 
programs  were  to  include  strong  disseminatior^  coinp<Jnents  ' 
and  were  to  be  considered\incomplete  and  unsuccessful 
until  they  had  actually  achieved  planned  improvements 
in  school  system  functioning.     Since  the  existing  in- 
stitutional bases  of  academic  research  were  viewed  as 
unsuitable  environments  to  carry  out  research  organized 
in  this  fashion,  a  wholly  new  network  of  federally- 
funded  institutions  was  fo  be  created  to  carry  out  edu- 
cational r/D6cI. 

d.      Establishment  of  Network  of  R&D  Centers 

University-based  educational  R&D  centers  were  the  first 

new  institutional  for^n  to  be  funded.     Initially  (1964-66) 

14 

10,    and  eventually  17  such  centers    were  created  under 

the  Cooperative  Research  Act,  the  Vocational  Research  Actj 

15  » 
and  other  legislation.      The  rationale  fop  these  centers 

was  as  follows:     education  had  a  weak,  derivative  knowledge 

base  with  few  links^^  the  disciplines ^^nd  poor  .access 

to  knowledge  producing  and  knowledge  applying  resources, 

-J  ^ 

The  field  had  been  unable  to  attract  significant  talent 
from  the  disciplines.     However,  i^  educational  R&D 
centers  were  established  on  university  campuses  ^  the  field 
woiilfl  be  "able  to  draw  on  the  critical  mass  of  interdisci- 
plinary talent  that  is  concentrated  in  the  universities. 
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The  RScD  centers  would  be  expected  to  carry  out  four  func" 
tions:    codifying  knowledge  relevant  to  particular  prob-^  , 
letns  and  drawing  theoretical  inferences  for  the  cohstriic- 
tion  of  niodels  and  prototypes;  identifying  serious  gaps* 
Id  existing-knowledge  and  mobilizing  university  resources 
'to  fill  these  gaps;  designing  protbtypes  (procedures, 
ciaterials,  systems)  to  achieve  specific  changes;  and 
testing' prototypes  sufficiently  to  indicate  their  poten- 
tial and  iniplemeDtation  conditions  needed  for  them  to 
realize  their  potential*^^    As  conceived,  the  R&D  centers 
were  to  carry  out  work  ranging  across  the  full  spectrum 
of  R/D&I*activity  —  research,  development,  dissemination, 
etc.,  but  they  were  expected  to  be  especially  productive 
as  perforaers  of  first-rate  r^sjearch*^^ 

e^      Establishment  of  a  Network  of  Regional  Laboratories 

A  network  of  twenty  regional  educational  laboratories  ap- 
peared oext,  created  under  Title  IV  of  the  Elementary  and 
Secondary  Education  Act  of  1965*    As  initially  conceived, 
the  labs  like  the  R&D  centers,  were  expected  to  carry^  oul^ 
the  full  range  of  R/D&l  functions  as  well  as  to  provide. 

various  regional  services /to  .operating  system  agencies 

^   "  18 
within  their  service  areas.       In  1968,  however,  a  shift  in 

federal  policy,  reoriented  these  institutions  to  concen- 

19 

trate  heavily  on  development  work* 

The  labs  were  intentionalfy  located  outside  the  universi- 
ties to  overcome  three  major  problems  posed  by  university 
settings.    Univeirsity  values  tend  to  favor  research,  and 
.view  development  work  with  condescension*    University  ' 
values  aife/perhaps  even  more  condescending  about  focusing 
effort  on  suchr  linkage  functions  as  dissemination  and 
implenientatioq,  which  need  to  be  integrated  into  development 
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planning.     And  of  equal  significance  for  the  conduct  o^  ths 
dei7elopr:;enc  function  which  generally  requires  full-tice, 
personnel  commitnfents,  the  time  of  academic  personnel 
tends  to  be  divided  between  teaching  and  a  range  of  other 
activities,  leaving  limited  time  blocks  for  R&D  work. 
It  was  Assumed  that  locating  the  laboratories  outside 
the  universities  would  permit  recruitment  of  fuH-tine 
personnel"  with  fewer  reservations  about  carrying  out  the 
development,  dissemination,  and  iniplementation  functions. 
Furthermore,  it  was  expected  that  there  would  be  definite 
advantages  in  creating  wholly  new,  independent,  quasi- 
p^biic  institutions  unburdened  by  traditions,  socializa- 
tion 'patterns  ,  and  histories  Inimical  to  new  vorking 
styles,  nsw  kinds  of  management  structures,  and  emphasis 
on  KP-KU  integration.     It  was  assumed  too  that  the  new 
mixes  of  personnel  required  *by  the  development,  disseTni- 
nation,  and  other  linkage  functions  wot^ld  be  easier  to 
recruit,  hire,  and  retain  outside  the  university  setting, 
end  that  collaborative  relationships  with  school  systems 
would  be  easier  to  develop.  ^ 

£.      The  Networks  of  Federally-Created  Institutions:  The' 
Linear  Model  or  Institutional  Overlap  in  Functioning? 

The  impres§ion  one  gets  from  some  of  the^literature  is  that 
a  linked  ^/D6J.  system  of  institutions  hjid  been  created 
with  some  specialization  of  functions  and  coordinated 
linkage  of  functions  from  research  to  development  to 
dissemination  to  implementation.    Some  presentations , 
foV  instance,  suggest  that  the  regional  laboratories 
would  take  prototypes  developed  by  the  R6cD  centers  and 
develop  them  to  the  point  where  they  were  fully  tested 
and  proven  to  produce  known  results  reliably  under  given 
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implemetitaCioEi  conditions^  and  could  be  used  with  little 

20 

outsid'e  assistance  in  classrooms  across  the  country* 

Othfer  docuTn^nts  suggest  that  the  demonstration  centers 

established  across  the  country  under  {itle  HI  of  Xjie 

Elementary  and  Secondary  Education  Act  of  1965  would 

take  the  Innovations  produced  by  the  laboratories ^ 

demonstrate  them,  and  ser7e  as  regional  and  local 

centers^  for  diffusion  o5. innovations  produced  by  the 
^  21 

laboratories.-     la  what  others  describe  (or^  more  , 

accurately^  criticize)  as  the  '^pass-it-on">  linear 

view  of  R/Dil 'functioning  which^  they  argue^  prevailed 

at  the  time^  research  and  prototype  development  would 

be  carried  out  by  the  RM)  centers,  the  prototypes 

would  be  passed  on  tcf  the  regional  laboratories  where 

they  would  be  developed  and  tested  fully  into  usable 

product  and  program  packages,  and  then  these  packages 

wouW  be  passed  on  to  the  Title  HI  centers  for  demon- 
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stration  and  diffusion  to  school  systems. 

In  factj  those  who^participated  in  the  OE  planning  for  ■ 

the  lai>oratorie5  and  centers  indicate- that  they  had  no 

such  tnaster  plan  in  mind^  that  their  conceptions  involved 

far  less  specialisation  or  linkage^  and  not  as  necessarily 
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a  linear  view  as  their  critics  suggest.      The  overlap  in 
functioning  between         centers  and  laboratories  were  as 
expected.    There  were  R£tD  .centers  engaged  in  development 
work  as  well  as  research  and  prototype  designs.    And  there 
were  laboratories  doing  not  only  development  vork  but  also 
their  own  ^'development-oriented  research'^       some  of  it 
more  basic  than  applied.    There  were  also  instances  of 
collaborative  relationships  between         centers  arid 
laboratories  operating  in  more  specialized  and  linked 

fashion,  the  RjStD  centers  doing  the  prototype  research^ 

/ 
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and  the  laboratories  carrying  out  the  extended  development  ' 
work  and  feeding  bacif;  to  R/D&I  center  persoimel  data  sugges- 
ting additional  research  needed  to  facilitate  product  devel- 
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opment  or  effectiveness.        The  IPI  (Individually  Prescribed 
Instruction^  collaboration^ between  the  Learning  Research  and 
Development  Center  of  the  University  of  Pittsburgh  and  Re- 
search for  Better  Schools  (the  Philadelphia-Abased  regional 

4 

laboratory)  is  o^fie^such  example  well  dooumented  in  the  lit- 
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erature.  There  are  other  exaEitples  as  well*       But  from 

the  perspective  of  OE  personnel^  these  collaborations  appear 

to  be  relationships  ^that  were  applauded  but  not  necessarily 

conaidered  the  model  all  Institutions  In  the  network  were 

expected  to  follow, 

g.      Termination  of  Some  of  the  Labs  and  Centers       The  find 
of  th^  ^*Reglona\l"  Network 


Regardless  of  what  the  conceptions  of  the  original  planners 
Biay  have  been,  the  "actual  functioning  of  these  new  institu- 
tions and  the  quality  of  the  outputs  they  produced  were  causes 
of  considerable  disappointment  to  observers  and  to  a  growing 
body  of  Congressional,  federal  agency,  and  research  community 
critics.    We  will  consider  some  of  the  criticisms  later, 
At  this  point,  though^  it  should  be  noted  that  the  labs  and 
centers  came  under  considerable  attack  and  successive  win- 
nowing efforts  In  1970,  1972,  and4974  so  that  there  are  now 

remaining  only  eight  of  the  original  20  regional  laboratories  - 
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ending  the  regional  blanketing  of  the-country  and  9  of  17 
or  tfo  R/D&I  or  poTicy  centers  created  at  various  times  by 
OE- 


h.    Other  Federally-established  Networks  of  Institutions 
for  Educational  r/OS^I  ^ 


We  have^trted  to  keep  our  presentation  sinple,  focusing 
on  Che  institutions  at  the  heart  of  the  federal ly- funded  * 
system  o£  R/D&I  institutions  created  to  specialize  in 
educational  R/D£tl  functioning.    But  surely  no  picture  d£ 
the  network  of  educational  r/dM  institutions  created  by 
federal  funding  would  be  complete  without  mention  of  various 
other  institutions  that  have  proliferated  along  with  the 
centers  and  laboratories.    We  include  here  the  14  Instruc- 
tional Materials  Centers  for  acquiring  and  disseminating 
materials  for  the  handicapped  and  for  youth;  Research 
Coordinating  Units  in  nost^states  t^  stiinulate  and 
coordinate  research  on  vocational  education;  and  especially 
the  vast  ERIC  system  for  acquiring,  storing,  reproducing 
and  making  available  the  vast  fugilrfve'^lrtt^ature  of  edu- 
cational R/DfitI,  the  E5IC  clearinghouses  thatXnot  only 
acquire  J  ^  screen^  and  abstract  materials  but  also  produce 
large  numbers  of  information  analysis  products^  and  the 
large  network  of  education  information  centers  that  pro- 
vide access  to  the  ERIC  system  and  user  services  tailored 
to  users*  information  needs.    There  has  been  some  modest 
degree  of  instability  in  this  part  of  the  educational  R/D^I 
macrostructure  as  well  as  the  laboratories  and  centers*^ 
We  discuss  these  institutions  more  fully  in  our  chapter  on  the 
network  of  institutions  that  make  up  the  educational  R/D£tl 

IC 
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system.        The  ERIC  system  enters  into  our  analysis  in  other 


chapters  ss  well 

i.    Summary  of  Key  Assumptions^  Strategies^  and  Priorities 

/ 

Though  we  have  presented  only  thejnosJ:  cursory  overview^of  • 
the  system's  history,  we  have  d^oted  a  substarrt"til  amount 
of  space  to  it.    This  seemed  necessary  to  document  the 
kinds  of  assunpti^s  and  strajiegies  th^t  dominated  educational 

/ 
/  ■ 
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K'^'D&I  thinking  during  the  *603,  and  to  permit  us^to 
contrast  this  earlier  pattern  of  thinking  with  the 
prevailing  views  in  NlE's  leadership.    We  underscore 
some  o£  th^se  pgi^jTs  before  turning  to  "the  systg^^'s 
history  since  the, creation  of  NIE. 


1  > 
i.      Creation  of  New  Institutions 


First,  federal  R/D&I  planners  appfear  to  have  assumed  that 

the  most  critical  barriers  to  improving  educational 

research  prior  to  1964  were  organizational  in  nature, 

and  that  the  best  solution  to  this  problem  was  the 

'  creation  of  ^  network  of  wholly  new  institutions  and 

organizational'  forms  rather  ti\an  working  within  the 

structures  of  existing  institutions.    The  fact  that  the 

new  organizational  forms  were  bound  to  bring  with 

them  inherent  strains  and  problems  of  their  own  was 

not  sufficiently  foreseen.    The  thinking  of'the  '6O3     '  ^ 

was  predicated  on  a  normative  view  of-  organizational 

design.    It  was  not  based  on  an  understanding  of  the 

real-world  context  in  which  R/D&I  systenis  function 
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and  the  constraints  posed  by  empirical  reality  no 

matter  how  attractive  the  ideas  in  the  plan  may  seem 

in  the  abstract.    Consequently,  institutions  failed 

to  function  in  the  manner  expected*    And,  as  the 

new  institutions  competed  for  scarce  funds  with 

established,  and  in  some  cases  powerful  institutions 

with  whom  they  had  few  links  or  shared.  Interests, 

,  they  never  developed  the  kind  of  constituency  they 
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needed  if  they  were  to  survive  and  flourish. 
Slighted  by  the  creation  of  these  new  institutions 
were  not  only  the  universities  but >al30  the  State 
Departments  of  Education,  the  local  school  districts,- 
and  the  poweVful  education  interests  and  lobbies 


3i; 


 '  


that  could  have  been  of  some  assistance  in  generating 
politicaj'  and  financial  support  for  educational  R/d6cI. 
This  picture  was  complicated  further  by 'federal  poli- 
cies that  stimulated  the  growth  of  large  numbers  of 
not-for-profit  and  profit-oriented  corporations j  with 

a  rather  substantial  share  of  the  total  R/d&I  funding 

'    ♦  35 
pie  flowing^ to  these  organizations,    rather  than 

the  universities,  the  States,  and  the  local  districts, 

intensifying  even  more  the  conflict  over  scarce 

resources . 

'Having  selected  the  option  of  creating  a  large  network 
(f£  totally  new  institutions  to  conduct  educational 
R/D6cI,  other  policy  options  were^  if  not  consciously 
rejected,  effectively  closed  off.    One  such  closed- 
off  option  was  building  an  R/d&I  system  around  whatever 
high  power  talent  already  existed  in  or  could  be 
attracted  to  the  field.    Considering  the  excitement 
created  by  the  curriculum  improvement  prograiD  model 
of  the  late  '50s  and  early  *60s,  it  is  particularly 
interesting  that  this  m&del  was  rejected.    That  model 
assumed  that  eminent  scientists  and  mathematicians 
were  best  equipped  to  develop  the  new  instructional 
progra,ms  and  materials  needed  to  improve  the  teaching 
of  those  subject  areas*    The  strategy  revolved  around 
attracting,  and  providing  the  support  needed  to  keep,  • 
the  best  minds  working  on  these  projects^  The 
materials  were  of  sup'feri6r  quality  and  were  produced 
in  record  time  compared  to  the  lengthy  development 
cycles  that  characterize  the  functioning  of  the 
regional  laboratories.    And  they  were  installed  arfd 
utilized  in  large  numbers  of  school  districts  scross 
the  country.    The  prestige  of  the  scholars  working  - 
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OTV  these  projects  generalized  to  the  projects 
themselves  and ^  indirectly,  to  developmeut  efforts 
to  improve  educational  practice.    Later  analyses 
suggested  that  there  were  some  unanticipated  problems. 
The   programs   may  have  been  beyond  the  capabilities 
of  many  of  the  ^high  school  students  using  the  mate- 
rials.   They  were  designed^  it  was  argued^  with  only 
the  theoretical  structure  and  inquiry  paradigms  of 
^e  di.sciplines  in  mind  and  insufficient  attention 
to  problems  of  teaching  and  learning  on  the  high 
school  level.     And  too^  there  was  relatively  little 
in  the  way  of  systematic  evaluation  of  field  tests 
in  operational  settings^  with  subsequent  revisions, 
new  field  tests,  and  further  revisi<ins.     Still,  the 
instructional  programs  and  materials  proc^uced  by 
these  eminent  men  must  still  be  considered  far 
superior  to  most  such  outputs  produced  before  or  since. 

The  "best  minds"  model  might  have  been  adapted  to 
take  these  subsequently  discovered  problems  into 
account.    WSrk  teams  in^^t  have  been  modified  in  ^ 
future  functioning  to  permit  more  influence  from 
learning  psychologists  and  gifted  teachers.  ^Develop- 
inent  cycled  including  more  extensive  field  tests  and^ 
more  systematic  data-gathering  might  have  been  added 
to  the  operational  procedures  of  the  work  teams. 

Some  of  the  initial  ^iivisers  to  the  OE  planrters  who 
created  the  regional  laboratories^ had  urged  the 
creation  of  only  a*"  handful  of  laboratories  rather 
than  a  vast  network.    Their  recommendation  was  based 
on  the  assumption  that  the  success  of  the  laboratories 
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would  be  dependent  on  the  availability  of  critical 
masses  of  talent  to  staff  ^thetn       building  each 
laboratory  around  an  existing  "center  of  excellence"  - 
and  that  the  available  talent  in  the  field  was  in- 
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adequate  to  staff  more  thaTi  a  few  such  institutions. 
If  the  "best  minds"  model  had  held  sway,  a  few  ^uch 
institutions  might  have  been  created  in  the  begin- 
nings   The  high  quality  outputs  they  could  be 
expected  to  produce  would  bring  prestiifee  and  added 
Support  to  R/D^I  activity.     New  talent  pould  be 
attracted  and  trained.    The  organizational  base 
could  be  expanded  over  time  with  the  growth  of  the 
skilled  personnel  base  of  the  field-  Starting 
small,  with  a  high  level  of  talept,  would  also 
minimize  managerial  problems  and  permit  the  mana- 
gerial capabilities  of  the  federal  agencies 
sponsoring  and  monitoring  the  system  to  develop 
gradually.    Thus  managerial  capabilities  could  be 
developed  slowly  with  the  slow  growth  of  the  system 
rather  than  being  overwhelmed  by  enormous  demands 
and  problems  from  the  out^jt-    The  gradual  elimi- 
nation of  one  after  ano^^heif  of  ^the  laboratories  and 
centers  for  having  inade^ately  fulfilled  their 
promise  suggests  that  thos^^i^ho  argued  for  a  system 
ttiat  started  small  and  ^i^w.with  the  expansion  of 
the  talent  base  migl^t  have  been  correct  in  their 
analysis.  ^  ^ 

Educational  R/D&I  never  did  succeed  in  attra'::ting  larg 
numbers  of  eminint  scholars  from  other  fields  or  the 
"best  minds"  amoig  ths  graduate  students  selecting 
career  options!*    If  anything,  the  reputation  of  the 


field  seaiusj  w:^rse        the  late  '60s  than  It  had 
been  before.     It  may  wsll  b.3  that  one  of  the  mojt 
serious  weaknesses  of  educational  R/dSI  thinking 
in_  the  '60s  waj  this  ^aiphasis  on  creating  a  la^ge 
natvork  of  nt^  Institutions  in  accord  with  a 
norma':Ive  organizational  design  mster  plan  (and/ 
or  as  we  shall  note  shortly,  the  pressures  of 
politics)  tathef  than  developing  a  small  system 
arodnd  the  existing  talent  base  and  letting  It* 
grov  i^ith  that  base.    The  consequences  of  this 
approach  continue  to  be  felt  today  as  a  se;:ious 
constraint  on  policy  fomrjlation  and  R/D6tl 
functioning,        ,  ' 

ii,      Creat;ion  of  Institutions  Ex(3^rnal  to  ^the 
Opsratin,^  System 

m 

A  second  point  that  needs-.to       und  =  rscor*id  a'^out  the 

'60s  and  early  '70s  period  is  that  the  network  of 

institutions  created  by  federal  K/D&l  strategists 

V^s  almost  totally  external  to,  and  separata  from. 

the  o?3rating  system.     There  are  at  least  two  possible  . 

explanations  of  why  this  external  approach  was 

taken. 


One  explanation  is  at  the  heart  of  much  of  what 
D  =  rshim*Br  hat  described  in  his  history  of  the 
federal  role  in  institutionalizing  educational 
RScD  in  the  '6.0y.    Tne  fed^^ral  strategists  who. 
planned  and  managed  the  federal  sp':)n5{r^ip  of 
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these  new  institutions  were  tnemselves  outsiders 
to  the  OK  establishment         oi/tsiders  to  the  field 
of  education  and  the  esttobtfshed  earlier  reflation- 
ships  between  OE  personnel  and  practitioners  or 
their  allies  In  teacher  training  institutions,  stat:e 
departments  of  education^  and  other  supporting 
struttyres  of  the  operating  system.-   Not  only  were 
they  outsiders,  but  they  tended  to  view  the  whole 
operating  system  and  its  supporting  networks,  as 
well  as  the  educational  researc^j^imnunity ,  as 
gene^^ally  incompetent,  or  at  least  unable  to  bring 
about  the  kind  or  the  quality  of  changes  the  new 
OE- personnel  saw  as  needed.    Thus,  they  were  g^(|^rally 
oriented  toward  starting  anew,  with  establishment  of 

^ew  ins-titutions ,  staffed  by  new  personnel,  using 
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new  approaches.      Lit^tle  attention  was  focused  on 

what  already  existed^  especially  in  the  operating"  ■ 

system,  that  might  be  significant  foci    or  might  * 

even  be  usefully  integrated  with,  the  new  system. 

F  ^ 
*^  * 

The^e-is  another  possible  explanation  for  thisi 
orientation  toward  an  external,  R6cD-type  approach. 
The  prevailing  assumptions  in  OE  in  the  *603 
appa^en^y^ef lected  the  dominance  of  a  science 
viewpoint  in  federal  R&D  since  World  War  II  and 
the  postwar  formtilations  of  federal  science  policyly::^^ 
This*  science  viewpoint  is,  in  sharp  contrast  to^  the  more 
market-oriented  or  user-oriented  strategies  that 

have  achieved  substantial  prominence  in  current 
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edijcattonal  R/d&I  initiatives. 


As  applied  to  education,  the  science  viewpoint  meant; 
that  the  problens  of  educational  practice  were  attri- 


buted  to  Inadequacies  in  the  knowledge  b3^  of  the 
field  and,  the  quality  of  available  programs  and 
products  for  use  in  thh  schools.     Researchers  and 
other  experts  (rather  than  practitioners)  were  * 
assumed  to  be  best  equipped  to  determine  the  needs 
to  be  met  by  the  R/D6^I  system,  and  to  organize  and 
carry  out  R/d^cX  activities  to  meet  these  needs.  High 
quality  products  could  be  produced  most  efficiently 
and  effectively,  it  was  argued,  if  critical  masses 
of  talent  in  specialized  areas  were  assembled  to  ^ 
work  together  on  large  scale  projects  providing, 
Extensive  testing  utidsr  varied  implementation  con^ 
ditions.    The  higtj  de7e£lopment  costs  of  this  approach 
could  be  overcome  by  nationwide  dissemination  of 
system  outputs,  resulting  in  a  low  per  unit  fiost  for 
the  finislj^  package.    Concentration  of  critical 
masses  of  talent  would  not  Vnly  speed  and  enhance 
the  quality  of  product  development^  according  to 
thi^-^fview*     It  would  probably  also  enhante  the 
development  of  the  knowledge  base  of  the  field. 

Several  problematic  aspects  of  this  view  w^e  ignored. 
Were  R6D  personnel  really  better  equl/Sped  than  user 
system  personnel  to  define  user  system  need??^  Did 
R6cD  personnel  have,  sufficient  understanding  of  user 
system  conditions  and  constraints  Dp  develop  products 
that  would  adopted  enthusiast icallyj^jr  implemented 
effectively?    Given  the  chaotic  nature  of  the  edu- 
cational marketplace,  could  externally-developed 
R&D  products  be  marketed  effectively  enough  to  insure 
widespread  addpti^n  and  implementation  and  therefore 
make  up  for  a  p^duct's  high  developmental  costs? 
Given  the  complej<ity  of  educational  innovations  and 
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the  considerable  diEEiculties  Eaced  in  getting 
externally  developed  innovations  adopted  and 
implemented  in  school  systems,  how  reasonable  was 
the  conceatration-of  resources  .on  external  R/D&I? 
Given  the  substantial/amount  of  genuine  innovation 
that  is  found  in  many  school  systems  albeit 
generally  undocumented  and  relatively  underdeveloped 
innovation       might  nop  the  user  system  be  a  natural 
institutional  base  for  R/D6cI  activities?    And  so  on.  ' 
The  external  R^D^^  strategy  tended  to  take  the  user 
system  for  granted  as  the  last  link  in  the  pass-it-on 
chain  oE  R/DScI^/^ithout  adequate  attention  to  its^ 
potential  for  functioning  in  a  KP  as  well  as  a  KU 
capacity,  and  without  adequate  comprehension  of  the, 
complexity  of  the  dissemination/marketing,  acquisi- 
xtion,  and  ttfe  implementation/utilization  functions 
for  externflly-develbped  R6tD  oi^tputs. 

ili>    Mi^nmm  of  Planning 

Our  thi^^d  major  point  is  that  this  network  of  insti- 
tutioT^  was  created  and  began  functioning  with  a 
minimum  of  plannin^^  without  adequate  consideration 
of  tl?ie  functional  requirements  of  such  a  system, 
without  formulation  of  an  overall  R/D6cI  strategy, 
,or  elaboration  or  communication  of  goals,  or  develop- 
ment of  a  consensus  among  R/D6cI  personnel  about  these 

goals  or  OE  expectat^^ons  about  how  they  were  to  be 
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achieved* 


Federal  officials  were  not. wholly  to  blame  for  this 
situation.     Political  pressures  wer^enormous *  ,  There 
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was  pressure  toget  the  system  operational  and 

visible,  _and  to  produce  iiranediate^  observable^ 

42  ' 

quick-payoff  outputs  and  benefits.      Much  the 
same  pattern  could  be  seen  in  the  establishment 
of  the  Community  Action  Agencies  (CMs)  at  this 
time  as  the* organizational  vehicles  of  the  |^verty 
program.    The  advice  of  experts  to  create  a  fev 
veil  funded  and  strongly  staffed  centers  and 
laboratories  (or  cXas)  was  ignored  4n  favor  of  a 
more  political  approach^  spreading  large  numbers 
of  such  organizations  across  the  count^^y  to.J^e 


clearly  visible  to  various  constituencies* 


A3 


The  need  fpr  a  period  of  goal  elaboration^  strategy 
planning^  and  adequate  staffing  and  organizing  was 
ignored  as  well.    Long-term  ^capability-building" 
programs  to  develop  the  R/d&I  system  were  given 
minimal  support  in  comparison  to  the  funding  of 
short-term  prodnact  and  program  development.  Quick 
results  and  achievements  were  emphasized  over  the 
kinds  of  long-term  ^system-building^programs  that 
might  produce  more  significant  outputs  and  benefits 
in  the  future/    Consequently^  the  systerA  remained 
week  in  its  knowledge  and  technology  base^  its 

personnel)  its  information  flow  patterns  and  c 

^\ 

muntcation  networks^  its  funding,  etc-,  and 
failed^  to  develops  the  kind  of  constituency  and  poli- 
"  tical  support  so  essential  to  its  long-tern5  survival. 


The  analogy  between  the  educational  R/D^I  laboratories 
^and  centers,  on  the  one  hand^  and'the  poverty  pro/ram's 
CAASj  on  the  othet,  siiggears  another  historical/point 
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^ —  that  should  be  loade.    Social  reform  in  this  country 

'  '  seems  to  ehb  and  flow  in  cyclical  fashion,  with 

periods  of  reform  followed  by  disenchantment  and 
'    coTiservatism,  consolidating  gains  and  resting  from 
^  the  turbulence  of  the  rlSform  years.    The  educational 

i  RSD  laboratories  and  centers  were  created,,  along  with 

the  CAASj  during  one  such  reform  upswing  in  the  cycle. 
Those  historical  circumstances  surrounding  the  system's 
birth  were  of  some  signi^cance  for  its  future.  Insti- 
tutions created  in  reform  periods  benefit  from  the  high 
hopes  and  expectations  of  the  historical  milieu  out  of 
which  they  emerge.    But  they  are  fragile,  and  are 
equally  likely  to  suffer  from  the  general  atmosphere 
'of  disillusioTUT^ent  and  reaction  that  sets  in  with  the 
cyclical  downswing*    If  they  survive  the  downswing  and' 
become, part  of  what  is  consolidated  in  the  respite 
^  ^  before  the  next  reform. period ,  their  long-term  prospects 

are  enhanced. 

Educational  R/D£^I  appeared  until  ^  year  or  so  ago  to 
still  be  teetering  ^on  the  brink.     OEO  and  the  CAAs 
failed  to  survive  the  period  of  disillusionment  and  ^ 
*  ^reaction.    Educational  R/D&I  was  given  a  reprieve  by 

being  transferred  from  the  control  of  OE  in  1972  to 
a  wholly  new  institution,  the  National  Institute  pf 
Education  (Nil)  -  It  seeme?  early  in  the  history  of 
<  NTE  that  this  reprieve  was  only  temporary-  We  turn 
noy  to  the  history  of  educational  R/D£el  under  NIE 
leadership  ovei^  the  last  five  years. 

2.      The  HIE:     Early  Historv 

  ^ 

The  federal 'government  remains  the  primary  sponsor  o£,  and  domir.ant 
influence  on,  the  development  of  the  R/D£^I  system  in  education.  But 
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the  direction  of  system  development  under  NIE  auspices  has  been  some- 
what at  variance  from  the  previous  OE  pattern.    The  liTTrature  pro- 
duced by  and  about  NiE  suggests  that  the  NIE  pol  icymalcers  have  held 
rather  different  assumptions  about  the  nature  of  the  R/d^I  system 
needed  and  the  strategies  required  to^ create  that  system^      One  of 
NIE's  more  substantial  achievements  to  date  --  with  perhaps  the 
most  fundamental  and  long-term  implications  for  system  development  -- 
may  well  be  this  r^hinl^lig  of  fundamental  questions  and  reconsidera- 
tion of  policy  options  that  were  either  ignored  or  rejected  during 
the  previous  period.     But  the  stormy  history  of  the  early  years  of 
the  Institute,  and  its  near  destruction  by  powerful  forces  in  Washington, 
may  still  affect  system  developoent  and  R^iD£tI  functioning  for  some 
ti^^^o  come.     We  therefore  revle*^  some  of  this  history  briefly* 

NIE  was  created  In  1972  in  an  atmosphere  of  high  hopes  and  expecta- 
tions*   The  Institute  was  created  hy  an  Administration-sponsored  bill 

and  appeared  to  be  backed  by  powerful  supporters,     it  benefited  from 

L- 

'  the  intended  analogy  to  the  prestigious  National  Institutes  of  Health 

■  ^ 

^  and  the  National  Science  Foundation.    The  ^iifitence  of  a  National 


yiifitence  of  a  I 
srcorn^  Congress ' : 


Institute  of  Education  was  expected  to  overEom^  Congress '  s  lack  of 

confidence  in  th't^bility  of  OE  to  manage  R6J)  resource3>  and'some  of 

its  reservations  about  RSD  in  general  and  edjiicat  lonal  R&D  in  par- 

ticular.      Creation  of  an  Institute  was ^expected  to  raise  the  status 

of  educational  research^^  and  ^'ttract  a  staff  of  first  rate  scientists  > 

47 

social  scientists,  and  educators. 


However,  these  high'Thopes  were  dashed  quickly.    Protilems  were  encoun- 
tered almost  from  the  outset.    The  first  source  of  the  problem  was  the 
Administration  itself.    The  Administration  had  initially  called  for  a 
commitment  of  $150  million  to  NIE  for  Fiscal^73*    But  by  the  time 
the  Administration  had  made  its  budget  proposals  public,  that  figure 
had  been  cut  back  to  $125  million,  of  which  $S0  to  $100  million  was 
needed  to  cover  e^iistlng^  programs  trai^^ferred  to  the  Institute  -- 
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e,g*,  the  programs  of  the  Natio^l  Center  for  Educational  Research 

and  Development,  the  ejcperimental  schools  program,  and  the  career 
A8 

education  prograp.      The  Administration  delayed  for  months  in 
selecting  Tom  Glennan  as  the  Institute's  Director,  then  additional 
months  in  appointing  the  National  Council  on  Educational  Research, 
vhich  was  ilegally  the  body  given  policymaking  authority  for  the 
Institute,     Consequently,  ic'was  difficult  fbr_ Glennan  to  give 
Congress  an  unambiguous  picture  of  the  Institute's  plans  and  policies 
in  the  absence       a  functioning  Council  to  authorize  proposed  plans* 
Congress  expected  the  Institute  to  take  a  strong  leadership  position, 
and  instead  plans  h^  to  be  described  tentatively  and  speculatively. 
When  the  appointments  to  the  Council  were  finally  announced  and  in- 
eluded  only  one  eminent  researcher  among  15  appointees,  whatever 
high  hopes  the  RficD  community  might  have  had  for  the  Institute  seemed 
mocked*      Some  accounts  suggest  that  the  difficulty  in  finding 
eminent  researchers  to  appoint  to  the  Council  was  finding  eminent 
researchers  who  were  also  politically  acceptable  ^o  this  Watergate-era 
Administration?    Whether  or  net  this  was  true,  the  quality  of  the 


appointments  made  suggested  that  the  Administration  was  no  longer  to 
be  considered  among  \ 
shrinking  in  nutnbers- 


be  considered  among  the  friends  of  the  Institute,  who  were  fast  ; 


The  most  serious  problems  were  encountered  in  the  annual  appropriations 
struggles  with  Congress.    The  Administration's  initial  NIE  budget  request 
for  Fiscal  1973  was  3125  million.    But  by  the  time  this  passed  the 
Congressional  appropriations  hurdle,  the^ appropriation  actually  made 
was  $106. a. million.    Since  $8^^^o  $100  million  was  needed  to  cover 
e:cisting  obligations  to  OE  programs  transferred  to  the  Institute,  this 
provided  relatively  little  "new  money"  for  ^he  Institute  to  develop 
new  initiatives  and  a  program  of  its  qwn^^    But  that  was  a  honeymoon 
situation  coppared  to  the  budget  allocations  for  Che  Institute  in 
Fiscal  1974  and  ^iscal^l975  —  $75.7  million  and  $70.0  million 
respectively.    These  1974  atjd  L975^  figures  represented  the'  smallest 
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federal  allocations'  to  educational  R/D^I  since  the  system  created 

a  decade  earlier.     As  described  by  Congressman  John  Bradeoas  (D-Ind.)> 

a  friend  of  the  Institute  and  of  educational  R/D6I ^  the  Fiscal  1974 

budget  fight  provided  an  unmistakable  clue  that^IE  was  in  trouble; 

"Than  the  $162  million  recommended  by  an  anti-education  Adtninistr^- ^ 

tion  should  have  been  reduced  to  575  million  by  a  Congress  that  cor/- 

sistently  votes  more  money  for  education  that  the  President  wants 

52 

is  dramatic  evidence  of  these  troubles*^*    One  writer  who  bas  been 
following  ^lE's  appropriations  cWfficulties  for  the  A£Rt\*^s  monthly 
Educational  Researcher  described  the  situation  in  these  terms^  '^t 
has  been  a  painful  process  for  the  Institute  to  see  a  $162  million 
budget  request  for  Fiscal  1974  get  shaved  to  5142  million  by  t>ie 
House^  then  dive  to  $50  million  during  the  deliberations  of  the 
Senate  Appropriations  Committee ^  and  finally  emerge  from  the  Senate 
at  $75  million/'^'' 

The  Fiscal  1974  cuts  were  devastating.     But^^the  Fiscal  1975  appropria* 
tions  crisis  was  nearly  the  institute  *  s  death  blow.    The  $130  million 
requested  was  reduced  to  $100  million  by  the  House  Appropriations  Com- 
mittee, and  reduced  further  to  $85>TOlllion  in  the  bill  initially  passed 
by  the  full  House.    But  most  serious  of  all,  the  Senate  Appropriations 
Committee  recommended  zero  funding  for  Fiscal  1975  and  this  was  reflec- 
ted in  the  Senate-passed  bill,     Firval  determination  of  a  compromise 
figure  was  left  to  the  House-Senate  conferees  on  the  bilP.     If  the 
compromise  had  been  a  $40  million  averaging  of  the  two  recommendations, 

this  would  h^ve  covered  only  existing  obligations  and  would  h^ve 

54 

meant  essentially  a  phaseout  of  HIE.      As  it  turned  out  ^  the  final 
figure  appropriated  was  around  $70  million  and  the  NIE  appropriation 
stabilized  around  that  figure  for  fiscal  1975,  1976,  and  1977,  with 
a  significant  increase  to  nearly  $90  million  for  Fiscal  1978.  It 
would  seem",  then,  that  the  worrr^s  probably  over;  and  NtE*s  future 
appears  to  be  assured.     But  clearly,  the  real  threat  of  a  phase-out 
so  early  in  t^he  Institute's  history  had  a  m^^jor  impact  at  the  time. 
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felt  over  the  short  run  in  the  resignation  of  Tom  Glennan  as  NIE's 
Director^  followed  by  resignation  o£  the  Chairnian  of  the  National 
Council  on  Educational  Research  in  protest  over  Glennan's  resignation. 
And  too  J  it  should  be  noCed>  the  size  of  NIE's  a^ipropriations  ^  con- 
siderably stTialler  than  NIE's  planners-  had  anticipated  or  that  NIE's  ; 
leadership  requested  each  year,  has  been  a  critical  continuing  cDn- 
straint  on  the  Institute  and  its  program  planning. 

Why  did  NIE  encounter  such  difficulties  and  inake  such  powerful 
enemies?    Clearly,  much  of  the  problem  predates  NIE.  Educational 
R£tD  has  had  ^powerfuI  enemies  for  soma  time,  in  the  Congress,  in  the 
Office  o£  Management  and  Budget,  ^nd  in  the  Office  of  Science  and 
Technology-      But  equally  cXearl/,  N'lE  did  a  poor  job  of  developing 
support  in  Congress  and  in  developing  a  constituency  among,  or  even 
significant  links  to  c<r  support  from,  researchers  and  powerful  edu-^ 
cation  interests?^    There  was  little  contact  between  NIE  staffers 
and  Congress  during  the  critical  early  period.    Glennan  decided  to 
let  the  liaison  work  be  carried  out  by  HEW's  liaison'staff  rather 
than  diverting  his  own  staff's  energies  to  this  critical  function. 
Consequently,  small  problems  that  were  not  attended  to  became  bi^ 
problems,  and  the  Institute*s  leadership  was  unaware  of  .the  developing 
problems  until  they  were  overwhelmed  by  them.      And  the  educational 
research  community  failed  to  provi-de  any  substantial  assistance  to 
NIE  in  developing  support  in  Congr^s.    AERA  leadership  charged  that 

educational  R^J)  was  being  "poll ticalized'^        that  political  considera- 

58 

tions  were  outweighing  technical  ones.      But  AERA  did  relatively 

«* 

little  to  niobilize  its  membershi^p  during  these  early  years,  and  has 

only  recently  begun  working  on  a  political  liaison  progratn  to  improve 

59 

the  political  environment  of  the  educational  R/D6I  system. 


NIE's  budget  problems  Inevitably  necessitated  cuts  in  programs  and 
reorganizations  of  the  Institute's  internal  structure,  continuing 
the  overall  structural  instability  tha|  characterized  ^he  OE  years. 
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If  NIE  was  to  "free  up"  any  funds  for  new  initiatives  of  its  own, 
the  Institute  was  forced  to  f^nd  ways  to  chop  existing  progra*nis. 
Inevitably,  this  would  alienate  parts  of  the  R/D6I  community  hurt 
by  the  cuts,  further  complicating  the  Institute's  political  probletas* 

3*  Leadership:     Assunptions  and  Strategies 


Despite  these  difficulties,  there  has  been  some  first-rate  thinking 

going  on  inside  the  agency       a  fundamental  reassessment  of  the  R/D&I 

assumptiTDns  and  strategies  of  the  ^60s,  and  the  formulation  of  an 

important  agenda  for  K/D&l  system  evolution  vhile  directing  R/D&I 

resources  to  some  important  needs  of  the  educational  system.    We  base 

our  evaluation  primarily  on  the  examination  of  NIE  documents  describing 

6 1  ^ 

rationales  ,  proposals ,  and  funded  R/Dinl  ac  tivities.      Documents  can 

be  misleading  in  suggesting  more  order,  consistency,  and  interrelation 

of  ideas  and  activities  than  exists  in  reality.     Still,  they  provide 

the  best  information  available  to  us,  and  are,  at  any  rate,  interesting 

in  their  own  right,  / 


We  not^d  earlier  that  the  federal  R/D&I  strategy  in  the  '60s  focused 
on  creating  and  operating  a  network  of  wholly  new  organizational 
forms  and  inst itutions  external  to  the  operating  system.    Much  of 
the  thinking  appears  to  have  been  premised  on  a  linear,  '*pass-it-*on" 
model  of  R/D&J  functions  that  placed  the  new  network  of  external 
R6tD  institutions  at  the  active,  knowledge  and  product  producing  end 
of  the  KPU  spectrum  and  placed  the  operating  educational  system  at  the 
passive,  target  end  of  the  spectrum.    The  key  barrier  to  the  improve- 
ment  of  educational  practice  was  assumed  to  be  an  inadequate  supply  of 
well  developed,  fully  tested  and  validated  programs  and  products  for 
use  in  the  operating  system.    Therefore,  the  strategy  focused  on 
creating  and  supporting  new"  institutions  that  would  specialize  in 
developing  and  testing  such  products  and  programs.  Widespread 
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adoption  and  effective  implementation  of  these  externally  developed 
products  were  assuned  to  follow  inevitably  from  their  availability, 
and  little  if  any  thinking  was  directed  at  operating  (i.e,,  ''user") 
system  problems  inherent  in  external  R/D5tl  strategies, 

Ue  get  a  rather  different  picture  from  our  reading  of  the  NIE 
literature.    The  literatur^  suggests  a  more  comprehensive  approach  ^ 
to  the  education  sector  as  a  whole.    Clearly,  it  represents  an  effort 
to  restore  a  more  balanced  judgment  of  the  diverse  sources  of  weaj;^ 
ness  and  potential  st^rength  in  the  education  sector  and  the  range  of 
interrelated  leverage  points  providing  opportunities  for  policy  in^ 
tervention*    Also,  from  the  very  outset,  statements  by  NIE's  leaders- 
ship  set  a  less  doctrinaire  tone^  a  more  experimental  (but  system- 
atically experimental)  approach  to  the  determination  of  strategies  ^ 

and  methodologies^  for  both  solving  educational  problems  and  building 

t  62 
an  R/D6I  systed* 

A,      More  Balance  Between  KP  and  KU 

The  educational  R/D6I  strategies  of  the  '60s  focused  largely. 

on  KP  futictions  —  e*e,j  on  research  and  development,  Wiile 

research  and  R&D  activities  are  still  centi:^!  to  the  programs 

funded  by  HIE^  and  continue  to  receive  the  bulk  of ■  the 
63 

Agency's  budget ^      federal  education  policy  (as  reflected  in 

the  programs  of^IE  ^s  well  as  other  federal  agencies  such 
64 

as  USOE)      places  more  emphasis  than  ever  before  on  dissemi- 
nation of  externally  produced  programs  and  on  developing 
internal  operating  system  capabilities  for  identifying 
pro^lemsj  developing  solutions^  ^nd  effectively  implementing 
and  utilizing  innovations,  products^  programs  and  the  like^ 
whether  developed  internally  or  externally. 
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a.      The  Importance  of  Dissemination  and  Linkage  ^  . 

Illustrative  of  the  importance  KIE  has  come  to  attach 

to  dissemination  was  the  tripling  of  the  Institute's 

allocation  for  its  dissecaination  program  in  its  Fiscal 
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1976  budget  request    and  the  following  Dissemination 

and  Resources  Group  program  description  from  the  FY  1978 
66 

Progran  Plans: 

Problem  Statement:    Schools  and  students  have 
derived  relatively  few  benefits  from  the  results 
of  research  and  'development.    Because  information 
about  newly  acquired  knowledge  and  better  instruc- 
tional methods  does  not  geaerally  reach  teachers 
and  administrators  in  a  timely  fashion,  the  educa- 
tion system  is  often  slow  to  itnplement  useful  in- 
novations.   Improved  coicmunicat  ion  and  linkage 
between  the  research  community  and  organizations 
State,  intermediate  and  local  education  agencies, 
*  teacher  education  institutions,  professional 
associations       serving  educators. in  the  field  are 
needed  to  speed  , the  flow  of  new  ideas  into  practice. 

Program  Purpose:  *To  improve  the  dissemination  aqji 
use  of  knowledge  *  for  solving  educational  problems; 

Assuring  access  to  available-knowledge  resources: 
'Programs  in  this  area  are  c6ncerned  with,  providing 
the  education  community  a  wider  range  of  knowledge 
resources  about  education,  and  with  making  this 
expanded  knowledge  base  md^e  accessible  and  easier 
to  use-    Knowledge  resources  include  ^oth  the  general 
type  that  provides  assistance  in  confronting  a  broad 
range  of  issues  in  education,  and  the  targeted  type 
that  provides  information  on  specific  topics^^ 

Specific  activities  include: 

Continuing  and  improving  the  ERIC  system 

Identifying  and  cataloging  of  R&D  outcomes; 
development  of  interpretive  analyses  on  how* 
these  outcomes  can  be  used  to  improve  edu- 
cational practice  ,   ,  . 

« 
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Strengtheriing  linkages  between         and  practice. 
While  the  objective  of  improving  linkages  between 
the  many  components  of  the  education  and  research 
communities  is  at  the^heart  o£  most  of  the  Group's 
activities,  this  strategy  is  concerned  specifically 
with  linking  research  and  practice  in  order  to  help 
education  practitioners  to  identify,  examine,  and 
effectively  impl-ement  R6tD-based  solutions  to  high- 
priority  educational  problems. 

Specific  activities  include; 

R6D  utilization  progran--local,  intermediate, 
and  State  education  agencies,  Rsd  organizations ^ 
and  institutions  of  higher  education  work 
together  to  provide  technical  assistance  to 
local  schools* 

R6tD  dissemination  and  **feed-f orward**  system 
(now  referred  to  as  the  R6tD  Exchange  program) 

R&D  organizations  cooperate  in  providing 
client-oriented  information  describing  available 
K&D  products  to  schools  and  in  assessing  the 
impact  of  R6tD  on  users* 

A  project  to  coordinate  and  synthesize  training 
materials  for  linking  agents  and  to  conduct 
pi  lot  training  programs  * 

b.      Develop^tent  of  Inte^al  Operating  System  Capabilities 

The  Institute's  concern  with  developing  internal  operating 

system  capabilities  in  problem  definition  and  solution  is 

evident  in  several  of  its  programs.    As  described  in  1978 
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Program  Plans : 

State  ind  Local  Capacity  Building;    The  Institute  is 
committed  to  strengthening  the  RSD  utilization  and 
perf^rnance  capabilities  within  local  schools,  school 
districts,  and.  State  education  agencies*    Few  states 
and  fewer  districts  and  schools  have  R6tD  capabilities 
as  the^e  functions  are  traditionally  defined*  In 
addition^  local  use  of  the  results  of  a  decade  of 
Federally-supported  R&D  has  been  disappointing.  To 
address  these  issues,  NIE  will  increase  its  assistance 
to  State  and  local  agencies  in  developing  their 
capacity  to: 


Improve  th^eir  probleia-solvitig  processes; 

Evaluate  ^nd  utilize  R6tD  products  developed 
elsewhere; 

Undertake  comprehensive  progr£im  change;  and 

Respond  systematicariy  and  knowledge'Sbly  to 
policy  issues  ot  local.  State,  and  national 
importance , 

* 

Hig-hliahts  of  FY  1978"^ Program; 

Continue  tj)  build  dissemination  capacity  through 
support  .cTi  up  to  AO  State  agencies  and  modest 
Support  of  other  selected  education  organizations. 

Building  capacity  in  the  education  system:  Programs 
in  this  area  are  presently  concerned  with  increasing 
the  capacity  of  State  education  agencies  to  disseminate 
and  use  knowledge.    Capacity-building  programs  are  now 
being  extended  to  other  settings. 

Specific  activities  include;  f 

State  dissemination  capacity  building,  ^ 

^  Capacity  building  in  other  settings  education 
associations,  connmitlity  colleges,  teacher  educa* 
tion  institutiprr^  large  school  systems. 

Dissemination  leadership  pr<>gram. 

Training  and  technical  assistance  for  mitiorities 
fe*  increase  their  participation  in  the  production, 
dissemination,  and  implementation  of  education  RCJ) , 


In  addition,  NIE's    Local  Problem-Solving  Group  funded: 
(a)  nine  innovative  projects  in  urban  schools  designed  to 
Increase  their  capacity  to  solve  problems,  and  Xb)  a  docu- 
mentation and,  technical  assistance  pro'ject  designed  "to 
docuraent^  tfie  activities  of  these  sites  and  attempt  to  use 
directly  the  knowledge  gained  from  the  documentation  to 

help  other  urban  schools  to  improve  their  capacity  for 
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problem  solving/'       The  latter  Documentation  ^nd  Technical  «^ 


Assistance  program  Ls. ambitious  in  cPciceptioci,  concerned 
as  it  is  with:  ^ 

Documentation:  To  develop  a  data  based  defir\ition 
and  ana,lysis  of  local  capacity  for  problem  solving 
in  urban  schools ^ 

Technical  Assistance:  To  develop  through  ^J'ractice 
effective  ways  to  U^lp  local  urban  schools  build 
a  .sustained  organizational  capacity  to  solve 
^  problems. 

Linkage:    Xo  connect  the  documentation  of  the  ni 
problem-solving  projects  funded  by  NIE  with  DIA ^ 
technical  assistance  efforts  and  to  study  the  connec- 
tions to  learn  hbw  education'algresa^rch  ^d  practice 
c^n  better  inform  each  other* 

c     •  ■  ' 

The  contractor's  implementation  of  the  program,  however, 
has  not  lived  up  to  these  *high  expectations.        Still,  trie 
program  is  iaportant  for  demonstrating  NIEs  commitment  to 
r  strengthening  local  school  capacity  for  problem-solving  and 
for  its  interesting  research-on-rssearch  design. 


Sunsnar-y 


Clearly,  then,  tWe  NIE  strateg/  takCT--a^ much  more  balanced' 
approach^  than^he  previous  OE  strategy  to  the  support  of 
internal^^Mtftcrnal  R6J)^  resoqpces^  and  to  funding  of  bj^th 
KP  jvhether  internal  or  external)  and  linkage  and 

support^MHxions  required  improve  prdduct  dissemination, 
delivery,  acquisition^  implementation  and  utilization* 


B>     ^Balance  Bet^ween  Working;  with  Older  and  l^ever  r/d&I  Institu- 
tions:.^ Horkiwith  gHAs  and  LEAs ,  Teacher  Training  Institu- 

tlonsj  and  Education  Associat ions 
— I   ~  

In  addition  to 'greater  balance  between  KP  and  KU  functions  in 
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the  programs  currently  receiving  support ^  there  is  a  second 
importiai^t:  reLaced  point  of  contrast  between  the  OE  and  NIE 
r/D^I  strat-egie*.    While  thinking  during  the  OE.  year^ 
focused  largely  on  the  new  institutions  created  by  federal 
funding  to  carry  out  R6cD  functions  ^  the  NiE  strategy  places  a 
good  deal  of  emphasis^n  working  with  and  through  the  older 
institui*icms  that  were  ^largely  ignored  by  the  OE  R6cD  strategies^ 
Working  with  and  through  state  departments  of  education  and 
local  school  districts  is  a  pattern  of  special  importance  to  the 
WIE  strategy*    As  described  in  one  NIE  document: 


NiE  strategy  recognizes  that  the  State  agencies  are  in  a 
key  positiocTto  build  an  effective^  dissemination  system 
in  education*    The  States  ^re  legally  responsible  for 
education  in  the  United  States;  they  are  unique  in  their  ' 
ability  to  allocate  a  range  of  resources  for  regulation^ 
finance^  and  leadership  in  education;  and  they  are  in  a 
strategic  position  to  link  the  R6cD  community  to  a  sub- 
stantial majority  of  educational  practitioners  .  * 
we  will  be  "working  with  the  States  and  others  to  an^yze 
and  catalog  available,  research  knowledge^  product*^  and 
exemplary  local  practices;  to  train  intermediate  agents 
within  the  States  who  can  help  schools  apply  that  knowl- 
edge; and'to  make  available  the  technical'  resources  of  R6cD 
organizations  to  help  schools  establish  new  programs  or 
practices  base^  on  that  knowledge* 


Another  NIE- document  takes  note  of  the  increasing  leadership  role 
exercised  by  more  and  more  State  Education  Agencies  over  the  last 
decade  J  including  suqJj,  functions  as  needs  assessment  and  long  range 

planning^  identifying  and . diffusing  successful  innovations^  and 
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,  providifig  information* services  and  technical  assistance*  The 

r  > 

NIE  strategy  is  designed  to  support  and  strengthen  the  states  in 
th|^  efforts^  a^  a  means  of  buMding  on  an  existing  resource 
base  and  therefore  stretching  the+ effect  of  the  federal  money 
invested  in  dissemination.    The  strategy  is  expected  to  ,be  more 
cost  effective  in  the  long  run^  and  probably,  more  effective  in 
impact  regardless  of  co3ts  because  of  the  added  possibilities  of 
providing  Services  through  the  states  that  ,are  tailored  more 

■i 
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adequately  to  local  district  needs,   ^^is  point  Is.  rnade  in^n, 
NIE  document  describing  the  Consumer  InforEnatlon  CoRipoiaent 
(now  part  of  the  R£J)  Exchange  Progra[n)/and  the  RiJ)  Utilization 
Component  of  ^lE* s  dissemination  program.    The, general  strategy 
is  described  as ;  ^  , 


a  linkage  strategy,  building  upon  the  ^ork"b'f  existing 
dissemination  programs  and  agehclcs  rather r than  creating'  " 

,  new  ones;  this  has  resulted  In  activities  -that  can  fee    ,    '  , 
combined  with  existing  programs,  and,  activities  that 
capitalize  on  shared  resources,  collaborative  efforts,  ^d 
joint  funding  ,   /  ,  The  objectives  Df;elther  componei^t 
could  be*  raanage<i,  centrally,  by  NIE,  or  could  be  addressed 
and  managed  separately  by  state  and  local  agencfts.  The 
design-proposed  by  this  program  is  to  adopt  s  minted  approach 
irT^ich  thee  resource-based  cH^jecCive^  (Consumer^  Information 
Component)  are  coorjjinated  centrally  with  input  and. help 
from  the  field,  ,while  the  utilizattoB  support  objectives 
(K£J)  Utillzatipn  Component)  "are  predominant,^  coordinated  by 

'  state  and  local  agencies  with  advi.ce  and  counsel  from  NIE-. 
This  mixed  approach  was  adopted  to  reflect  th^  tradeoff 

^between  the  importance  of  iopuri^ng  that  everything  is 
directly  related  to  each  user's  aeeds  and  efficiencies  of 
scale  and  benefits  of  mutual  collaboration  possible  when 
all  are  addressing  a  similar  pjfoblem.    It  Is  thought  that 
the  advantages  of  mutual  collaboration  and  the  potential^ 
for  efficiencies  of  scal^  are  more  likely  to  appear  in 
building  the  resource  base;  there  Is  rot  as*  great  a  likeli- 
hood of  them  appearing  irf  the  implementation  work.  In 
addition,  a  centralized  m&nagement  approach  Is  more  suscep- 
tible to  failure  by  not  reflecting  the  needs  of  individual 
clients  and  situations  involved  ln-,^he  utilization  activities 
than  the  resource  base  activities  *  ^ 


Rather  than  assuming  that  the  best  solutjfeons  will  be  d.eveloped  by 
researchers  and  experts  in  specialized  external  KP  facilities 
suclf  as  the  centers  and  laboratories,  the  NIE  strategy  has  pro'- 
vided  substantlal^support  for  locally  developed  innovations  and 
local  innovation^nd  innovati^^L-^upport  processes  a^  important 
alternative  sources  of  innovation,  and  perhaps  more  cost-effective  ' 
sources  as  well.    Tl^erefore,  by  building  on  existing  resource  bases 
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throughout  The  of>eT^atins  as  w^HJ^-a^  the  R£J)  systems  In  education^ 
■IS^E' expef^ts  to  devaiop  i3^D;ro^:tegrat.ed ,  ^mqre  pr^ctice-priented , 
and  c}^a/ly  more  jiecentrali2«d/and  market-oriented  strtcture, 
■Instead  or  view£ftg         re^uTQ^^ai  concentrated  in  a  relatively 
.  small  ne"ti?9T?k  o't:  R4i£)  institutions  external       the  ^ast  operating 
■  ^.j^stenr  of  So'^C^e-^^ducaiti^oB <^^gfencix>s ,  17,000  or  so  school  dis- 
.tricta,  thpusands  ^f'pvofessional  and  lay  crrganizations  concerned 
^"T^th  education, 'etc,  ,  dll  institutions  and  groups  within  the 
education  sector  arid  iie^  cnvironnient  ara  viewed  as  potential  bases 
of^  the'KP^ras  w&Ilras  KU  artd-iinkage  resout^s  and  actirvit^Tfes ,  - 
yhus  1978  program  pla^is  of  the-  Institute,  inclu<£e  support^  for      '  . 
capacity-buildxng  and  other  progr^ams  in  State  Education  Ag^^n^es, 
local  School  districts,  teacher  education  ij^stitutions,  community 
colleges and  education  organizations . ^  The  A6l:ion^of  critical  ■  V 
masses  of  scientific  tilear  is.  not  displaced  in  the  NIE  stra- 
tegy      most  research  and  R6cD  grant?  and  contracts  are  still  awar?^  , 
to  the  universities  and  Specialised  R^  institutions.    But;  in 
addition,  we  see  programs  designed  to^mobilize  other  bases  of 
org^ifeational  renewal  --^e^g.*;  teachers  (teacher  centers  and 
advisories)  arid  parents  (parents  advisory  groupps  and  parent  in- 
formation  centers).  ^  In  addition  to  disseiilination  strategies 
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designed  to  increase  information  flows  among  research  and 

peifsonnel,  and  between  the  research  and  R&D  communities,  on  the 

one  hand,  and  operating  system  personnel,  on  the.  other^""NIE 

documents  have  ejTpi^essed  interest  in  strategies(te^tgned  to  create 

iijiormal  communication  netw6rks  among  school  sysreiSi  sharing 

interests  in  particular  approaches,  strategies,  etc*  (e.g*r 

reating  netwo^ljs  of  teacher  centers,  other  networks  of  rural 

education  helping  agencies,*  and  still  other  networks  of  parent 

7-7 

information  centers)*        If  sucj>>netvorks  can  be  created  oven" 
time,  and  perhaps  be  linked  up  to  each  other  and  the  various, 
resource  bases  for  educational  R/D&I  and  ^organizational  renewal, 
this  approach  may  prove  to  have  been  the  key  to  stimulating  KP- 


t 

KU  integration  and  system  maturation,     (We  have  noted  here  only 
those  instances  where  NIE  has  opted  to  work  with  thes'fe  various 
operating  system  organizations  or  institutions  closely  related 
to  the  operating  system.    If  one  vere  to  analyze  currei\t  OE  R£J)- 
related  programs,  numerous  additional  examples  could  no  doubt  be' 
cited. )4 

C>      Lorig-Range  Strategy  Fomulation  and  System  Building 

'  ""^  »  * 

Ve  should  mention  one  final  point  of  contrast  between  the  OE^and 

the  NI£'  years*    We  noted  previously  the^  inadequacies  of  goal  elab-;? 

ojation^  strategy  fonnulatlon^  and  plannin^during  the  OE  years. 

That  these  criticisms  have  been  heard  less  frequently  In  the  NIE 

period  may  be  an  indicator  that  ^  certain  amount  of  systenj  tiiatura- 

tion  has  taken  place,  especially  in  macrostructure  management  on 

the  federal  agency  level.    In  comparison  to  the  OE  years,  NIE^s 

leadership  has  shown  greater  understanding  of  at  least  some  of 

the  fundamental  requirements  of  RitD  systems  and  their  attendant 

management  needs.    itiE  documents  demonstrate  that  the  agency's 

staff  have  done  a  substanti*al  amounc  of  thinking  about  the  long 

J  range  needs  of  the  r/d&I  system  and  staged  strategies  to  push 

that  system  toward  maturation.    By  their  statements  and  their 

actions^  MIE  officials  indicated  their  concern  with  .bringing  some 

stability,  continuity,  and  gradual  evolution  to  the  syst^'s  -struc 

tures  and  programs.    Glennan,  for  instance^  commented  at  a  number 
0 

of  points*  on  the  need  to  stabilize  signals  from  Washington  to  the 
field,  and  to  provide  continuity  by  resisting  the  tendency  to 
create  and  then  destroy  programs  in  favor  of  neu  programs.  He 
argued  that  long-range  stability  could  be  provided  by  resisting 
"hastily  conceived  solutions, making  clear  to  Congress  and  the 
public  that  complex  educational  problems  could  be  solved  but 
would  require  far  more  time  than  they  had  assumed^  emphasizing 
long  deliberation  and  planning  of  program  initiatives  with  the 
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with  che  research  cornmonity>  and  emphasizing  scientific  rigor 

f  78 
rather  than  hafete  in  the  conduct  of  R&D  programs.  '     Both  the 

planning  staf?  for  the  Institute  and  NIE ' s  Initial  leadership 

emphasized  st^V^^-^S  small  and  expanding  gradually  with  the 

developrnent  of  nfew  capabilities^  rather  absorbing  so  many 

diverse  -programs  and  starting  so  many  initiatives  at  once  tliat 

the  system's  management  capabilities  and  resource  base  would  be 

*  79 

over^^'he Ined  and  Inadequate.      'The  Instltute*s  1978  program  ^ 
plan  giv^s  prominent  mention  of  "prog^rarrmatic  and  organizational 
stability"  as  an  important  development  In  NIE's  brief  history 
and  "long-rangs  planning"  as  an  area  of  special  emphasis. 


And  perhaps  most  Important  of  all>  NIE's  staff  took  seriously 
its^  legislative  mandate  to  "build  an  effective  educational  R6cD 
system."    Their  prograsi  agenda  reflected  concern  not  only  with 
carrying  out  R/D6fl  activities  td  solve  educational  problems'and 

V 

to  produce  visible  results,  but  also  with  developing  the  R6tD 
system  Itself       its  resources  and  capabilities>  and  a  sufficient 
understanc^ng  of  system  functioning  to  p'ermit  more  effective  IJIE 
management 'of  the  system. 

*  ,  ^  / 

This  brings  us  to  NIE's         System  Support  Program,    Out  a&^ysis 
has  been  funded  by  this  program.    The  program  has  been  described 
by  NIE  as  follows;  *  ) 


,This  program  ,  \  .  encompasses  three  interrelated  goals* 
The  fiirst  is  to  build  a  systematic  data  base  concerning 
Knowledge  Production  and  Utilization  (KPU)  In  education. 
This  vill  be  done  through  compiling  and  modifying  data 
from  existing  statistical  systems  and  through  designing 
and  conducing  new  periodic  surveys  and  special  purpose 
studies. 

The  second  function  is  analytic.    The  data  base  will  be 
used  to  monitor  educational  change  and  to  develop  models 
of  the  knowledge  production  and  utilization  process 
leading  to  a  greater  understanding  o£  system  dynamics. 
The  program  will  plan  a  series  o£  regular  reports  which 
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will  describe  the  status  of  the         syste.71  and  the  edu- 
cational system  and  the  changes  taking  place  in  those 
systems*   .         Through  the  analysis  function  it  should 
be  possible  both  to-ldentify  ^oblesas'  requir ing  tJIE 
attention,  and  to  provide  analyses 'of  policy  issues 
identified  by  others*    Finally^  it  should  be  possible  to 
^  identify  areas  of  imbalance  or  weakness  in  che  KPU  system 
for  which  NIE  support  activities  are  needed. 

The  third  function  of  the  unit  is  to  design  and  manage 
■   specific  programs  for  strengthening  the  KPU  system* 
Such  programs  are  conceived  of  along  four  dimensions: 
the  institutional  base,  the  personnel  base^  the  tech- 
nologies for  conducting  KPU,  and  the  facilities  and 
I  ^(BliP^^^  infrastructure.    Inasmuch  as  other  E{IE 

programs  will  be  responsible  for  efforts  to  improve  the 
linkage  and  utilisation  components,  the  inicaatives  of 
this  program  will  focus  largely  on  support  for  research 
and  development  components .       *      ,  . 

V  - 

We  View  the 'inclusion  of  this  kind  of  prograni  in  the  Institute's 
planning  as  one  of  the  most  hopeful  signs  of  niovar::ient  in  the 
direction  of  system  maturation.    Once  the  proposed  monitoring 
system  is  operational,  and  an  empirical  dafSTSase  is  available  / 
to  test  the  effects  ^f  policy  initiatives  throughout  the  system 
(both  those  effects  irttehded  and  others  unintended),  NIE,  working 
in  coordination  with  other  agencies  and  the  field,  will  be  in  a 
Jjetter  position  to  manage  the  system's  development  and  perhaps 
speed  its  maturation. 

* 

A.      i;iE  as  "Think  Tank"^  "Lead  Agency",  or  "More  or  che  Same"? 
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If  the  thinking  reflected  i-n  NIE  documents  is  so  much  note  balanced 
and  reasonable  than  the  assumptions  and  strategies  that  ^^Mvai led  In 
the  *60s,  why  was  the  Institute  in  such  trouble  during  the  first  three 
years  of  its  history?     \Jhy  were  so  many  powerful  voices  calling  for 
its  phas^'Out  and  a  restoration  of  OE  control  over  educational  R6D 


policies  and  programs?    And  what  has  happened  since" 
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Ue  have  already  taecen  note  of  NIE's  political  troubles  in  the  early 
years        lCs  failure  to  naintain  strong  support  in  Congress  and 
develop  a  strong  constituency  within  the  research  and  KSd>  communities^ 
,   and  among  the  powerful  education  interests  and  lobbies,  niany\  of  who^ 
had  strong  ties  to  the  OE  bureaucracy. 

/■ 

It  is  also  worth  noting  in  this  connection  that  Richard  Dershiner^s 

82 

argun^en:  about  technocratic  politics  seens  valid  here.        NIE  ca'me 
into  being  because  powerful  forces  within  the  Acministration  were 
pushing  for  it.    After  fts  creation^  however ^  the  political  winds 
had  changed  and  the  agency  had  relatively  few  influential  friends 
close  t(f  the  Administration  or  the  ir.ajor  wielders  of  po'ver  on  educa- 
tion legislation  in  Congress. 

But  beyond  this,  and  adding  to  the  agency|  s  -difficulties  ^  the  Insti- 
tute never  became  che  Think  Tank  of  eminent  researchers,  RM)  special- 
ists, anS  educators  that  its^  most  hopeful  proponents  expected  it  to 
be.    As  described  when  NIE  was, still  in  only  the  talking  stage  >  the 
Institute  '^^'as  to  hav^  a  permanent  staff  of  scientists,  social 'scien- 
tists, and  educators  and  an  influx  of  top  people  froci  the  field  joining 
the  staff  for  a  feu  years  to  work  on  particular  programs.        A  small^ 
undersupported  internal  research  staff  was  recruited^  but  this  Basic 
Studies  Group  generally  lacked  visibility  and ^  before  being  disbanded^, 
devoted  much  of  its  tine  to  such  functions  as  "staying  on  top  of 
projects and  organizing  invitat ional  conferences  of  leading  scholars 

in  important  research  areas  "to  identify  disciplinary  research  n^eds/' 

84 

develop  research  agendas,      and,  hopefully,  attract  some  of-fchese  emi- 
nent researchers  to'^apply  for  grants  and  carry  out  contract  work  under 
'  sponsorship. 

As  yet,  however^  NIE  does  not  appear  to  have  attracted  a  large  supply  of 
eminent  scholars  from  the  disciplines  to  work  on  educational  R/D6I  or  to 
serve  on  NIE^s  policynaking  body,  the  National  Council  on  Educational 
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Research.    Consequently,  with  little  eminence  to  give  prestige  to  the 
Institute  and  its  programs  and  cnake  it  less  vulnerable  to  attach,  edu- 
cational R/DctI  critics  could  attach  it  as  **Tnore  of  the  sanie,  but  worse" 

worse  because  its  leadership  failed-to  understand  its  political 
.environner^t  and  the  problems  It  posed,^  and  lacked  the  political  skills 
to  overcoQe  these  problems;  worse,  too,  because  it  rnade  new  enemies 
of  those  whose  interests  were  hurt  by  the  transfer  of  programs 
from  OE,  especially  those  whose  programs  were  eventually  dropped  by 
t/IE,    Had  thj  Institute  becocie  a  Think  Tank  of  first  rate  leaders  of 
the  research  coixiunity,  or  attracted  the  strong  backing  and  vocal 
support  of  such  a  cb*artned  circle,  the  story  might  well  have  been 
different*  ^ 

The  Institute's  political  situation  has  clearly  stabilized:     its  exis- 
tence is  no  longer  threatened  and  its  Fiscal  1978  budget  has  been  sub- 
stantially increased  over  previous  levels*    At  even  the  higher  new 
funding  level  of  roughly  $90  million,  the  ag^cy  may  simply  be  such 
'^sstall  potatoes'*  that  few  o£  those  with  power  or  , influence  care  much 
yne  way  or  the  other  about  its  existence.    However,  whether  or  not 
NIE  can  assur.e  the  "lead  agency*'  role  for  educational  R&D  that  seems  ^ 
implicit  in  Its  legislative  mar^date  to  "build  ar^  effective  R6iD  system" 
is  still  open  to  question.    We  shall  return  to  this  point  later  in 
this  cha!(ter. 

We  have  considered  the  history  of  the  last  two  decades  in  some  detail* 
We  .now  abstract  fro:n  that  history  a  nuuiber  of  points  that  help  us  to 
understand  the  present  state  of  historical  development  of  the  system, 
and  especially  sone  of  the  key  problems  in  current  functioning  that 
block  systen  maturation  and  therefore  suggest  needed  policy  initiatives 
for  the  future , 
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111.,     TKE  HISTORIG\L  PRESENT:  THE  TRAMSITIQIi^L  PHASE  OF  D£:\^LO?;-tENT 

Our  previous  analyses  have  provided  some  descriptions  of  the  phases 
of  historical  development  of  K/Dixl  systems,  as  we  have  conceptualized 
them.    We  have  described  the  introductory  phase  of  development  as  the 
initiation  pt;riod  following  the  system's  birtb.    We  noted  that  this 
period  tends  to  be  characterized  by  an  initial  "missionary"  surge 
preceding  *'disenchant:nent  and  a  downturn  that  sonetimes  results  in  \^ 
'del^h'."    We  described  the  subsequent  transitional  phase  of  develop- 
ment as  "a  iset  of  changes  which  occur  in  developing  this  new  activity 
from  a  status  that  is  eXper imental ^  tentative  and  possibly  declining 
to  an  e.\pandingj  accepted  and  integrated  activity  .  .   .  withm  its 
own  context.^*       There  is  room  ror  some  dJ^sagreement  as  to  how  *^experi* 
mental'^  and  "tentative"  the  system  still  is,  and  the  extent  to  which  it 
is  now  an  ''expanding^  accepted  and  integrated  activity  ,   ,   .  within 
its  own  context/'    But  clearly  the  federally  funded  part  of  the  system 
has  gone  through  the  part  of  the  cycle  described  as  "disenchantment" 
and  "downturn/*  and  cone  dangerously  close  to  a  premature  death.  And 
there  is  abundant  evidence  of  extensive  activity  oriented  toward 
expansion  and  integration  of  KP  and  KU  f UJiefeipning ^  both  ^central  to 
our  definition  of  "-he  transitional  ste^  of  develo^ent.  Equally 
clear,  educational  R/D6I  has  considerable  development  to  undergo  before 
it  approaches  our  conception  of  an  effectively  functioning  mature  K/D^l 
systeTtj  ijde.j  a  system  tlja"  demonstrates  the  following  attributes: 

1.  a  network  of  stable  institutions  which  are  pcoparly 
atCTjned  to  their  various  functions  (research,  develOpTient  ^ 
di^^minationj  etc.),  and  appropriately  linked  to  each 

L 

othen  and  to  the  operating  system; 

2.  qualified  personnel  in  sufficient  numbers,  properly 
distributed  And  £ocus^*d  on  appi;opf^i4te  programs; 

\ 


/ 
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3)      visibilicy  and  legitimacy  arnong  the  various ^/D6I 
System  stakeholders; 

4,  adequate  and  stable  levels  of  ^undingj  > 

5,  a  strong  knowledge  and  technology  base;  and 

6,  system ^managers  J  decision  makers >  and  policy  makers 
who  have  relevant  managecnent  and  policy  training  and 
skills* 

If  we  are  correct  in  our  interpretation  of  the  available  evidence  and 
in  our  understanding  of  the  stag^es  of  historical  development  of  R/D6I 
syste:ns,  :hen  a  case  can       niade  for  the  desirability  of  certain  kinds 
^of  policy  options  and  strategies  rather  than  others  at  this  particular 
point  in  :ime. 

% 

First,  let  us  consider  some  of  the  available  evidence.    We  consider 
^evldence  on  seven  criteria  useful  for  judging  the  stage  of  development 
of  a  given  R/D^tl  system:     the  age  of  institutionalized  r/D6I  in  that 
sector;  its  knowledge  and  technology  base;  the  stability  of  its  struc-  - 
cure;  its  resource  base  (i*e,>  its  personnel  and  funding);  patterns  of 
functioning;  the  degree  of  integration  between  KP  and  KU  functioning; 
and  the  quality  of  system  outputs.  j 

1'      The  A;;e  of  Institutionalized  k/d^I  in  Education 

A,      Linked  r/d^I  ■        .  .  ' 

Institutionalisea  r/D6I  in  education  is  little  more  than  a  decade 
old.    The  development  of  instructional  sti^ategies  and  learning 
nateriaU  has  been  going  on  as  long  as  there  have  been  teachers  and 
stu^l'^nt^^ .     But  n(?w  to  the  field  o^  education  is  the  development 
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function  d€£ined\n  the  ri-gorous  R£(D  sense  as  the  production 

of  nesccd  products  or  strategies  with  known  outcoraes,  developed 

and  refined  through  iterative  cycles  of  designj  development j 

87 

testingj  evaluations  revisionj  etc*        Kew  is  institutionalized, 
linked  R/D6tlj  as  an  interrelated  set  of  processes  revolving 
around  the  developnaent  function       research^based  development. 


development-briented  research,  development  Linked  to  dissemina- 

88  * 
tion  and  implementation,      etc,,  carried  oui  by  specialized 

personnel  under  specially  designed  organizati^onal  arrangements h 


While  the  newness  of  a  system  may  not  be  significant  in  itself 
few  institutionalized  R/D6tl  systems  in  any  sectors  tire  more  than 
a  few  decades  old        it  is  a  factor  of  sorae  significance  when 
compared  to  the  centuries  of  history  and  tradition  that  characterize 
the  operating  system  of  educational  institutions.    This  is  in 
sharp  contrast  to  a  sector  like  aerospace  wnere  the  operating 
and  R/D&I  systems  matured  to  a  significant  degree  together,  and 
were  therefore  open  and  r^JceptiVe  to  itiUeraction  and  mufcual  in- 
"ELuence,    The  operating  system  served  by,  educational  K&D  is  old 
in  history  and  heavily  laden  vith  traditions,  'norms,  and  values 
that  run  counter  to  acceptance  of  the  outputs  of  external  R6tD, 
The  educational  K/d&I  system  has  not  yet  established  its  legiti- 
macy.     It  competes  against  traditional  approaches  to  producing 
knowledge,  products,  and  programs  for  educational  instit^itions, 
and  it  uses  scarce  resources.    Its  methods  and  outputs  have  not 
yet  proven  their  superiority  to  tr^itional  methods  or  outputs* 
In  many  cases,  the  products  of  educational  R/D6tl  are  clearly 
inferior  to  conventionally  developed^prod^^cts. 

The  historical  jnilieu  in  which  th^  educational  R/D£(I^  system  emerged 
V 

contributed  to  its  problems  in  gaining  acceptance  by  operating 
systicm  personnel.    Unlike  the  relatively  close  synchroni;;ation*of 
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the  historical  development  cycles  of  the  operating  and  R/D6tl 

systeriis  in  a  sector  like  a{;rospace,  educational  r/t>&L  was  born 

at  a  time  when  school  systems  were  often  characterized  by 

critics  as  obsolescent  and  in  a  state  of^^ganizaCional  decay. 

School  professionals  in  the  '60s  were  targets  of  intensive 
89 

attack,  which  Laade  then  understandably  more  defensive  and  resis- 
tant to  encroachments  from  outside  experts  whose  very  exisxence 
with  government  support  was  interpreted  as  a  slighting  of  the 
competence  of  educational  practitioners. 


These  legitimacy  problems  for  external  R/d^I  would  seem  to 
suggest  the  advisability  of  funding  efforts  to  strengthen  inter- 
nal operating  system  capabilities  for  identifying  problems  and 
developing  solutions.    And  indeed^'  some  relatively  sizeable  alio- 
cations  have  been  directed  toward  this  aim*     It  will  take  some 
time  before  clearly,  ■  institutionalized  patterns  for  internal 
R/D&I  emerge,  ,^ndeed,  it  may  be  necessary  for  us  to  rethink  what' 
"institutionalized^'  R/D^I  means  when  it  is  internal  to  an  opera- 
ting syst.em  and  not  necessarily  manifested  in^full-time  specialised 
roles.    But  clearly^  however  long  practice -based  development\^work 
has  beea  going  on,  conceived  now  in  terms  of '^enti f ication  and 

perhaps  validation,  packaging,  and  dissemination  of  exemplary 
90 

practices^    this  pattern  of  functioning  is  quite  new  to  the  field- 
of  education* 


Certainly,  then,  given  the  newness  of  institutionalized  R/d^I 
functioning  in  the  education  sector,  the  fact  that  educational 
_R/D6iI  shows  few  signs  of  , maturity  should  not  be  viewed  as 
surprising  or  alarming.  ^ 

B.       Individual  Functions 


Mncb  of  what  we  h^ve  sard  ahout  Institutionalised,  linked  R/d&T 


ERIC 
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in  education  holds  equally  well  for  the  individual  functions  that 
make  up  ail  r/D5cI  system.     Many  functional  specialties  of  mature 
R/D6cI  systems  are  almost  totally  absent  in  education,  »  Those  that 
dp  exist  either  emerged  as  areas  of  specialization  after  the  R/D^I 
sys4«.ii  was  institutionalized  in  the  mid-'60Sj  or  were  wholly 
transformed  by  the  demands  of  that  system.    These  functional 
specialties  as  they  are  carried  out  in  the  R/D6cI  system  exist 
alongside  of^  and  compete  withj  these  various  activities  as  they 
are  carried  out  in  otherj  oldet  parts  of  the  education  sector,  A 
few  words  would  seem  to  be  in  order  about  each  of  theSe  functional 
specialties . 

/ 

a.      Research  \^ 

Systematic  educational  research  in  this  country  has  been 

91 

dated  as  far  back  as  1895.      But  until  sti[nulated  by  the 
infusion  of  federal  funds  in  the  '50s  and  '60sj  the  educa- 
tional research  community  remained  relatively  small  in 
numbers  J  fragmented  and  unorganized^  functioning  mostly  as 

individual  researchers>  doing  smalT-scale^  non-cmumulative 
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research^  primarily  in  schools  of  education.      The  field  has 

'  93 

experieno^d  enormous  expansion  since  then^    and  considerable 

94 

structural  change  intended  to  overcome  these  weaknesses.  But 

*  the  new  pattern  of  long  term^  team  research  programs  coexists 

95 

with  large  numbers  of  small-scale  one-shot  studies    --  the. 
familiax  older  pattern  the  educational  R/D6(I  system  was  in- 
tended to  replace. 

Institutionalized  educational  research^  then^  may  not  be  newj 
but  programmatic  research  of  the  type  emphasised  by  federal, 
funding  policies  is  new.    It  is  still  fledgling  in  status^ 
has  not  ()on  total  acceptance  within  the.  research  communityj 
and  has  met  some  significant  resistance  for  a  variety  of 
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reasons  —  3t  Least  some  q£ 'which  have  soihe  merit  +  And 
regardless  of  how  much  of  thti  current  output  of  tHe  research 
community  i^  programmatic  m  nature  and'how  much  tends  to  bo 
of  the  tjne-shot  variety^  our  analysis  of  the  conduct  of^edu- 
cational  research  S(j^ests  that  ^he  educational  research 
conpnunity  has  failjMto  come  , ''to  grips  with' some  of  the 


critical  problems  th^C.  prevent  it  from  improving  the  quantity 
and  quality  of  knowledge  production  and  knowb?^^^||jtili2ation 


to  improve  educational  practice . 
b.      Evaluation  Research 


Evaluation  of  educational  pro-ams  is  hardly  new*    But  evalua- 
tion emerged  as  a- specialized  R/D6c1  funG^ion  with  distinctive 
Concerns  and  a  distinctive  methodology  only  with  the  institu- 
tionalization of  educations  R/D&I  in  the  last  ten  to  twelve 
years.    Prior  to  that  time>  evaluation  of  educational  programs^ 
when  it  was  done  at  all^  was  carried  out  by  educatioral^prac-  _ 
titioners  and  some  eeucational  researchers.    It  was  rarely 
systematiCj  and  tendeti  mostly  to  be  normat^*ve.    The  predomi- 
nant approach  was  casual  observation  and  ^alysis.  Conclu- 
sions* tended  to  4>e%ased  on.  expert  opinior^ind  intuition 
rather  than  systematically  gathered  angj^igorously  ^analyzed 
empirical  dbta.    This  pattern  ^?^ged  significantly  in  the  - 
"60s  as  large-scale,  federally^fiinded  sgjfial  progrShis  pro- 
lif'erated^  an^  the  legislation  tha^  created  them  tended  to 
requ^ire  the  systematic  gathering^  analysis^  and  reporting  ^ 

of  ampirif^al  data  otv  program  effectiveness,    l^he  evaluation 
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function  expanded  rapidly  as  a  new  specialty^    and  even  as 
98 

a*  new  industry,      Butj  ^s  in  research^  old  and  new  patterns 
of  evaluation  functioning  coexist  and  compete^  and  the 
immaturity  of  the  Aeld  is  still  evident  in  the  literature 
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as  evaluators  grope  co  overcome  che  conceptual  and  method- 
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ologlcal  :^:nbiguicies  of  their  function 
c". '     De ve  1  oPnent  and  Pissemination 


The  newest  r/J)^1  specialties  to  appear  in  education  are 
development  and  the  di sseminacion/narketing  function .  Both 
have  links  to  activities  that  have  been  carried  out  for  some 
time  by  educators  and  people  in  the  education  industries* 
But  tfoth  took  on  totally  new  meanings  when  understood  as  part 
of  linked  r/D£^I  processes  in  the  mid-'60s. 

Before  then,  educational  products  and  materials  may  -have^  been 
designed  and  uitSergone  a  few  revisions,  but  rar*ely  on  the 
basis  of  systematic  testing  and  data-gathering.    And  rarer 
still  was  development  work  oriented  toward  producing  tested 


products  that  could  be  ofescribed  in  terms  of  specific  known"" 

outcomes  to  be  expected  reliably  under  specified  nnp 1 e me nt anion 

conditions,  or  exemplary  practices  that  could  be  packaged  ar^d 

disseminated  for  use  by  others  (possibly  validated  in  some 

ways  as  well).    Dissemination,  when  it  occurred  at  all,  was 

somewhat  random  and  chaotic,  rarely  based  on  market  analysis 

or  marketing  planning,  and  passive  in  approach^  leaving  the 

burden  of  effort  in  learning  about  new  products  to  acquisition 

personnel  *       '  -  '  * 

*  « 

Over  the  past  decade,  development  and  dissemination  have  coirie 
increasingly  to  be  viewed  by  educational  r/D£cI  theorists  as 
institutionalized  function^  carried  out  or  supported  by 
special Lzed^ersonnel ^  using  carefullj^  conceived  and  managed 
planning  and  implementation  st^^tegies.    But  th^ere  is.per- 
fdifriy  no  unanimity  on  this'^^*^^  Both  funjjj^ions  are  still  in 
thoir  infancy.    The  old  ^attern^  of  development  and  (Sissemi- 
natiion  exist  alongside  the  neu.    And  relatively  fbv^  products 
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are  developed  ri-gorously  or  disseminated  by  means  o£ 
sophisticated  marketing  techniques.    The  aducational 
marketplace  is  still  chaotic,  and  the  operating  system 
still  has  great  difficulty  determining  uhat  ideas,  in- 
formation, products,  or  programs  are  available  to  meet 
■    a  given  need,  lauch  less  how  effective '  they  are  under       ^  ^ 
various  implementation  conditions  -  ^ 

Relative  Absence  of  Some  Other  Specialized  Functions 

This  situation  exists  not  simply  because  of  the  immaturity 
V^of  the  development  and'dissemination  functions  but  also 
^'^because  6£  the  virtual  absence  in' educational  r/D&I  of 
several  functional  specialties  that  can  be  observed  in 
mattljre  systems  *    Need  ident  if  icat  ion,  acqu  isition,  and 
implementation/utilization  genera^y  lack  institutionali- 
zation in  edu^datioa  as  specialized  roles,  carried  out  by 
specialized  personnel,  on  a  continuous,  pngoing,  routine 
*   basis^  uGing  specially  allocated  resources  and  backed  up 

by  specialized  organizational  supports.    Consequently,  thfise 
,    processes  occur  haphazardly  and  episodically.    They  tend  to  , 
be  unplanned' and  uncoordijiated  with  routine  system  functioning 


'r 

e .      Sur:inary   .  ^ 


Clearly,  then,  whether  one  considers  institJ^JSnalized  r/D&I 
^n  (;«rThs  of  individual  or  linked  r/D&I  functions',  we  are 
dealing^  with  a^phenoagnon 'that  is  young  and  shows  £ew  s^igns 
of  mature  ijttnctioning-    Poliqy  options  and  alternative 
management*  strategies  must,  be  assessed' in^^lation  to  this 
immaturity,  and  the  need  for  learning  time-     '  ^ 
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The  Knowledge  and  Techgologv  Bab'e 


A,    Nature  and  V^^eakness  of  the  Base 

\   :  \ — 


Education  is  generally  characterized  in  the  literature  as  a  field 
VLth  a  veak, knowledge  and  technology  ba^e}^^  There  is' some  dis^- 


\  102 
^    agreement  as  to  whether  it  can  be  coasidered  a  discipline.  -But 

,    clearly,  vjhether  or  not  it  is  ^  discipline,   it  is  at  best  a 

derivative  discipline  generally  lacking  the  powerful  paradigms 

that  have  structured  knowledge  In  the  parents  disciplines  of 
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ps  JchoLogy  J  sociology  J  etc  .      One  theor  ist  >  viewing  edjjcation 

fron  the  vantage  point  of  the  sociology  of  science,  described 

104 

education  as  ^  conjunctive  domain  of  knowledge      -~  a  field  drawing 
On  interdisciplinary  resources  to  solve  social  problemSj  rather 
than  a  discipline  oriented  toward  theoretical  advances  to  solve 
intellectual  problems..  Where  problem  solu/ion  is  paramountj 
knowledge  accumulation  15  secondaryj  and  the  advancement  of  the 

i 

knowledge  and'.teoknology  base  of  ^a  field  is  likely  to  be  in*-  ^ 
^   efficient,    without"  concerted  attention  t(\  the  development  of  a 
field's  knowledge  and  technology  base /  maturation  of  its  R/D6cI 
System  seems  unlikely*     In  the  case  of  education,  this  problem 
seems  particularly  significant*  ^ 

^  ^  ' 

We  would^npt  attempt  'to-appraise  the  present  -st^te  of  kn<^ledge 
and  technology  in  the  hundreds  of  research  areas  ^^^ectvely  pursued*  _ 
in  education  today,  or  the  vast  number  of  difljcrent  methods  and 
approaches  used  to  conduct  the  various  kinds  of  R/D^I  actlvit^^es. 
However*  we  have  e^camined  evidence  on  one  indly^tor  we  believe 
to  b^^  useful  for  judging  the  statQ  of  development  of^the  accumu- 
I'^ted  knowledge*and  technology  base  of  the'^iQld  —  the  avail- 
ability of  handbooks  ajid  other  Syntheses  of  existing  knowledge  in  \ 
<  different  research  ^eas  arid  functional  specialities.  Project* 
Hi  ndsigHc        suggest^^  thaO  the  s>;nth^sis  and  presentation  o4^ 
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knowledge  in  highly  organised  and  cocnpressed  form  is  critical 
for  the  cuT.(jlati7e  devfeloprr^ent  of  a  lield^    Through  these 
syntheses  the  findings  become  widely  available^  enter  teaching 
and  course  work,  and  are  passed  on  to  th^  newest  gen^ation  of 
^r/d&I  personnel  as  part  of  the  accepted  knowledge  base  of  their 
field,    A  research  area  has  to  have  achieved  sotne  degree  of 
maturation  before  such  syntheses  are  produced-    Therefore^  we 
can  make  some  broad  inferences  about  maturation  Jevels  from'the 
eKt4j^vcne3S  of  the  available  syntheses. 

B.      EXiucational  Research 

Using  this  criterion,  educational  research  is  the  only  functional 
specialty  with  a  well  developed  research  and  methodology  base, 
largely  but  certainly  not  totally  derived  from  other  disciplines, 
especially  psychology  and  sociology.    The  AERA  has  been  instru- 
mental in  producing  and  publishing  most  of  the  major  rea[earch 
syntheses       e,g.,\he  Encyct^edia  of  Educational  Research,  pro- 
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duced  ^t  nine  or  ten  year  intervals  and- now  in  its  fourth  edition; 

two  editions  "of  the  Handbook  of  Research  on  Teachiri^ l^^the  quarterly 

108 

Review  of  Educational  Research:  'and  the  newest  series  ^  an  anrmal 

Review  of  Research  in  Education,  beginning  in  1^73^^^  Each  of        -  ^. 

these  volumes  includes  numerous  bigh  quality  articles  covering 

broad  areas  of  theoretical^  empirical^  or  methodological  activity. 

Some  of  these  pieces  have  been  lajidmark  articles  in  their  own 

right,  such  as  Campbell  and  Stanley's,  Exper itnentaX.  and  Quasi- 
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Experimental  Designs  for  Research       that  appeared  initially  in 
the  1963  edition  of  the  Handbook  of  Research  ou  Teaching,  and 
must  be  considered  one  of  the  most  important  paper?  to  have  in- 
fl^jencec!  the  teaching  and  perhaps  too  the  conduct  of  educational 
research  since  then. 


Still,  as  exten^iv^i  as  these  syntheses  nay  be  ^  and  as'vast  as  the 
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theoretical  and  ecnplrical  bbdy  of  kno:;lq;igc  they  bring  to^^other, 
,the  kr.owledge  and  technology  base  oi  the  "field  c^n  hardly  be 
judged  to  be  "mature.    As  we  noted .earlier,  despite  the  vastness 
and  perhaps  ever,  un'^rlelcif  sizt?  of  the  litora^ur^,  it  has  enor- 
mous gaps.     It  gefierally  lacks  po^jerful  theoretical  and  inquiry 
paradigcs!    And  only  a  ifelatively  snail  portion  of  it  is  de^lop- 
ment^oriented  in  nature  or  directly  applicable  to  deve^lop.^enc  of 
product  and  progmri  prototypes  or  implementation  supports.-  Using 
Our  same  criterion  of  naturity  (the  availability  of  synth^^ses  of 
field's  knowledge  and  technology  base),  the  general  lack  of  such 
syntheses  for  research  that  is  directly  applicable  to  developnie-nt 
and  imolementation  r.eeds  suggests  the  relative  i=:\^turity  of 
researdh  as  a  function  linked  to  and  supporting  the  educational 
R/D&I  system,  .  j 

C.   .  Evaluation  Research 


The-  evaluation  and  disser^ination  functions  have  generated  a  sub- 
stantial literature  over'-t^e  past  decade,  and  a  few  important 
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syntheses  of  the  existing  knowledge  and  technology  base.   '  But 
these  are  relatively  few  in  number  and  small  in  scale  in  com- 
parison to  educational  reseatch,  and  they  have  been  published 
as  out^puts  of  one-tine  ratherMlli^i^  ongoing  (annual  or  decennial) 
projects.    This  can  be  considered  at  least  suggestive  that  the 
accumulated  and  accumulating  knowledge  base  of  these  fields  is 
far  less  extensive,  ' 

The  earl^  phases  of  the  naturation  process  "of  a  knojjftedge ^nd 
technolo^  base*are  illustrated  with  particular  clarity  in  the 
enormous  literature  produced  by  the  evaluatio'n  function  over  th^ 
last  decadeV    Of  all  the  functional  r/D&I  specialties,  evalua- 
tion appears  *to  have  experienced  the  most  self-cotiscious  and 
concerted  d^^velopment  of  its  m*?thodology  during  this  period. 
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The  literature  reflects  not  only  the^inherent  difficulties  of 

the  evaltiarion  role  and  evaluation  processes,  but  also  the 

problems  of  weaning  a  new  specialty  away  froro  a  parent  field. 

The  ^early  literature  was  filled  with  seli-cortscious  analyses 
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drawing  distinctions  between  evaluation  and  research,  and 

ernphas izing  the  inappropr iatet^ss  of  prevailing  research 

113  ► 

methodology  for  the  educational  evaluation  context.  Within 
only  a  few  years >  the  distinction  from  educational  research  was 
taken  for  granted,  ar\d  the  literature  documented  the  development 
of  evaluation  ^as  a  nevi  field  with  a  distinctive  identity. 


The  rapid  coming  of  age  of  the  evaluafton  function  could  be  seen 

in  the  quick  succession  of  seminal  papers  produced  by  evaluation 
1 14 

theorists,      the  publication  or  several  anthologies  rjeprinting 

145 

important  articles  on  evaluation^      the  frequent  citation  of  the 
^!i'&!HAnal  papers  of  the  field  and  the  u^e  of  concepts  and  approaches 
/developed  in  these  paperd.     It  could  be  seen  in  the  energence  of  a 
/    somewhat  cornmon  frame  of  reference  among  evaluation  theorists  ^ind 

a  consnon  vocabulary        including  such  terms  a&  ^^formative"  and 
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**suTnrnative**  evaluation     'and  ^'context/'  ''input      ^'product/*  and 

117 

'^process*'  evaluation.        The  :naturation  of  the  evaluation  function 

could  be  seen  especially  in  the  fonnulation  of  various  new  evalua- 

118 

tion  designs  and  methodologies,      in  al^mpts  to  develop  taxonomies 

119 

of  evaluation  designs,      and  in  the  publication  of  several  hand- 
books syntViesLzlng  and  compressing -the  accumulating  knowledge  an* 
technology  base  and  translating  it  into  more  readily  usable 
Reference  form.  t/ 


Still,  the  conduce  of  educatfSnaL  evaluation  and  the  quality  of 

121 

evaluation  outputs  havje  been  the  focus  of  considerable  criticise. 
The  field  still  lacks  afc  adequate  theoretical  base.  Evaluation 
instrumentAtion  15  In  a  Tr.ost  rudimentary  state  of  developments 
And  basic  concept'jal  and  nethodolo^^ical  dilcirzx^as  remain  unresolved.^ 
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Though  suSstar.tial  progress  has  been  nade  in  recent  years  >  th\; 
kno'jLedge  and  technology  basn  of  the  evaluation*  function  rr.List 
still  be  considered  imature  and  underdeveloped- 


Disseninatioa 


Tbere  is  a  sizeable  literature  on  dissemination  and  diffusion  in 

education^  much  of  which  has  b*een  produced  by  the  University  of 

^Eichiga^*s  Center  for  Research"  on  Utilization  of  Scientific 
123 

Knowledge .       This  inc ludes  one  extremely  use ful  synthesis  oz  the 
potential  knowledge  base  of  the  fields  drawn  from  various  disci- 
plines and  focused  on  the  questions  that  arise  in  the  course  of 
planning  for  dissemination  of  an  innovation^^"* 

Stillj  the  literature  as"^  whole  tends  to  be  normative  rather 
than  enipirical  in  nature^  suggesting  how  the  dissemination  func- 
tion should  be  organized  and  conducted  rather  than  how  it  is  in 
fact  carried  out^  with  uhat  degrees  of  success,  in  what  settings^ 
under  what  conditions.    Some  of  this  needed  empirical  infornia- 
tlon  is  beginning  to  become  available  in  the  form  of  research 
and  evaluation  data  from  the  various  experimental  dissemination 

projects  that  are  proliferating  under  t^he  new  federal  emphasis 
125 

on  dissemination.        But  dissemination  remains  the  most  diffuse 
of  the  existing  functional  specialties ^  the  hardest  to  describe 
in  Specific  operational  terms.    And  the  virtual  absence  of  a 
marketing  approach  to  dissemination  of  educational  innovations ^ 
and^the  rarity  of  even  any  mention  of  marketing  concernsP^ 
suggests  that  tjiis  function  reruins  the  most  immature  and  under- 
dtiveloped  of  th^se  specxalti<?s  that  have  enf-rg^d  to  date. 


E .      Deve lopment 

'127 
ThQ  development  function  h^5  produced  some  case  materials,  but 
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relatively  little  in  the  way  of  a  synthesis  of  the  accumulatirtg 

kno;/Iedge  and  technology  ba^^e  of  the  field.    We  are  a'v^*are  of  only 

two  volunes  designed  to  provide  an  understanding  of  the  devtflop- 

nent  function  in  education  and  we  were  able  to  acquire  only  one 

1 2  8 

of  these  for  revie-J^     The  volume  we  reviewed  was  useful  for 
understanding  the  nature  of  educational  development  (in  the  struct 
R6J)  sense)  >  develo?:nent  policyinakingj  and  development'^nagement  > 
but  of  Httle  help  for  providing  more  than  the  vaguest  impression 
of  the  nature  or  state  of  developr?,ent  of  the  underlying  knowledge 
apd  technology  base  of  the  field.     One  gets  the  ir?,presslon  that 
/'^uch  a  technology  base  may  in  fact  exj-st  in  the  few  centers  of 
rigorous  development  work  found  in  the  r/D6cI  systeni.    Bet  there 
is  little  in  the  literature  to  give  new  de';^lopers  or  developers 
workiing  elsewhere  a  grounding  in  the  procedures  and  strategies 
that  distinguish  syste::iatic  development  in  the  Red)  sense  from 
development  worlc  as  it  has  always  been  carried  out*    In  all  likeli- 
hoodj  then>  we  can  assume  that  they  will  continue  inefficiently 

reinventing  the  wneel . 

i 

T*      Other  Relatively  Absent  Functional  Specialties 

The  picture  is  even  less  sanguine  for  the  functional  specialties 

that  have  yet  to  energe  in  education*    There  is  a  large  literature 

*  129 

on  the  adoption  of  innovations  >      and  several  syr^heses  of  the 

existing  knowledge .base  on  factors  that  influence  the  rate  of 

130 

diffusion  of  innovat^i  ons  *        But  relatively  little  of  this  is 

< 

geared  to  the  needs  of  acquisition  personnel*    There  is  sone 

m 

research  literature  on  problens  encountered  in  attempting  to 
iriplennent  conpLex  educational  innovat ions J"^^    But  givan  the 
rather  belated  recognition  of  implementation  and  utilization 
problens  as  criticaT  sources  of  weakr^^  in  educational  R/D6tl, 
and  the  virtual  absence  of  imple^nentation  and  utilization  as 
specialized  furtctions  in  education>  it  is  little  wonder  that 
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there  is  litnle  of  ah  itnplementation/utiLization  knowledge  and 

vCechnoIogy  base  to  synchdslze.    The  new  surge  of  inceresc  in 

internal  school  system  problem-solving  has  led  to  the  publication 

132 

of  a  few  useful  intrQduccory  guides  for  school  personnel.  Sone 

problesi-solvins  and  renewal  approaches  that  have  developed  a  fol- 

lovir.g  of  their  ow?l  (e.g..  Organisational  Development)  have  pro- 
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duced  a  si^eabIe  literature  and  soae  efforts  ^t  synthesis.  But 
generally  lacking  are  comprehensive  overviews  of  what  we  V.now  about 
inplcmentatian  and  utilisation  problems  in  general  or  with  respect 
to  Specific  kinds  of  product s  /  prograsns ,  or  organisational 
innovations. 

In  surrnary,  the  knowledge  and  technology  base  of  educational  r/D^I 
functions  is  so  poorly  developed  that  there  appears  to  be  at  least 
some  grounds  for  questioning  whether  creation  of  an  educational  ^ 
K/D^I  systej>  may  have  been  prer?ature.    Perhaps  without  such  a  systetn 
the  kind  o£  knowledge  and  tech'nology  needed  might  never  have  been 
developed^    But  regardless  of  where  one  stands  on  that  issue,  it 
see:ns  reasonable  to  assume  that  wherever  the  knowledge  and  tech- 
nology base  of  R/D6I  acti^/xties  remains  weak,  as  it  is  in  educa- 
tion, system  outputs  will  be  generally  poor  in  quality,  low 
quality  outputs  will  produce  or  reinforce  negative  environmental 
influences  that  inhibit  the  flov  of  ample  funds,  personnel,  and 
other  essential*  inputs  into  the  r/D^I  system,  and  system  matura- 
tion  will,, be  retarded.    Unless  there  is  more  focused  attention 
oij,  and"  substantial  progress  in,  the  development  of  the  knowledge 
aad  technology  base  or  the  field,  the  future  o£  the  educational 
r7D6(I  systen  may  reniain  clouded  ^ 
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Scabil'icy  of  Structlure 


Mature  r/D£^I  systems  generally  manifest  substantial  stability  in  macro 
and  micro  structures.     By  the  time  a  system  reaches  aaturityj  gaps  and 
inadequacies  in  the  macrostrueture  have ' been  corrected.  Appropriate 
linkag^5,  interfaces,  and  coordinating  cnechanisnis  have  evolved. 
Organizational  forms  h^y^  adapted  to  a  point  of  relative^equilibrilim" 
with  environnencal  and^^textual  constraints.    For  the  most  part, 
weaker  institutions  and  organizational  units  have  been  winnowed  out. 
Consequently,  resources  can  be  focused  on  substantive  R/d£iI  problems 
and  need  not  be  ^diverted  to  structural  and  organizational  concerns, 

Educational  R/D6Tj  in  contrast,  has  been  char^cter't^ed  by  a  high  level 

^     of  instability  in  both  macro  and  micro  structures.   ^The  last  decade 

and  a  half  have  witnessed  a  groping  for  appropriate  organizational 

forms        R<SD  centers^  regional  and  national  laboratories.  Title  111 

demonstration  centers,  ERIC  clear  inghouses  ^  educ^ional  information 

centers,  Instructional  Materials  Centers,  Research  Coordinating  Units^ 

Intermediate  Service  Agencies,  state  and  interstate  dissemination 

networks  ^  consult  ing  y  training ,  and  technical  ass  1  stance  organizations  ^ 

and  in-house  operating  system  units  to  support  implementation  and  uti^ 
13^4 

lization.        Stilly  the  existing  cionf Igurat ion  shows  relatively  limited 
and  poorly  developed  linkages  and  interfaces  within  and  between  func- 
tions and  organizations.    Consequently,  the  overall  configuration  ot 
*    institutions  and  functional  specialties,  interfaces  and  linkages  con- 
tinues to  evolve^  and  a  considerable  proportion  of  overall  R/D^I  re- 
sources continue  to  be- aJLlocated  to  organizat^iona L  design  and  experi- 
mentation with  new  forms        with  all  the  attendant  problems  of  uncer- 
tainty and  learning  tir?e  to  be  expected  from  this  kind  of  experimentatiion, 

'  To  pernit  us  to  trace  the  evolving  conf Igurat ion^  and  changes  in  that 
configuration,  it  would  be  useful  for  us  to^ave  su^^b^ic  information 
as  hov  ^^ny  institutions  of  various  types  x;ere,  carryinV^^t  how  much 
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1  educatior.al  R/DcsI  activity  of  what  types  each  year.    KIE*s  tCPU 
Hoaitorin^/Pro^ran  is  expected  m  time  to  provide  this  kind  of  data- 
gathisring  tot  the  future*    But  even  without  such  data  in  hand ,  the 
instability  in  structure- seems  clear. 


Si^ns  of  Progress 


{ 


4 


The  patternj  thenj  has  not  been  one  of  stability,  but  progress  is 

clearly  evident  in  two  aspects  of  this  institutional  or  configura^ 

135 

tLDr.al  evolution  that  sho^j'ld  be  noted: 


1,      The  trend  appears  to  be  toward  crea^on  of  larger- 
scale  institutionalized  >  1  inked ,  prograrnmatic  R/D6tl , 
and  a^ay  from  the  pattern  that  existed  tvo  decades  ago 
when  the  field  consisted  largely  of: 

'^a  *      scattered  researchers  (mostly  individuals  or 
small  teans  in  academic^  settings j  doing  small 
scale,  non-cumulative  studies  of  schools  and 
studies,  yet  having  few  strong  linkages  to 
operating  system  personnel); 

b.  a  small  number  of  large  curriculua  improvement 
projects  in  selected  subject  areas  (again, 
staffed  largely  by  university  scholars); 

c,  *a  considerable  amount  of  internal,  in-house, 
^    practice-based  development  o^  curriculum  by 

school  system  personnel  (rarely  disseminated 
much  less  evaluated,  validated,  or  packaged  for 
use  by  others) ;  ^  , 


d ,  private  companies  providing  textbooks ,  mater ial s 
^       and  equipment;  and 
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a  very  small  number  of  private  sector  research 
organ Lzat LOns * 

Overall,  the  trend  has  been  coward  subst;anclaL  expan- 
sion and  stabilization  of  the  institutional  base.  Our 
own  observations  suggest  the  following: 

a.      A  substantial  number  of  new  R/D^l  institutions 
or  organizational  units  have  emerged  (precise 
figures  on  this  await  findings  from  the  NIE 
Education  KPU  Monitoring  Program  survey  of 
organizations) .  *  , 

/ 

'b.      There  have  been  a  significant  number  of  losses  in 
the  institutional  base  due  to  laclc  of  funding  or 

markets  for  service's  (for- inst^ce ,  the  dccreaae 

136  ' 
"?^T?5w30       to  17  of  the  original  federally  funded 

regional  laboratories  and  RctD  centers). 


c/     There  appears  to  be  a  considerable  **levelling  off" 
in  the  "loss  rate**  amor^^  existing  educational 
R/D6tl  institutions  (as  seen,  for  ins^nce,  in  the 
strengthened  political  pos3/tion*oT  the  labs  and 
centers)- 


.d.      It  apfJears  that  a  healthier  degree  of  career 

■  stability  is  becoming  possible  even  in  the  n^er 
of  these  institutions'. 

4 

B.      Macro^tructure  -Instability 

Conflgarationat  evolution  in  ednc/atlon  has  been  complicated  by 
substantial  structui'al  Ins-tabllity  within  the  federal  agencies 
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that  were  the  prirr^ary  sponsors  of  educational  R/D6.I-    The  Office 
of. Education  underwent  two  reorganizations  in  196^ /nd  L969.  In 
1972  the  Mat;ional  Institut^:^  of  Education  was  created  as  a  wholly 
new  and  independent  agency,  and  lead  agency  responsibility  for  the 
educational  R/D6cI  system  w^s  transferred  to  the  Institute,  NIE 
evolved  a  significantly  new  agenda  for  Kl^&l  sponsorship  new 
niissionSj  new  policies^  new  funding  programs.    But  in  its  brief 
five-year  history,  '^hfe  Institute  too  has  had  three  different 
Direct'ors  and  undergone  (and^jcont inues  to  undergo)  some  reorganiza- 
tions .  /  -^^^-^ 

Each  reorganizatiorL       within  OS,   from  OE  to  NIE>  and  within  MIE 
was  intended  to  solve  some  perceived  problem  in  k/D^t^/functioning. 
But  the  frequency  of  reorganization  in  and  o*l  itself>  regardless 
of  the  substance  of  the  changes,  complicated  planning,  operations, 
and  coordination  on  both  the  macro  and  the  micro  levels^  The 
research  or  R6tD  emphases  to  be  supported  ebbed  and  ffowed.  Programs 
were  started  and  then  stopped  before  thef  canie  to  fruition.    In  the 
initial  years  of  system  functioning,  OE  was  unclear  about  its  expec- 
tations ^nd  failed  to  cornmunicate  clear  messages.    Critiques  of  OE 
functioning  during  this  period  stressed  the  agency's  lack  of  ''^'t^' 
coherent  RficD  sttategy,^*  its  ^'inability  to  set  consistent  goals  for 

itself"  or  goals  "meaningful  to/educational  researchers and  its 

_     -  f 
failure  to  enlist^tf^T  educational  research  cotisnunity  to  any  sig- 
nificant degree  in  the  setting  of  goals  or  the  development  of 
funding  programs  — ^ 

r/D6j1  institutions  . fumbled  and  underwent '^constant  reorganizations 
of  their  o^vn,  redefining  their  missions,  developing  and  then 
dropping  programs  and  developing  new  o"nes,  as  they  tried  to  second* 

guess  federal  officials  and  meet  expectations  that  were  often 

^  1 3S  *  ^ 

conflicting  and  frequently  changing.        Staff  turnover  was  high> 
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and  management  turnover  was  even  higher.        Hew  institutions 
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Appeared,  and  others,  disappeared  a£ter  only  a  brief  exisCence. 


^    .   ,■       Several  of  the  RiJ)  centers  and  regional  laboratories  cheated 
*  '  witti  such  ■  £anfare ,  and  even         * c learinghouse s  >  los4i  their 

funding  pr  went  out  of  extstence  for  one  reason  or  another.  4' 
few  such  xnstLtutiq'ns  that  closed  their  doors,  appeared  anfew  ip. 
changed  form       e*g.:  a  core  of  a  regional^^aboratory  'staff  " 
ifr       ,  forming  or  jaining  a  non-profiL  or  prof it-o?Lented^ corporation^ 

or  one  ^IC  clear iaghouse  merged  into  another*      Large  corpora- 

*    ^  ^tions  ent^ecl  the  'education  industry. and  i;b*n  withdrew  as  the 

*  '  ■      .  "    ^  141 

I  ear^y  Dromise  for  expansion  and  profits  dissipated* 


*   ^  ^      ^       ^    C*,     lJe?^,r^e  of  Stability  of  Educational  R/D&I  as  $ug^es,&lve  of  "^^^ 


the  Transitional  Stase  of  Historical  gi^velopruerit 


Mnttiratlon  from  the  introductory  to  the  transitionjr  phase  of. 

historical  developnent  of  R/D<5tl  systems  tends  to  be  marked  by 

'  ^      "        expansion  axid  integration  of  a  relaFively  stable  structure* 
■  ] 

4?  ^  Subst^tial  progress  has  been  made  under  NIE  auspices  to  expand 

^  , the -exist Ing  structure  in  the  direction  of  increasing  KP^l*j^||kt&- 
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gration,  linking  functional  specialties,  and  filling  in  "several  - 
of  the  key  intejrfjrce  gaps*    And  Certainly  the  weedihg-  out  of  the 
weaker  laboratories  and  centers  and  the  concentration  9f  more_^ 

resources  in^  the  stronger  organizations  was  i^evitat^le  ar^d  overdue*  ^ 
Still,  whatever  the  ci^^j^ee  of  progress^soirte  degree  , of  instability 
continues    espec  ialXy  in  macrostructure  management.  Long-term 
^¥  prospects  for  the  success  of  individual  R/D6cI  institutions  of  ^  ^ 

"high  quality  will'be  dependent  in  part  on  the  development  of 
consistent  long-range  programs  and  coord iiAting  mechanisms  to    .  , 
*  ^  -    produce  a  stable^  n^acro.^trucEiLire  *  ^^*\s  long  as  th^;  possibility  of 

future  upheavals  arf^^^reorganisatioas  of  the  system's  macrostruc- 
ture Jjeems  strong j'^R/D^I  pei^sonnel  .and  institutions  are  likei^y 

*  ).  V  *  * 

to  show  some  hesitancy  in  committing  themselves  J:o  th^k/ndlr^£ 

ion^-term  programs  needed  to  advance  the  dc^lo^ient  of  the  k/D&I  ^  *'  \  ' 
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syscem  and  acffre^e  tiie  long-range  goal        inproviag  edLicational 

Draw*:ice,.     If  s^^scen  maturat^^  is  to  be  substantially  furtnered, 

^    ^  i-c  wpold  seexn  that  NIE  s  stated  comrriitmeats  to  programmatic  and 

1^^  * 

organisational  stability  and  to  loag-rat\g^  planning       wilt  need 
to  be  backed  up  vith  demonstrable  evi^enc^that  it  can' exercise 
its  leadership  role  iij  a  manner  that  prorhotes  system  stability* 

4 ,      Resourcg  Base  y 

Mature  R/D£il  systems  are  generally  characterized  by  well  developed 
resource  bases  adequate  to  the  demands  of  system^J^ctioning  and 
appropriate  to  the-j^antity  and  quality  of  outputs  expected  by  their 
sponsors.    The  inadequacies  of^the  educational  R/D£tl  resource  base  are 
readily  apparent .    We  consider  tf^o  resources  at\Jlength  in  subsequent 
.chapters       personnel>^nd  funding,    ^uch  of  the  analysis  in  these  thap^ 
^ters  underscores  the  immaturity  of  educational  R/D£tl,  and  suggests  that 
substantial  progress  in  system  maturation  is  uhlikely  without  inter^  ^ 
vention  in  the  development  of  these  tesoarce  bases.    To  support  our 
historical  analysi;3/we  simply  sua^narlze  here  some  of  the  material  ^ 
covered  in  these  li*figthier  pres^tations  * 


A,  Personnel 


The  personnel  base  of  educational  R/D^I  mky  be  the  most  critical 
and  most  dlf f icGTT'source  of  weakness  retarding  system  maturation. 

Precise  data  on  the  personnel  base  await  the  results  of  the 

"t  *^  ^ 

*^  organisational  su^rvey*undertaRen  as  j>art  of  f^IE*f  Education 

'   143     *J  *  - 

KPUp  H<sni,tor4ng  Pr^ram/    ^tfCheVer,,  bafeed  on  general  estiiriatjs 

^  and  analyses  in^'the  literature,  several  observations  ^em 

recisonsble  at  this  time:  , 

F 

-I-      In  comparison  to  the  oarly*  l960Sj  the  educational 
K/b^l  personnel  base  has  more  ihan  double<f  in  sixe 


ERIC 


y 


72 


J  - 


> 

r 

--',froai  an  estiinate  of  around  4,000  -in  1964  to  around 
to, 000  in  L974}^^ 


2,  Still,  Che  personnel  basli  seems  inadeqtjate  in  sheet^ 
numbers  ^ 

3.  Most  of  the  work  f or^e*^  is  represented  by  researchers ,  ' 

^  146 

evaluatipn  researchers,  and  development  personnel . 

*  ^  *  t  ' 

There  would-  aopear  to  be  \  particularly  inadequate 

nun:iber  of  personnel  to  carry,  out  linkage  rales. 
If 

Educational  researchers  and  other  R/D£tl  personnel  are 


gearod  nore  to  th'j  old  -pattern  of  academic  ||rjoject 

V 


generally  rated  as  low  'in  productivity  (as  measured 

W  ^  -     '  '     14?  ^  ' 

'  by  publications  and  oth^n  system  o'utpujs). 

6.      By  training  4nd  professional  background,  educational 
personnel  tend  to  have  been  trained  ^eit^her  in 
the  fields  of  e^ucfition  or  psycliology  andl  com^  ouc  of 
^  the  psycho-statistical  traditiioVt  and  ^aniversity  work 

As 

environtnents  (^r  school  sy&tem  positions  aS^^^r^chers  or 
adtnini^Jrators^'^^  Although  some  progress  has  been  made 
in^  recruiting  personnel  from  other  fields,  these'  oth&r  j 

personnel  still  represent  no  more  than  one-fifth  of 

V      ^  149 

the  educational  R/D<ScI  per^G^el  base*      G^'^/en  the  nulti- 

disciplinary  nature  of  the  field,  there  is  clearjy^a 
need  ftir  a  n^re  substantially  muUt  i-disciplinary  bas«  * 
p.- of  recruitment,   including  $uch  fields  as  sociology,       ^  * 
artLhropoiogy,  poLiticaPscience,  economics,  etc, 


1 


Wrth  few  if  any 'training  programs  geared  to  producing 
R/DciI  '(Specialists,  and  the  few  that  have  been  available  / 


ERIC  .   .  •  » 


research  rather  than  programiuat ic  deVelopmentl^-^^on-tlrq-       *  ■ 
job  ^training  has^  beerr  "the  prlrnary  mechanisTri  ^or  pro-      ^  ^ 
ddcing  ni^Qpower  wich  appropriate  ski^lls  and  cbinipeten-  . 
cies        an^inesff Lcient  strategy  at  best.    S.ome  initia-     .  ^ 
tiv«s  have||)Jbeea  taken  to  develop  training  programs 

mor^Neuitat/le  to  tii^needs  of  educational  R/DitI 

•  ^  ^<  151 

functioning.      But  as  yetj  it  Is  too  early  to  dcte^ 

,  a  significant  cliange  in  the  characfer  of  the"  system's 
personTiel  base.  *  > 

S.      The  field  suffers  particularly  from  the  lack  of  art 
■  ,  adequate  supply  of  ^trained-or  ejjperienced  R/D6I 

managerSj  or  even  an  appreciation  of  R/D5tl  management 

as  a  function  that  could  benefit  from  specialized  "  * 

skills  4nd  training.  ' 

The  recruitment^  trainiTi^j  and'  socialization  of  a  talented  personnel 
base  for  educatipnal  RA)6I\will  require  overcoming  several  seemingly 
lairactable  prj^blems        e.g.:       ^  ■  " 

the  i^w  prestige  o£  education,  educati^ai  research, 
and  educational  RicD;  *  .  ^  r  * 

the  orientations  of^ost  of  those  who  come  out  of  unl-^ 
versity  settings -toward^^vancing  theory  rather  than 
improving  practice^  doward  individualistic ■ rather  than 
team  functioning, i  tov^rd  relatively  homogeneous  rather 
than  h^erogeneous  persorrnel  ski  11' mixes ,  toward  pf^o-  ^ 
ducflhg  publications  rat>her  t^an  products  or  programSj 
and  toward  a^  "professional"  rather  ^than  a  "bureau-, 
.cratic*'  style  of  functioning  ^n'd  management;* 

the  Complexities  of^dcve  lopiWig^iltable  training  pro- 
grams given  the  amblguPfy  that"  surrounds  the  definition 

/     "     '  ^ 


* 
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^  of  w&rk  roles,  , requisite  skills,  and  standards  for 

vFai^ious  £unccional  sDecialties  in  the  field,  and  the? 
,    weakness  of  the  existing  knowledge  base;  and 

\  ■ 

the  instability  of  R/D^StI  funding  and  the  insecurity 
of  R/D<StX  positions  compared  to  tenurecl  univtsrsity 
posts. 


Un4^s3  R/Oiif  sponsors  give  concerted  attention  to  these^problenis, 
continuef^^a^^crj  maturation  will  be  diff^ult  to  achieve.  But 
is  it  posst^ble  to  attract  talented  personnel  to  educa^tional  R/D^^I 


given  the  present  poor  quality  of  system  ^^puts  and  the  resultant 
inability  to  overcome  the  system's  l«v  prestige?    ^Is  it  reason- 
able to  try  to  intervene  nov  in  the  maturation  of  the  systeni's 
c  personnel  base?  or^^  is  it  wiser  to  concentrate  resources  on  a  few 
key  projects  ^*here  the  critical  mass  of 'talent  already  exists  and 
impressive  levels  of  achievement  are  within  reach?    Will  a  few 
exciting  high  quality  R/D6(I  outputs  do  more  to  attract  talented 
personnel  th^n  resource-building  strategies  focused  on  recruitment 
and  training'  programs?    We  have  no  answers  to  offer,  but  clearly 
high  level  debate  on  these  policy  options  would^eem  to  be  in 
ordexj  leading,  one  wpuld  hope,  to  J,ong*range  planning  iof  inter-  ^ 
related  product  development  and  resource-building  strategics  to 
spfeed  system  naturatioa. 

( 

B,  Funding 

The-  funding  of  ^^iicational  R/D^I  has  tended  t8  suffer  frt^n  five 
key  wakn^sses:'    relatively  lov  le^els^  insufficient  diversi- 
fiCrttion  of  sources;  instability,  inadequate  concencfratioft^^and 
inadequate  atj^ntion  to  funding  policy  development-  '  ^ 


The  best  estimaCe  avaiiable'^^Jb^' the' Level  of  funding  for 
edycatic^Sil  R/D!(I  iri  this  coua^vy,  frpm  all  sources 
(public  and  privates )^^^^s  sc5?:^C:jh^r^between  S605  millioa 
and  $673  niLlion  (dependir.g  on  'Aat""iT^incTuded  or 
excluded  In  a  given  escimate)^  with  $619  mill  ion  the  TTiifst 
likely  figure.    These  data  are  for  Fiscal  Year  1975 j  the 

recent  year  for  which  s'lzYi  an  estinate  is  availableP^ 
This  figure  r^st  be  considered  in  light  of  anr,ual  ediacation 
expenditures  (by  all  le/eis  of  government  combined)  of 
approy^ir^tely  $90  billion  by  Che  early  I970sP^Csing  the^ie 
figures,  we  calculate  that  the  annual  expenditure  for  R/D£(I 
in  education  represents  no  more  than  0.77*  of  total  educa- 
tion experiditures .    The  inadequacy  of  this  funding  level-is 
underscored  by  conparison  with  other  sectors       e.g.:  3.4% 
to  5%  of  expenditures  by  ihiiustry  are  appropriated  to  RiJ); 
In  the  healnh'^sector  the  figure  is»it,6%;  in  agriculture> 
Ip'lSL^  and  th^.  D^spartment  of  Defense  appropriation  to  K&D 
runs  as  high  as  10%  to  14%^^*    Given  the  immaturity  of 
educational  R/D5tl  compared  to  these  ot^er  sectors  and  the 
need  for  expensive  capacity-building  expenditures >  the. low 
level  o§  funding  availabl'^  to  support  educational  R/Diil 
seems  "espefcially  problernatic  * ,  . 

b.      Insufficient  Diversification  of  Sources 

Of  the  approximately  $619  million  spent  each  yesr  on  educa- 
tiona:  R/Dal  iTt  thi^  country^  the  bcjst  availaDie  escioate^  is 
that  approximately  ^313  million,  or  83%  (in  Fiscal  Year  1975) 
.came  fro*n  various  departT?,ents  or  agencies  of  the  federal 
governnej^t         C  Ic.ir ly ^  the- federal  gov^rnmen"  has  become 
the  prirfjiry  sponsor  of  edueational  R/D£tl.    The' remaining 
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177,  are  estimated  to  come  fron;     state  funds,  $40  million 
(S30-S60  nillLon);  local  gov'ernment  funds,  $4  million 
($2-$L0  RLllLon);  private  fqundations,  $57  million  ^ 
(i557-$"65  million);  and  other  private  sector  sources, 

possibly  $5  million  C$3-$2S  miilioa,  but  here  esti^maftion 

*  157 
is  particularly  dirficult).      G^reater  diversification  of  ' 

■SDonsorship  wouH  seem  to  be  advisable  given  the  poli^tical 

vulnerability  of  fedacational  R/D&I  expenditure  in  a 

climate  of  liniit^d  R/D&I  system  legitimacy  and  lack  of 

substantial  confidence  in  the  systen^s  ability  to'produce 

a  reasonable  return  on  the  taxpayers*  investment.  Clearly, 

though',  substantia!  inv^t:nent  in  educatior.al  K/oil  by  the 

private  sector  cr  by  state  and  local  governnients  is  unlikely 

unless  i4";iagiaative  ne'«"  incentives  are  proiftded"  and  bold  new 

initiatives  are  taken  to  attract  this  new  sponsorship. 

c.      Instability  of  Funding 

Instability  of  funding  has  been  one  of  the  nost  serious 
problems  confronted  by  the  educational  R/Dftl  system  ov^ 
it5  brief  histori=.    The  early  promise  of  ample  funding  for 

w 

educational- Jl/D&:I--wa^  clouded  within  only  a  few  years. 
Funding  for  different  -types  of  R/D&I  activities  has  tended 
to  ebb  and  flow  wit^  frequent  shifts  and  fluctuatiofts  in 
federal  R/D&X  priorities.     Federal,  r^i^nce        annual  rather 
than  longer-tertn  funding  cycles  .was  a  frequenc  cause  of 
cdtep^latnt  in  th#  ea/ly  year^^of  the  system.     Pleas  were  niade 
"for  lorig^r-Cemyfuqding -comrjitments.  to  permit  long-rang^^ 
'fjLanni?ig  of  comple3!rl5^1ti^y#ar  projects^''^  ,    and  some  nodi- 
ficatjor.  of  f-vftdifig^^ol  iaics  '  in  this  direct  loo,  has  been^ 
apparent.'',  And^.  J^ip^J^  ^parent      pas'sed  now,  the  threat  of 
2crd-;le/f*l  fundt*r;g 'for  llfE,  that  Vo'JLid  have  terrunated  the 
^^^ti^''^ .£;*;UtOTic-e' ohlv  4vr>^  ^iioxty  years  after  it*was 


77 


establi^riedj  has  the  educgcionil  r/D^I  eaterprist; 

wich  a  soinewhat  shak\   irnage.         would  seeca  that  greater 


longer -ter-^.  stability  will  be  aeeded  to  attract:  tho 

resource  base        tirst-rate  personael  and  subcon:#ractors  ' 

needed  t^^^peymit  sysien  maturation, 

d.  '     Inadea^jate  Cortcentrat ion  of  Funding 

The-  cir::.cuUies  posed  by  low  overall  funding  levels  arc 
conp:Lca:ed  fur::tr^f"?y  allocation  patterns  that  tend  £o 
disper^t  \;hat  little  noney  is  available  over  a  large 
r,Linber  of  projects  rather  than  .conceatratir.g  it  sufficiently 
on  a  £ev.    The-  tr^^nd  has  beet^to^yar^  gr-eater  and  greatej*  con- 
centration of  fundings  as  morw^  and  noro  projects  and  prograois 

J' 

have  lost  funding  and  increasing  nu-nbers  /of  federally  sup-^y 
ported  r/Dc(I  institutions  have  gone  out  of  existence.  Stilly 
given  the  limited  f^inding  available  and  the  high  costs 
incurred  by  large-scale  educational  R/D£tl  programs^  greater 
concentration  would  seen  essential  if.  effective  programs 
and  products  are  to  be  produced. 

Inadeciuate  Attention  to  Fund  ins  Policv  DeVelopinent 

A  well  conceived  funding  policy  for  educational^^/D^I^would 
bo  'formulated^after  dire  consideration  to  a  host  of  factors 
--  for  instance/ agency  missiion  and  goals  in  relation  to 
those  of  other  sponsors  of  educational  R/D6cI  ;  the  state  of 
dovelopn-^nt  of  the  educational  R/D^il  systcn  and  its  system- 

-Ijui  Idmg '  requ  ire-nent  s ;  the  existing  degree  of  balance  or- 
imbalance  among  r/D-SI  functions  as  currently  funded^  (as  com- 
pared to  some  ^ense  of  ninimuni  degrees  of  balance  required^ 

^for.  adequate  systeni  functioning  and  development);  the  need 
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for  so.T.e  degree  of  stabiLiLy  and  coaciauity;  etc.  There 
IS  re»ciC^-vely  lictle  evidence  oi  jnuch  attention  to  these 
kinds  of  systeniic  considerations  in  the  planning  or  bud- 
geting processes  of  17LZ  as  the  lead  agency  for  educational 
R/D&ly  or  of  any  of  the  other, key  sponsors  of  educational 
R/Ddtl!^^'^  Since  at  this  tine  funding  policy  appears  to  be 
the  primary  leverage    federal  agencies  are  able  to  exert  on 
R/DiSil  functioning,  these  srirts  of  issues  would  seen!  to 
warrant  considerable  attention.  *     '  ^ 


Patterns  of  Functionlag  _      _  , 

Virtually  ^ny  aspect  of  k/DuZ  functioning  in  education  might  be  used  ^ 
\\o  illustrate  the  iz::?-atur it y  of  the  system.    We  shall  consider  here  three 
^^X^hat  have  particularly  attracted  our  interest:     the  amorphousness  of 
standards,  ambiguities  in  defining  work  roles  and  requisite  skills,  and 
inadequacies  in  inforniation  flow. 

A.      Auiorphousness  of  Standards 

The  current  period  of  heightened  self-consciousness  in  educational 
R/D6I  has  produced  nutnerous  critiques  of  the  conduct  and  especially 

poor  quality  of  out  puts  of  different  f unct  iorial  specialties  and 

161  ^ 

R/Dal  institutions.        Several  analysts  have  suggested  models  for 
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eva Lu^it'iffg:'' the  nethodoLogical  adequacy  of  conpleted  projects. 

But'  on  th6  whole,  the  impression  that  seems  reinforced  by -tfie 

litt:ratiire  is  that  standards  of  qua^^ty  and  performance  in  edu-^ 

catlonal  K^itl  are  amorphous,  and  the  kind  of  consensus  on  stan* 

iaccs  ev^enc   xn  nat^jre  k/DoI  systoms'  is  iacktng. 


Edvicatiopal  ros^^-^rch,  for  inst^ace,  has/been  descr^ibed  as  lacking 

mm/  163  ^ 

■^^S'   "a  definite  structure  of  criticism.**.        Consequently,  poof  research 


gets  p'jblisned  along  "with,  and  t;onpetes  for  attention  with,  good 
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TtiStdarch,    Qualitiy  control  is  iriadec;uace ,  quality  is  ur.6-'=n, 
arid  cu::ujid:ivt;  dfe v?;  1  Dpr^erit  of  a  hi-^h  qualiLy  krLCvl^;dg»  bas= 
is  re  Larded ,  ^ 


Educational  evaluation  has  been  descrlbriG  as  hela  biick  by  a  lack 

164 

o£  "berichmarks  of  periornance  having  ;;ide3pread  refcir^nce  vaLu^/'  ^ 
Different:  standards  ar^  held  by  different  groups,  are  rarely  nade 
ey.plicit,  an^  are  rarely  applied  consciously  iti  a  ri^oroua  nan:ier. 


Consensus  is  grea^esL  in  the  nore  traditional  kir.cs  o:  research^^ 
where  prir.ciples  of  ^;:<perLTiental  design  and  sLaiiSLical  treatr:.er.t 
car^.  be  appli^.    Ye:  ev^n  here^  the  Uuerature  reflects  substar.iiil 
controversy  and  interfc^  disagreer.ent^^^ 

The  diffuseness  of  standards  In  educaLioaal  R/D£.I  is  pari;^cularly 

apparent  fron  descriptions  of  uhe  standards  and  criteria  ir.at  are 

used,  or  should  be  used.^  by  educational  R/D6I  persc4liel  in  con- 

♦ 

ducting  end  appraising  their  own  work  and  evaluating  the  perforn^nce 

> 

and  outputs  of  others.    The  phrases  used  lo  describe  these  stan- 
dards and  criteria  underscore  their  personal,  subjective,  '*soft" 
character        "personal  satisfaction  or  feeling,"  '^acceptance  by 
others  (m  ^^roject) '^acceptance  by  users/'  "appropriateness/' 
"relevance/'  "timeliness,"  "intelligibility,"  '^fideli^y,"  "cred- 
ibility/' "viability,"  "pervasiveness/'  "convenience/*  "goal 
attainriient/'  '^completeness  of  content/'  ''utility  or  value/' 

1 66 

''logical  rigor  or  consistency/'  and  ^'clarity  of  objectives/' 
More  of:ea  than  in  nature  R/DccI  systems  or  in  disciplines  with 
weH  developed  i^no^^ledge  and  technology  bases,  we  find  sponsors 
judging  e<JbcationaI  proposals  in  terns  of  the  significance  of 
the  problem  area  rather  than  quality  of  conceptuali'^:ation,  or 

meLhodoiogical  rigor  of  design^  or  institULional  capability,  to 

^167 
cart;y  it  out. 
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The  literature  includes  a  few  pieces  that  conHder  the  isdue 

of  standar^is  for  the  field        even  one  discussion  of  sor^e  kind 

165  *  ^ 

of  cercif icacioa  system,   .    Euc  clearly,  maturation  of  educa- 

J* 

clonal  R/D£iI  would  seem  to  require  more  concerted  attention  to 
the  problem  of  standards,  either  by  AERA  or  some  other  body. 
At  che  very  least  what  is  needed  is  fomulation  of  rigorous, 
objectively  phrased  standards  for  all  the  various  functions^' 
processes^  activities,  and  outputs  that  comprise  educational 
r/DSI.    Beyond'  thatj  over  the  long  run,  the  field  needs  to 
develop  some  reasonable  level  of  consensus  on  these  standards, 
end  explicit,  perhaps  even  9#lf-cor-3Cious  application  of  these 
standards  to  the  conduct  of ^educatior.al  r/D£.I,    Given  the  generally 
poor  quality  of  educational  research  and  r/Dc<I  outputs  to  date, 
this  problem  would  seem  to  be  particularly  pressings 

Ambi^tiities  in  Defining  Work  Rotes  and  Requisite  Skills 

R/DocI  operations  tend  Co  require  tea^i  functioning  under  bureaucratic 
modes  of  management.    A  large  proportion  of  the  E/D£tl  personnel 
at  '^ork  in  the  System  today  Here  socialized  in  settings  character- 
ized by  individualistic  definition  and  Investigation  of  research 
problems  regulated'  only  by  peer  approvail'^^Adapcation  to  the  new 
mode  of  functioning  has  been  painful  for  many,  impossible  for  some. 
.There  appears  to  be  little  in  existing  training' programs  to  make 
'th^r  adaptation  any  easier  for  new  recruits  to  educational  R/D£tl , 

The  literature  provides  evidence  that  there  has  been  some  inte- 
rest in  the  field  in  developing  taxonomies  or  wcgrk  require^ients 

an  i  n^ed^d  "en:ib  ler j'*  (  ik_l  ^, S  ,  krtow: t^dga  ,  ar,d  ^eas     x  ^icie 3 ) 
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^for  given  R/D6I  tasks.      Over  cime ,  ^tfrf  (Srmat  Ion  of  this  kind  may 

b^  'jseful  for  the  design  of  effective  craiaing  programs  geared 

Co  the  demands  of  R/DSd  system  fuazCiQningr   Al  the  moment,  hot^- 

ver ,  our  xmp^ress  Lon  is  that  a  significant  amounc  ol  anbiguity 
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s^^rounds  the  definition  of  work  roles  and  relationships  and  their 

requj-i^it^;  skilly,    Xher<;  is  ^  danger  in  our  overstating  the  case, 

'    Progress  has  been  made  in  d^ifining  the  technical  aspects  of  R/Do<1 

functioning  and  some  of  the  technical  skills  needed  for  certain 

functional  specialties.     But  interview  data  assembled  from  case 

studies  of  exemplary  R/D^I  projects  are  most  revealing  about  an 

array  of  other  kinds  of  skills  that  R/DctI  personnel  judge  critical 

to  the  work  they  do        skills  for  which  many  are  ill  prepared  by 

training  or  prior  work  experience,    Work  v;ith  others  in  a  tea:a 

setting  is  one  of  the  most  frequently  mentioned  of  these  skills, 

V/riting  ability  is  another*     Sensitivity  to  the  dynamics  of 

various  organizational  and  inter -organizational  settings  is  still 
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another,        While  personnel  involved  in  day-to-d^iy  r/d^I  fuftc- 
tioning  call  attention  to  these  "nont^echnical'^  as  wel^  as  the  usual 
technical  skills  associated  with  their  work,  the  literature  on 
competencies  required  to  carry  out  R/D6cI  ^lasks  tends  to  concentrate 
on  only  the  technical  aspects.    If  educational  R/D&I  is  to  function 
sraoothly,  realistic  pictures  of  R/D£tl  work  environments  must  be 
provided  to  new  recruits,  and  training  prograns  (both  pre-service 
and  in-'house)  must  be  oriented  toward  socialization  and  censi* 
tization  as  well  as  technical  competence. 


Inadequacies  in  Information  Flow 

t 

Inadequate,  inefficient  information  flow  is  one  of  the  most  p^rva-- 

sive  problems  in  educational  R/D6I  system  functioning.    We  consider 

information  flow  problems  in  some  detail  in  subsequent  chapl^prs. 

A 

The  literature  is  fiH^^d  with  discussions  about  the  lack  of  adequate 
disseminition  and  linkage  mechanisms  to  bring  R6D  outputs*  to  the 
attention  of  operating  system  personnel^  >ind  to  facilitate  adop- 
tio^^  and  implementation  of  externally  developed  innova tions^^^ 
There  are  also  a  nunber  of  useful  analyses  of  the  barriers  to  * 
information  flow  in  tho  operating  system  --^  anong  educational 


prtic c LC ianers  as  a  profession,  among  sciiool  disLnctb,  even 
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within  school  distrLcts  and  vLthin  single  school  buildings,  ^ 

But  p;;rhaps  Isast  uaderatood  until  recently  is  the  inadet^uacy 

of  information  flow  anong^  the  researchers  and  R/Di^il  personnel 

functioning  on  ths  KP  end  of  the  K?U  spectrutnP^  Though  the 

f orr^I  information  flow  system  of  professions^  association  Eaeetlngs, 

jo'jrnals,  secondary  publications,  and  inforfiution  agencies  parallels 

other  fields  and  disciplines  (in  the  case  of  the  ERIC  system  It 

surpasses  it)any  other  fields- In  easy  access  ta  J*he  fugitive  l&tera- 

tur;  of  the  fieldy,  KP  functioning  in  educatlin  generally  lack 

the  wi;ll  developed  inf orn:il  corriunicatlon  netuo^.s  of  rnatute  dLsci-- 

plia^js  arW  R/Dil  systerus,    There  has  been  increasing  'aterest  in 

'  177 
such  concepts  as  ''research  conimunities'*  and  ^'Invisible  colleges/' 

As  yet,  though,  there  is  relat  i ve ly  little  e vid ence  o f  the  one r 

gence  of  the  kind  of  social  organization  of  research  areas  so 

critical  to  the  rapid  development  of  cumulative  knowledge  bases 

and  nacuratlon  of  the  r/dStI  systetrfs  dependent  onjthese  knowledge 

bases* 


The  Improvenent  of  Infornation  flows  nay  held  one  of  the  mos: 
significant  kev^to  facilitating  system  maturation*     Yet,  despite 
AyERA  interestff^in  this  area  sorae  years  ago^^^we  are  aware  of  no 
slgaiflcant  Initiatives  to  .promote  the  development  of  research'^com- 
munlties  and  invislbi^  colleges  In  educational  research  and  R/D6tl 
functions-     Some  slspiificant  developments  aice  under  way  to  Increase 

r        '  '  *  • 

infor-^atJLOn  flo^s  tft^ithin  the  operating  system,  and  als^c^  E^c\/een'  the 
e:-:tt:rnal  R/D6I  and  operating  systems.    This  Is  clearly  a  major 
foc'js  of  N'lE  Initlativesfc^  in  dissemination  and  in  developing  local  ^ 
probi^^m-solvin:;  capabilities.  ^Thc  intent  is  to  increase  the  le^'el 
of  int-i^grlt Lon  becween  the  R/i^i  and  operating  systems.  The 
potential         the  future  is  promising.     But  most  of  these  Initia- 
tives are  t':>o         to  have  had  significant  im^pact  on  the  vast  edif- 
catior-al  i?ystem  in  this  country.    At  the  pr'^sent  time,  then,  the 
in<id9quacio5  of  inf^mat  Ion  flows  in  education  appear  to  be  n 
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clsar  indicacoi:  o£  the  itnnatur jLty  of  the  R/Dil  system. 

6.      Da^rae  of  Irtte^rat ijlin  between  the  R/D6el  and  Operating  Systems 

A  nature  R/D£sI  systen  could  be  characterized  as  an  integratc-d  ^^s^stem  of 
rec  ipr  Dcat  ing  _^arts wich  comporients  meshing  so  effectively  chat  cievGl- 
opaent5  in  one  pact  of  the  system  bring  about  changes  in  all  other  parts 
of  the  syste^n*        In  ^educat  ion j  this  might  mean  that  a  majtjr  break- 

througii  in  the  r^se^rch  or  development  function,  fpr  Instance,  would 

V  ^ 
a:fecc  not  only  institut  ioi^s  thjat  conduct  research  or  developnient 

activ;cits  but  also  achooL  systems,  .state  depart^nec^s  of  education, 

Lecichtr  s  tra  inin^  luititut  ioas  >  R/d£<I  sponsors ,  etc .    Thi  s  is  hardly , 

what  on^  finds  in  fact  in  education,    ISfie  linkages  in  education  tend 

to  be  casual  and  incidental,  and  information  flows  fron  or^e  part  of 

the  system  to  another  are  episodic  at  best^  ^     .  ^ 


One  of  the  inost  pervasive  themes  iri  the  educationaT  R/D6I  literature 
is  the  lack  of  integration  i^ween  R6D,  on  the  one  hand^  and  educa- 
tional practice,  on  the  other*    The  R&D  and  operating  systems  appear 
to  function  in  two  discrete^  compartmentalized  woi^ldsj  barely  touching. 
The  literature  describes  and  documents  the  large  gap  between  educational 
research  and  practicel^*^    Liit/e  educationSl  research  has  been  found  to 
have  ^.ny  discernible  impact  on  educational  [Jractice*    And  .Virtually  none 
of  the^pr^domia^nt  practi&es  of  school  systems  have'  been  4>ucid  to  have 
any  foundation  in  educational  research,    ^^^escribed  by  several  ai^talff^stSi 
ducational  research  i*^8:arely  oriented^to  problems  of  educatio^l 
practiCGj  and  -  there  fore ,  researchers  are  not  accu^lating  a  knowledge 
base  about  educational  practice  and  how  to  improve  it.     Fevj  of  *the 
products  of  R6tD  institutions  ^c'-d  few  of  the  highly  pubHciz^;d  inno- 
vatlvti  strategies  of  Jrecent  decades  h^ve  been  found  to  be  implemented 
in  school  systems;  where  they  have  been  found,  they  tenjied  more  often 
than  not  to  be  emasculated  Into  "more  of  the  same  old^thing/'  School 
systems  that  are  hi^ghly  innovative  have  been  described  as  generally  ^ 
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drawing        internal  rather  than  external  source^  of  innovation.  New 

r 

maCerlai^  and  progrrvms  are  produced  by  their  own  prof essi-onals ,  usin^ 
severely  limited  local  sfesourceSj  Co  develop  local  innovations  tliat 
are  for  purely  local  consumption*    Consequently,  a  vast  body  of  ^ ' 
practice-based  innovation  fails  to  get  disseminated  or  even  documenLe,d; 
lit;tl£'  of  it  is  adequately  researched  or  systematically  evaluated; 
relatively  few  of  these  innovations  are  even  ^'developed"  suf f icie^^-ly 
to  'permit  utilization  by  educators  other  than  those  uho  created  them* 
Clearly^  then ^  innovation  in  educatibn^  where  it  doos  eKist,  is  not 
being  nanaged  with  maximal  efficiency  for  the  educatlonaT  enterprise 
tin  this  country* 

The  evidence  comparing  educational  research  and  RcJ>  outputs,  on  the  one 

hajid  J  to  educational  practice,  on  the  other,  seens  overwhelming. 

Although  there  has  been  less  cotnmentary  on  other  weak  links  in  RM) 

and  operating  systeui  integration,  some  of  these  too  have  been  noted, 

The  teacher-training  institutions^  for  instance,  tend  to  pass  on 

conventional  practice  rather  than  provide  an  appreciat  ion  ^  or  an  up- 

'  181  ■ 

to-datc  understanding  J  of  new  developments  in  the  r/d&I  system*^  To 

con3idei**another  example^  r/D^I  and  operating  system  personnei  tend 

to  be  part  of  different  information  flow  systems  that  rarely  overlap* 

They  tend  to  read  differeftt  journals,  belong  to  different  professional 
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associations,  attend  different-kinds  of  meetings,  etc* 

We  consider  tljg  gap  b^ween  the  educational  r/d&I  and  operating  systems, 

*  '       '  183 

and  some  of  the  reasons  for,  it,  in  several  chapters  of  our  analysis. 

Our  concern  ^it  y:i^s  point  is  simply  to  call  attention  to  this  factor  as 

additional  support  for  the  conclusi on 'that  educational*R^  is  still  in 

an  immature'  state  of  deve lopirient  and  will  require  conierted'attfcntion 

tQ  KPU  integration  to  speed  maturation  processes* 

'  -  * 

The  need  for  greater  KP  and  KU  integration  has  been  given  increasing 
recognition  in  the  past  few  years.    The  literature  of  the  *609  Included 
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a  few  calls  for  -  increased  practitioner  participation  in  educational 
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R6cD  decision  making,      some  lucid  pieces  by  one  major  theorist  of 

eduction  R/D£t3>c^l  ing  'for  a  market-or  iented  rather  than  KP-^arlcnted 

1 85 

approach  to  the  -institutionalizatiory  of 'educational  R/D^vl,      ^nd  - 

burgeoning _ literature  analyzing  the  dissemination  function  and  calling 

for  the  creation  and  support  o£  needed  linking  roles  and  linking  instil 

tutions.    But  only  in  the  past  few  years  have  dissemination  and  linkage 

become  a  major  focus  of  federally  funded  R/D£*I  organizations.  Linkage 

organizations  are  proliferating.        Support  for  local  probUm-soLvir.g 

has  emerged 'as  a  major  new  thrust  of  federal  funding  and  research. 

Organizational  pevelopment  and  various  other  organizational  renewal 
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strategies  appear  to  be  taking  the  field  by  storm.  Do*^it-yo\irseli 

guides  are  appearing^  to  help  school  systems  analyse  and  solve  their 

'  '  188 

proljlems  ,  find  and  negotiate  with  external  resource  organizat ions ^  etc. 

KP  organizations  are  betiiDming  more  concerned  a^>out  implementation  and  ^ 

utilization  of  their  products,'  and  leaders  of  some  o£  the  more  Successful  ^ 

of  th^se  organizations  ^re  publishing  analyses  of  their  approaches  and 
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experiences  to  stimulate  others  to  follow  their  lead.       More  resources 
are  being  devoted  to  creating  nationwide  dissemination  networks,  using 
the  active,  interpersonal,  technical  assistance  and  consulting  type^^E 

strategies  that  appear  to  be  most  effective  in  creating  significant' 

190  *  ^ 

change.        Even  the  ERIC  system  is  undergoing  change  from  a  vast, 

passive  storehouse  of  undigested  print  to  a  more  active  system  that 

is  increasingly  producing  targetted  information  analysis  products, 

and  is  increasingly  being  tied  into  local  education  information  centers 

with  the  capability  to  produce  information  products  tailored  to  specific 
191 

local  needs.        One  large  scale  program  was  funded  in  an  effort  to 
^  document  and  analyze  a  number 'of  exemplary  local  problem^solving 
projects  to  capture,  and  provide  developmen^t  and  dissemination  yf 
materials  derived  from,  internal  user  system  innovation  souvcesL  Other 
federal  initiatives  such  as  the  experimental  schools  program  sh^w  some 
movement  in  the  direction  of  focusing  on  educational  practice  in  exem- 
plary but  real  operating  systems  as-the^sis  of  research,  development^ 
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and  ih^  spread  of  innovaLion  and  che  improvemenc  of  practice* 


There  are;^  chen^  a  number  of  exciting  developmeats  afoijt  to  incroasti 
the  integration  between  the  R/Oal  and  operating  syst^ems.    It  is  too 
early  to  see  significant  impact  frora  these  initiatives*  *ln  tioie^ 
thoughj  programs  of  this  kind  n:ay  prove  to  have  been  of  major  i.-npor- 
tance  in  speeding  education  R/D<£tl  .maturation* 

7.      System  Outputs 

yattjre  r/d6I  systems  produce  high  quality  outputs  that  are  readily 
marketed  ani  widely  used  in  the  relevant  operating  systems.  Educational 
R/D6tl  activity  has  produced  a  substantial  number  cif  output's*^  In 
preparation  fen:  19/6  publication  of  the  Catalog  of  NIE)  Education  Products 
information  was  collected  on  some  776  of  a  much  larger  number  of  prac- 
tice-oriented outputs  developed  with  OE  or  NIE* funding  over  the  past 
decade  or  so.    Clearly^  a  listing  of  the  total  number  of  outputs  pro- 
duced over  the  past  two  decades^  by  all  institutions  carrying  out 
educational  R/D^tl  sponsored  by  all  funding  sources,  i^uld  be  many  times 


larger.     Several  other  catalogs  and  reviews  of  educational  products  have 
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also  appeared  in  recent  years*  , 

At "  this  timsj  there  are  few  data-based  statements  that  c^n  be  made  a-boiit 
the  overall  qu^flity  of  these  outputs.    Clearly,  though  >  the  tone  of 

most  of  the  discussion  of  output  <}tjal ity  *that  has  appeared  in  the  lit^ra- 

197  1 
ture  is  rather  negative*       Most  of  this  t;^d3  to^be  impressixfnistic  and 

ba^ed  on  examination  of  a  relatively  small  proportion  of  what  has  been 

produced.    Still  J  the  repeated  theme  is  that  the  outputs  are  generally 

poor  in  quality  and  relatively^  few  can  b^  found        school  systems 

af f ectin?^  educational  practice* 

.At  the  samS  time^  the  system  has  always  produced  some  outputs  of  out** 
standing  quality  and  widely  reputed  excellencti  that  have  been  widely 
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adopted  by  school  systems.     In  the  Late  '30s  atVd  early  '60s,  the 

r 

NSF  scieace  curriculur^.  improvement  projects  roc^ived  a  very  positi/e 

198 
response. 


^j^^the  late  *60s>  IndividuaLLy  Prescribed  Instruction  (IPI)  was  cited 
repeatE^dLy,  along  uith  Sesame  ■  Street ,  as  e^^mplcs  of  exempLary  projcccs, 

diffused  on  a  wide  scale,  tliat  have  produced  significant  changes  in 

J  199  '  ^ 

educational  practice*        In  an  efforc  to  identify  and  niake  better 

known  some  of  the  other  high  qualtty  outputs  of  the  system,  some 
projects  have  tried  to  ideatify  exemplary  projects  and  have  brought 
increased  attention  to  30  such  outputs  described       the  NIE  1976 
Pat dbook^^^Exatnp les  of  a^'few  of  ttiese  products  with  cj;tGnsive  utili- 
zation histories  are: 


Sullivan  Reading,  Program  (prograramed' readers) ,  reportedl^y  being 
used  by  more  than  five  million  childreni 

Science  Curriculum  Improvement  Study  (fundamental  concepts/ 
eleraentary  school  science),  reported  to  have  been  used  by  more 
>  than  one  million  students,  >  [ 

Jhe  Southwest  iteglonal  Laboratory's  Kindergarten  Pfogram,  or 
First  *Year  Connuaication  Skills  Program  (basic  skil^ls  of  *  - 

English  language  coEnmunicatton)  ,  reportedly  used  by  about 
'250,000  scudents. 


Simirlar  efforts  ha^e  also  identified  specific  outstanding  pieces  or 

programs  or  bodies  of  educational  research  chat  have  been  judged  to 

*  ^  201 

have  "had  a  significant  effect  on  educational  practice.  * 

There  has,  then,  been  some  achievement.    The  picture  is  perhaps  even 
more  encoiirage ing  if  one  takes  a  broader  and  longer  texm  view^cTf  system 
Outputs.    This  vie^j  "^cresses  the  gradual  dt^velopment  of  the  fie  Id  of 
educational  R/DitI  as  an, important  system  output  in  itself.  ■  Proponents 
of  this  position  argue  that  several  important  gains  can  he  observed 
over  timft  in  the  system's  brief  history       acceptance  of  ^the  idea  of 
rigorous  development  and  continuous  data-based  refinement  in  the 
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produett^on  of  materials  and  programs;      recruttment  of  needed  kinds 
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of  personnel,      and  gradual'  deveLopment  of  new.  kinds  of  training 
programs  appropriate  to  new  functlo'na^l  specialties;  dev/elopmtint  of 
new  technologies  appropriate  to-the  practice  of  these  new  functional 
specialties  under  the  enviroamtintal  and  organizational  constraints 
peculiar  to  the  educational  context;  creation  of  needed  new  institu- 
tions  "to  fill  gaps  in  the  system  rnacr oscr ucture  and  _  to  provide  the 
kinds  of  linkage^  interface,  -and  coordination  required  to  permit  more 
effective  system  functioning;  and  a^ove  all^  greater  understanding  of 
the  re<juireraents  and  coTiplexities  of  R/d^I  functioning  in  the  educa- 
ti'or.al  contextj  an  output  that  required,  and  continues  to  require^ 
learning  time. 

The  ^.ield,  then^  has  nade  some  noticeable  progressyin  establishing 
itself  and  gradually  evolving  the  personnel^  and  knowledge  and 
technology  base  needed  for  longer-term  development  of  tKe  .system's 
capab'ilit'ies* 

IV.      THE  HISTORICAL  FUTURE:     WHERE  DO  WE  GO  FROM  HERE?  ^ 

We  have  devoted  a  considerable  amount  of  space  to  the  historical  past 
and  present  of  the  educational  r/D6cI  system^    Before  turning  to  the 
system's  future^  it  would  seem  useful  to  summariEe  some  of  the  key 
points  we  have  tried  to  make  about  historical  forces  Vhat  continue  to 
be  felt  as  significant  constraints  on  policy  formation  and  R/D^l 
functioning  in^this  sector. 

We  noted  several  elenents  in  the  historical  milieu  o'f  the  ^60s  (and  to 
a  lesser  extent  the  ^50s)  that  sigjiificantly  affected  how  the  emerging, 
system  came  ta  be  perceivedj  what  was  expected  from  it\  who  would  cn^ 
would  not  be  numbered  among  its  supporters^  and  some  of  the  kinds  of 
needs  the  sj^stem  would  attempt  to  meet*    Firsts  the  fact  that  the 
federally  funded  educational  R/D6cI  institutions  (the  labs,  centers,  etc.,) 
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were  created  during  a  reforr^  upsving  in  th^^  rcfortn^onservatlsm  cycle 
of  recent  U,S*  social  history  explains  some  of  t.he  unrealisticaUy  high 
hopes  'and  expectations  that  its  creators  had  for  the  systen^  t^eir 
'  inpatience  with  doing  much  of  the  slow^  undramatic  foundation-^building  , 
needed  for  fuiiure  success^  and  thjs  inevitable  d isi L luslorLn^enC "that 
followed  in  the  cyclical  downswing.    The  legacy  of  both  the  high  h^pes 
and  the  disillusionment  continue  to  be  feltj  making  it  all  the  more, 
difficult  after  m*ore  'than  a-  decade  tp  explain  how  long  it  may  take  to 
get  significant  breakthroughs  in  complex,  areas^  or  how  significant  a 
portion  of  at^ailable  resoi^rces  should  be  spent  on  ^ong-term  capability 
building  rather  than  short-term  product  and  program  development-  ' 

Second  J  the  creation  of  a  federally  funded  R/D6I  system  external  to 
the  operating  system  at  the  same  time  that  educational  practitioners 
were  coming  under  increasing  attack  as  incompetent  and  uncaring  did 
not  help  to  endear  RStD  personnel  to  struggling  t^eachers  and  admini- 
strators*    Generally  strained  relationships  between  ojierating  personnel 
and  external  experts   (who  tended  to  have  limited  familiarity  with 
operating  system  constraints  or  perceived  needs)  were  not  helped  by 
seeing  what  appeared  to  be  lavish  quarters  for  federally  funded  labora- 
tories while  principals  had  yo  fight  for  money  to  replace  light  bulbs 
and  broken  windows.    Some-  of  this  ill  will  may  still  continue  today^ 
^implicating  further  the  difficult  problems  of  KP-KU  integration* 

And  third,  the  development  of' educat  iona  I  R/D^I  at  the  same  time  that 
race  and  poverty  were  emerging  as  socjial  and  political  issues  in  this  •  . 
country  and  schools  were  coning  to  be  viewed  as  major  vehicles  for 
social  reform  meant  inevltaSly  that  a  major  focus  of  R/D&I  activity 
would  be  meef:ing  increasingly  vocal  demands  for  school  programs  targetted. 
at  specific  racial  Bnd  ethnic  grouf>s  and  at  the  ecbnomically  disadvantaged. 
This  continues  to  some  extent  today. 

Aside  fro:n  the  historical  miUeu  out  of  which  the  system  emergedj  other 
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historical  factors  have  had  itn'c^ortant  effects  on  systuni  functLOaing. 
One  Such  factor^s  the  nev/ness  of.  institutionaJrized  r/d^L  in  education 
compared  to  the  ceaturies  of  history  associated  with  the  operating 
systec^j  and  traditions  ^  norms,  and  values-  that  run  counter  to  ac^ceu- 
tance  of  the  outputs  of  ei-cternal  K6tEl^    JlctD  approaches  to  producing*^ 
knowledge^  products >  and  programs  compete  with  traditional  methods 
for  scarce  resources  ^  and  in  many  cases  RcJ)  outputs  are  clearly  inferior 
to  conventionally  developed  products.    Consequent ly^  the  K/D&l  system  has 
a  legitimacy  problem  ^ich  niakss  it  pore  difficult  not  only  to  achitive 
KP-KU  integration  but  also  to  generate  sufficient  de:nand  for  RcJ)  pro- 
ducts to  build  a  strong  constituency  able  to  overcome  same  of  the 
system* s  poii tical  problems .  '  i 

Perhaps  most  critical  of  all^  the  emergence  of  the  federal  goverrjnent 
as  the  sponsor  of  most  educational  R/D6(I  activity  has  significantly 
affected  not  only  the  level,  distribution,  and  a|tabil  ity  of  ^R/Ditl 
^funding  but  also  the  character  of  the  system  thSt  has  evolved*  Policy 
options  selected,  rejected,  or  ignored  by  federal  officials  d(jring  the 
course  of  that  brief  history  continue  to  be  felt  as  constraints  on 
policy  formation  ^nd  K/d&I  functioning.    For  instance,  emphasis  on 
non-university  organizational  forms  as  mor^  conducive  to  mission- 
■oriented  R&D  contract  work,  with  relatively  little  attention  to  linking 
university  resea^rchers  to  the  work  being  done  *in  the  research  corpora-  j 
t ions  or  building  peer  review  safeguards  into  the  release  of  procured 
research  and  RfJ)  outputs,  has  complicated  the  problems  of  insuring 
quality  control  of  research  and  R&sD  outputs,  developing  a  cumulative 
knowledge  and  technology  base  for.  the  field,  facilitating,  infoifmation 
flow,  attracting  high-powered  research"  talent  to  education,  and  training' 
new  educational  research  and  R£iD  manpower. 

Kmphasis  on  creating  (or  heavily  supporting)  new  organizational  forms, 
rather  than  working  within  existing  settings,. or  building  new  programs 
around  the  existing  critical  masses  of  talent  in  education,  has  made 
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It  more  difficult  to  attract,  high  calibre  personnel  who  have  strong 

204 

^ties  to  th**  universities  and  loc^iLi/s  ip.  which  they  are  working  • 
and  at  any  rate  would  h^ve  little  to  gain  and  much  to  Lose  by  leaving 
the  universities  to  join  a  laboratory  or  research  corporation* 

Several  early  0£  decisions,  m^de  directly  or  by  default  had  similar 
effects  and  pose  simi  Lar' 4cinds  of  continuing  problems  th^ 
creation  of  a  lar^e  nuciber  of  laboratories  and  centers  rather  than  a 
few,  the  funding  of  large  nurnber^^'of  progratns  rather  than  only  a  few, 
and  the  emphasis  on  s,hort-range  quick  g^ay-off  goals*    The  decision 
to  create  a  large  network  of  nev  laboratories  and  centers,  without 

i  concern  for  the  inadequacy  of  the  supply  of  skilled,  ta].ented  personnel 
to  staff  it,  virtually  predetermined  the  poor  quality  of  R/D£cI  func- 
tioning in  most  of  these  institutions,  the  low  quality  of  outputs,  and^ 
a  worsening  of  the  prestige,  political*  environment  of  the  system,  and 
its  attractiveness  to  talented  researchers*    Had  the  system  started  on 
a  smaller  scale,  and  concentrated  on  producing  a  few  impressive  achieve- 
ments, educational  R/D£cI  might  have  had  more  success  in  attracting  emi- 

'nent  researchers  from  the  disciplines  and  talented  younger  researchers 
and  students  as  well.    The  small  institutional  base  could  have  expanded 
gradually  with  the  increased  supply  of  trained,  R/D£cI  personfieU 

Siinilarly,  little  vlS^ible  achievement  was  produced  by  funding  large 
numbers  of  programs  instead  of  only  a  few,  or  by  emphasizing  the  short- 
term  goal  of  producing  packageable  products  to  solve  immediate  problems 
rather  than  focusing  on  longer-term  needs  that  might  produce  significant 
gains  but  only  after  considerable  time*    Educational  K/d^I  today  might 
.be  in  a  somewhat  better  position  if:   (1)  available  funds  had  been 
adequately  concentrated  on  a  few  programs  where  a  critical* mass  of 
talent  was  already  available  and  the  knowledge  and  technology  base  was 
sufficiently  developed  to  bring  impressive  achievement  within  reach; 
or  if  (2)  resource  allocation  had  emphasised  building  the  system's 
capabilities  for  adequate  functioning  or  p\annift|  staged  cumulative 
attacks*  on  the  gaps  in  a  knowledge  base  that  need  to  be  filled  prior 

;.,v  • 
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Co  application  in  product  or  program  devolopnent.    Tne  dccrim<2nca^ 
effects  of  thtise  various  decisions  continue  to  be  felt  in  the  low         "  . 
prestige  of  the  system,  and  its  inability  to  attract  large -nunibers 
of  talented  personnel  or  sufficient  support  in  Congress  and  .anon^ 
the  federal  agencies  that  significantly  influence  the  appropriations 
process. 

The  0£  strategy  of  developing  a  netvgrk*  of  new  institutions,  external 
to  the  operating  system,  has  complicated  the.  problems  of  KP-KU  inte- 
gra'tion.    OE  policies  ignored  the  operating  system's  potential  for 
effecCL/e  K?  functioning  and  underestimated  the  difficulty  of  dissemi- 
nating, marketing,  wipning  user  system  adopt  ion  or  producing  effective 
user  system  tmple^Tientation  of  externally  developed  R^tD  outputs.  Conse- 
qujently>^  the^  limited  impact  of  external  Red)  on  educational  practice  has 
increased  the  political  difficulties  of  the  educational  R/D6tl  system 
in  trying  to  justify  its  existence,  rauch  le^s  the  need  for  additional 
funtling.    NIE  *  s  emphasis  on  biiilding  a  network  integrating  the  newer 
and  older  organizational  forms, 'external  R&D  organizations  and  internal 
operating  system  KP  capabilities,  and  emphasizing  dissemination, 
delivery,  and  implementation  supports  as  well  as  KP  function^  may  in" 
time  overcome  the  diff icu^lties  posed  by  the  earlier  approach.    But  for 
the  present,  they  continue  to  be  felt. 

In  the  re:nainder  of  this  chapter,  we  examine  al'ternative  descriptions  of 
4^e  likely  future  development  of  the  system',  given  actions  that  may  or 
may^not  be  taken,  particularly  by  the  sponsors  of  education  R/D^1  activi 
ty,  and  especially  ^^l£  as  the  lead  agency  for  ^educational  K^D.^ 

AC  the  .ery  outset  of  this  discussion,  it  seems  Important  to  take  note 
again  (as  we  did  ac  che  beginning  of  chis  chapter)  of  our  analytical 
biases*  for  our  analysis  rests  6n  cer^tain  fundamental  assumptions  that 
others  may  not. share- 

All  of  Che  work  thac  we  have  done  assumes  that  the  variou's  infititutions 
or  organizations  and  the  thousands  of  personnel  engaged  in  optrway  or 
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aiTOther  in  education  R/D^I  activity  (as  s^jons5rs>  per f orxt.-ri3^  linkers]^*^ 
or  user^  of  R/DSI  outp'Jts)  constitute  a  "system",  albeit  at  present  a 
weak  and  loosely  1  inked  system.    The  system  notion  focuses  ^ittention 
on  how  elements  interact,  and  therefore  how  decisions  made  in  relation 
to  one  issue  or  one  set  of  institutions  can  have  significant  implicatioris 
for  other  issues  and  other  institutions.    Therefore>  possible  courses 
of  action  can  be  considered  in  teems  of*their  possible  repercussions  and 
side  effects  throughout  the  system  and  not  simply  in  terms  of  the  im- 
mediate case  at  hand. 

The  system  notion  also  directs  attention  to  the  concept  of  maturation. 
We  mentioned  this  briefly  at  the  beginning  of  this  chapter.     R&D  i3y5te:::s 
go  through  a  historical  development,  proceeding  from  birth,   through  a 
transitional  stage>   to  a  gradual  maturing  of  structure  and  patterns*of 
functioning.    Thj^^hout*  this  voKime,  we  sugges^t  various  kinds  of  policy 
options  that  we  believe  should  be  considered  (or  at  least  studied)  so,- 
as  to  further  the  process  of  "system  matura^tion";  i.e.,  to  further  the 
strengthening  of  the  field's  institutional  and  personnel  base,  the  know- 
ledge and  technological  fjaundations  Qn  which  R/d&I  activity^  is  based, 
the  R/D&T  processes  within  each  functional  area  of  activity,  Research, 
develop::ient ,  etc.),  and  especially  the  linkages  and  information  flows 
across  pacts  of  the  system.     And  we  argue  for  NIE  to  play  a  strong 

lead  agency  role^by  adapting  policies  that  will  further  this  system 
r 

maturation  process  and  by  iJroviding  the  kinds,  of  coordination,  orchestra- 
tion, cos^^^^cing,  and  quality  control  that  matiye  systems  are  able  to 
-provide  on  their  ow^n. 

Given  this  sec  of  biases,  we  have  come  to  view  the  future  historical 
dcvelop:::eac  of  the  sysqeni  in  teems  of  the. likely  impact  of  NIE  (in  colla- 
boratfLon  with  other  sponsors  and  institations  as  well)  taking  either  a 
ialsse^-f aire  or  an  active  stance  -in  relation  to  system  maturation. 
Clearlv,  this  is  an  oversimplified  dichotomy,  and  in  reality  there  is 
likely  to  be  something  of  a  contitiuum  of  degrees  ot  laissez-faire  and 
dr-grees  of  .ictive  i^ystem  leadership,  and  the  precise  degree  of  ^ictivism 
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-taken  is  likely  to  va*ry  with  given  ^i^yiies..     However,  even  ackuow-  . 
.  ledgln^  all  of  tl^at,  we  think  the  oversliap  I  i  t  ied  dicfjoto?n>'  wil'f  \\el[f 
us  to  [yia^e  Our  kt?y  points. 

Clearly  >  any  attempt  to  pr*;;dict  tfie  Future  is  fraught  with  r'isks  and 
is  foolhardy  at  be^t.    There  are  so  many  unknowns.    And  if  the  his'- 
torical  pas^t    its  any  indication  of  the  future,  t^e  only  certainty  to' 
be  predicted  is  the  certainty  of  unexpected  shifts  in  priuriti*;;^  an^ji^'' 
directions.    A  new  NIE  Director,  a  new  President,  a  new  set  of  financi-  ' 
al  -pre;ssuresi  on  Congres^produc ing  cutbacks  in  education  and  other 
social  services,  the  creation  Department  of  Education  -  any  of^ 

these  developments  could  dramatically  change  the  parameters  of  the  situ^ 
ation  to  mske  the  recent  past  vastly  different  fi:;om  the  ^ysten^jS  future. 

Still,  if  for  no  other  reason  th^n  to  provide  some  understanding  of  the 
importance  of  the  ^*iead  agency'^  posture,  and  to  suggest,  the  significant 
g^tins  to  be,  expected  from  NIE  taking  an  active  lead  agency  stance,  it 
seems  useful  to  try  to . jextrapolate  t?ie  future  from  our  assessment  o-f 
the  recent  past  and  th^  present.    Assuming  no  significant  changes  in  the 
general'ly  laisse2^faire  stance  NIE  has  taken  with  regard  to  assuming  lead 
agency  roles,  what  are  we  likely  to  see  in  the  next  ten  to  twenty  years, 
and  what  differences  might  be  expected  if  a  more  active  leadership  stance 
were  Caken? 


Much  qf  what  we  predict  for  the  future  is  positive,   regardless  of  the  ^ 
activisin  of  NIE's  leadership  -  learning  time  generally  produces  gains 
reg^nrdless  of  anything  that  is  oi:  is  not  done  to  improve  system  function^ 
ing-    The  two  futures  we  predict  (as  outcomes  of  a  laissez-faire  stance 
versus  air  active  system  leadership  posture-by  NIE)  differ  in  terms  of 

the  magnitrudes  and  types        tains  to  be  expected  over  the  next  ten  to 
twenty  years.     Let  li^  confs/der,  first,  what  the  future  is  likely  to  look 
like  assuming  no  major  chfinge  in  NIE's  relatively  laissez-faire  approach 
toward  system  develppment  issues,' 
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_Ed I i^a t  lon^g  1  R /^DS ij  ^  Future  ^  A s^s^riin^.  a I s s e z - i_r^t^_0 ten tac  io n 
Toward  Sys  ten  XoaC*^^"^  ^  '  " 

A.  Thie  System's  Btivirontnenc 


With  the  e>;ception  of  some  low  points  (such  as  the  NIE  appropria-- 
tion  battles  In  1974  and  1975)>''the  overa^  environment  of  educa- 
tional R/u£f[  in  jihis  country  does  seem  to  havf  improved  to  at 
least  a  moderate  degree  over  the^  past  decade  or  so*  ^  We  do  not 
meaa  to  imply  that  there  is  a  high  degree  of  enthusiasm  or  even 
support  for  the  educational  R/d&I  enterprise.     Rather'we  take^  not^ 
of  che  fact  chat  Che  incense  animosijty  that  used  to  characterize 
relationships  between  che  Ri^D  "sysCem"  and  key  elements  in  its  "erl^ 
vironment  seems  to  have  cooled*  /  The  old  toes  of  the  system  have  ^ 
either  passed  from  the  scene  in  Washington  (or  from  Tositions  chaV 
enable  them  to  voice  criticisms)  or  they  have  lost  interest  in,  the 
subject  and  gone  ori  to  other  ijatters.    Educational  R/D^I  may  simply 
be  ignored  at  this  stage  of  its  history>  perhaps  ^s  too  small  a 
kettle  of  fish  to  warranft  concernp 

Given  past  ill  vill>  this  "neutrality'*  can  only  ^e  viewed  as  a  plus 
and>  barring  unforeseen  blovup£>  this  benevcflent  "neutrality  (or 
"benevolent  neglect")  is  likely  to  continue.    Left  alone  to  develop> 
with  less  constant  review  and  scrutiny>  and  less  pressure  to  pro-- 
dcce  evidence  of  immediate  payoffs>  policy  is  likely  to  be  made  in 
^ -ffOdch  healthier  climate  and  on  sounder  bases  than  might  have  been 
possible  in  much  of  the  past.    And  given  this  neutrality  and  ignor- 
ing af  tHe  system,  congressional  appropriations  ^are  likely  to  con- 
tinue to  shov  the  usual  pattern  of  gradual   (^lib^X^very  gradual)* 
increases.  *  4^^^' 

Mod^^st  gains  are  also  likely  in 'the  relationships  between  the  ex- 
ternal Ri*D  .and  operating  systems.    Some  equality  products  have  been 

producedj  are  being  more  effectively  disseminatedj  and  are  reach- 
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ing  uiser6  who  Are  reacting  with  at  least  modest  enthusiasm. 
^School  systems  are  likely  to  continue  relying' more  lieavily  on^ 
ccmHTierciaiiy  developed  materialSjand  their  own  internal 


sources  than  pn  either  RSD  outputs  or  exemplary  practices  de,*- 

1 

veloped  elsewhere.    But  stilly  the  old  hostility  seems  to  be 
gone.    Practitioner  interesJt  groups  are,  if  not  enthusiastic 
^bout  the  R&D  system,  at  least  less  antagonis  tic  >    and  some- 
what mollified  as  they  see  themselves  getting  some  chunks  of 
the  R&D  pie  that  was  previously  close<jjjpf£  from  them.  Th^ 
are  still  likely  to  feel  that  they  are  hot  sufficiently  con- 
suited  cn  their  needs>  and  that  educational  RSB  is  'neitlie^ 
adequately  re^iponsive  to  their  needs  nor  adequately  cognizant 
of  th^  constraints  under  which  operating  systems  function. 
-But  overall^  the  linkages  between  the  R&D  and  operating  sys- 
tems have  been  improving  (though  very  gradually) ^  and  this  ^ 
seems  likely  to  continue  and  perhaps  even  to  be  strengthened 
by  NIE's  new  emphasis  o^n  the  importance  of  the  practice  setting. 

We  see  no  reason^  however^  to  expect  significant  improvement  in 
the  low  E^estige  and  status  of  education  and  educational  R^D> 
no  developments  likely  to  significantly  raise  the  esteem  in 
whicb  the.  field  is  held  by  the  scholarly  community  or  the  public 
at  large^^  This  is  bound  ^  continue  to  have  a  detrimental  ef- 
fect on  the  System's  ability  to  attract  flrst'-rate  talent  to  the 
fields  significantly  higher  levels  of  funding,  or  other  fofms  of^ 
needed  support* 


vjunding 


Funding  leve^  -are  likely  to  expand  very  gradually.  "And  funding^ 
"decisions  are  likely  to  continue  to  be  made  on  an  ad  hoc>  project^ 
by-proj,ect  or  program-by-program  basis/  with  litclo  if  any  coordina 
tion  across  agencies  (or 'other  sources  of  sponsorship)*    TlTere  is 
likely  to  be  a  con^^ideroblcw^l^^nent  of  arbltrarinecs  in  funding 


policy  decisions  {such,  as  establishing  percentage  set  abides  for 
funding  certain  kinds  of  work>  wicho'ut  developingNsoun^J  r^ition- 
ales  for  such  decisions,  or  ccmsidering'  the  hosf  ofj/factors  that* 
should  be  taken  into  account  a&  ^  basis  /or  such  decisions). 
For  the  most  par t >  y funding  decisions  are  likely  to  continue  jo 
fo'cus  on  the  need  to  produce  substantiv^^^&utputs  to  solve  par- 
t^icular  ^roblems>  without  giving  much  additional  consideration 
to  effects  of  fanding  decislPns  on  the  system's  capacities  or 

»  r 

its  eaVironmnet .    KIE  is  likely  to  continue  to  conceive  its  re- 
sponsibilities largely  in  terms  of  funding  particular  kinds  of 
work  rather  thafi  also  assuming  active  roles  in  system  orchestra- 
tion, coordination ,  etc . 


Goa 
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The  brief  history  of  the  education  R/d&I  system  in  this  country  ^ 
has  been  characterized' by  a  continuing  dialectic  over  the  ap- 
propriate goals  for  such  a  system  ajid  the  kinds  of  work  that  there- 
fore  should  be  Supported,     To  what  extent  should  the  available  re- 
sources be  allocated  between  such  goals  as  increasing  our  under- 
standing versus  improving  practice?  improving  the  scientific  and 
technological  foundations  of  practice  versus  providing  products? 
developing  new  products  versus  disseminating  existing  ones?  work- 
ing with  educators  on  the  use  of  innovative  materials  and  the  de- 
velopment of  self-renewal  structures  and  processes  versus  wcnrking 
outside  the  practice  setting  on  generating  new  knowledge  and  develop- 
ing  new  products  for  ultimate  application  in  the  practice  setting,? 

There  have  been  major  shitts  in  relative  e:nphases  over  the  past  two 
decade^^in  the  rhetoric  and  the  available  f4nding,  levels  to  sup- 
port researchj  demonstrations  and  evaluation  research>  development, 
dissemination  and  \it  iliza tton^  and    now  a  renewed  emphasis  on  the 
inporcance  of  f undaii/ental  research  and  on  improving  educational 
pracriao.   -^^iven  past  histocy,  it  set*ms  reasonable  to  expect  a 
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regrouping  of  forces  and  a  new  fight  to  ensue  .short Ij' ,  to  re- 
'verse  ^v^hat  is  being  perceived  as  a  daei^^phas  is  on  R6D  and  especi- 
ally development  work-    As  they  feel  the  pinch  of  reduceti  develofi- 
ment  fundingj  trhe  non-profit  organizatLPns  and  the  universities 
'  (who  condu<^^most  of  the  federally  funded  development  work)'may 
team  up  to  revive  the  debate  over  what  is  ne^^d  most  and  what 
the  system  should  be  trying  to  achieve. 

D,     System  Capacity;    'The  Institutional  and  Personnel  Base  fog 
R/D^I  Functioning    .  \ 

JJ^jS'tem  capacities  can  be  discussed  in  quantitative  or  in  qualita- 
tive terms-     Taking  a  look  at  the  quantitative  issues  first,  the 
evidence  seems  clear  that  capacity  for  R/Dj^ , activity  has  expanded 
enormously  %ver  the, past  two  decades.    However,  a  substantial 

mount  of  this  growth  is  attributable  to  direct  federal  investment 
+ 

in  capacity. building,  and  the  signs  seem  to  be  that  substantially 
less  attention  is  being  directed  toward  capacity  building  qOes- 
tions  now  than  'in  the  '60s,    We  would  therefore  expect  that  with- 
out a  significant  change  in  policy  direction,  the  future  will  likely 
show  mare  modest  rates  of  expansion,  with  growth  rates  varying  a- 
cross  functional  areas  and  types  of  institutional  performers,    -9%  ^ 

FPr  instance,  though  NIE's  share  of  the  overall  educational  R/d&I 
budget  is  small  and  its  policies  do  not  as  yet  appear  to  have  had 
a  major  influence  on  the  funding  policies  of  other  educational  R/D£(I 
sponsors,  recent  funding  policy  shifts  by  NIE  can  be  expected, to 
have 'at  least  a  modest  effect  on  overall  system  capacities.    On  the 
basis  of  NIE  policy  emphases,  we  would  ekpect  over  the  next  few^years 
to  fund  at  least  a  modest  expansion  of  LEA  innouation  c^^pacitics  and  a 
more  Significant  expansion!  in  the  capacities  of  SEAs  and  IgAs  (inter- 
mediate  Service  Agencies)',  especially  *in  the  areas  of  dissemination 
and  utilization.    Associated  with  these  changes  (and  others  that  were 
already  utlder  way,  especially  at  the  state  level)  we  would  expect 
to  find  significant  increases  in  capaci,ties  for  need  identification 
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and  also  for  di'sseninat^iQn  and  utilization*    ;Ve  would  expect  too 
to  find  modest,  inprovements  iif  thfe  estabU^hnent  o£  the  key  Link- 
ages  ne^^dcid  to  nake  these  iiew  capacities  productive  in  affecting 
practice  on  the  LBA  level* 

*"  -J 

However*  we  would  also  expect  to  find  some 'loss  of  capacity  over 
xhe  next  few  y^ars  in  R/D&I  specialties  receiving  dec^^sed  sup- 
ports .This  seeais  especially  true  iri  the  x:ase  of  large  scale  de- 
velopment  work  whl&h  is  losing  some  NIE  support,    ^-^hether  this 
will  lead  to  sinilar  shcinkas^.in  support  for  development  work 
f  com  other  sponsors  (or  to  their  increasing  support  for  develop- 
ment wojrk  to  take  up  the^slacK)  remains  td  be  seen*     But  it  seec?-s 
likely  that  we  can  expect  to  se^  ^one  shninkage  in  development 
capacity  in  the  non-profit  organizations  and  acadeinic  institutions 
that  have  been  carrying  out  the  bulk  of  this  work* 

Whether  this  will  lead  these  institutions  'to  reorient  themselves 
toward  growing  areas  of  funding  {e,g,>  fundamental  research)  can 
not  b*e  predicted  now.   '^ut  one^'thing  does  seem  certain*  Regard- 
less of  what  these' institutions  do  to  reshape*  some  of  their  over- 
all effort  to  stay  alive  in *the  grants  and  contracts  economy>  de-  * 
velopnent  capacity  and  fundamental  research  capacity  are  not  in- 
terchangeable.    It  is  not  rea^onableVo  try  to  shift  development  ^ 
specialties  intc^  fundamental  research  which  may  be  expanding  for 
a  time.    The  length  of  time  required  to  train  cqmpetent  funda- 
mental researchers  is  enormous,  and  there  seems  strong  reason  to 
believe  that  fundamental  research  and  development  activity  call 
for  entirely  iJifferent  kinds  of  people,  who  func'tTuti^dif fei»entiy, 
.  approach  problems  dif ferently>  ^^nd  respond  differently  to  dif- 
ferent kiads  of  constraints  anA  ambiguities  in  the  work  environ- 
ment*     In  short,  if  development  capacity  is  lost>  it  is  likely 
to  be  lost  permanently^and  not  simply  shifted  temporarily  to 
other  assignments  ufttil  development  funds  flow  ngatn. 

The  shrinkage  in  development^f unding  is  likely  to  hit  the  non- 
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prof  Lc  corporations  an  J  acqdenic  insti  tl^tions^  with  par  ricular 
severity.     The  labs  and  cenjers  are  likely, to  stay  afloat  with 
little  di::iculty  as  long  as  they  can  r.aintain  th^lr  political 
cloCi*  apd  budgee  %eE: -aside .     Buc  approximately  305i  to  40/1  "of 
educational  r/DSI  funding  for  non-profit  corporations^  ids  a 
i^hole  category)  and  "univers  Lcies  is  for  development  workj 
and  to*  make  up  for  a  significant  reduction  in  these  funftsv^^^y  ^ 
are  likely  to  try  to  compete  more  intensely  with  the  for-|^rofit 
corporations  for  evaluation  funding  and  possibly  move  more  heavi^ 
ly  into  applied  research^  policy  research,  and  perhaps  utiliza-  ^ 
tion  activities-    Or,  even  more  likely^  they  w>ll  reorient  some 
of  their  effort  av^^a^^  from  education  and  into  other  social  service 
fields-     Thus  Capacity  night  be  lost  altogether  fror^  the  fi^iid  of 
education^  -  *- 

Although  it  has  beer^^  widely  assuned  that  increased  funding  for 
fundamental  research  would  strengthen  the  i^iversities,  ^here  most' 
basic  research  is  carried  outj  it  is  not  entirely  clear  that  this 
will  be  the  case  unless -sponsors  other  than  MIE  also  increase  their 
support  for  fundamental  .research,     The  reason  for  this  is  that 
while  most  agencies  do  heavily  support  academic  institutions  for 
the  conduct  of  basic  i;esearch  projects,  ,NIE  gives  most  of  its  basic 
research  funds  (73%  in  FY  1975^*^^)  to  non-profit  organizations. 

Even  If  some  marginal  increase  of  funding  is  channelled  to  the  uni- 
versities, it  seems  most  likely  that  the  Increased  funding  v'in'^e 
scattered  in  a  way  that  is  not  likely  to  promote  the  growth  6f 
"centers'*  of  re^arch  excellence  or  the  cumulative  development  of 
bodies  of  significant  research.    ,Thi5  is  suggested,  for  inst^ce, 
by  tne  recent  NCER  resolution:     (a)  increasing  the  funding  alloca- 
ted  to  fundamental  research  but  mandating  that  at  least  50%  of  the 
basic  research  funds  be  awarded  to  single  researchers  or  small  ) 
groups  of  Investigators  (rather  than^the  kinds  of  research  teams 
we  associate  with  strong  research  centers);  and  Cb)  suggesting  Cat 
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least  by  implication)  that  the  unsolicited  proposal  mechai:ibm 

would  be  used  to  sonie  significant  degree  co  fund  this  ki-nd  of  re- 
206 

search.         It  is>  of  course>  too  soon  to  say  whether  this  is  in 
^  fact  what  will  happen>  and^J^t  is  possible  chat  the  review  pro- 

^  cess  will  work  to  Channel  ■  the  funding  into  a  few  strong  Lines  of 

^inquiry  developing  a  cumulative  knowledge  base,    Still>  given 

past  history*  what  seems  more  lively  is  a  pattern  of  scattered 

* 

funding  along  the  lines  of  the  kinds  of  project  "selection  deci- 
sions made  under  the  Cooperative  Research  Progr^em  in  the  late 
■       *50s  and  early  '60s. 

/ 

One  particularly  positi^  a^ect  of  the  strengthening  of  field- 
ini^^ted  i;ork  and  the  u^e  of  the  unsolicited  proposal  mechanism 
sh?u^d^  be  a  reestab^*&hment  of  peer  review  panels  >  which  should 
in  turn  strenghten  the-  communication  mechanisms  of  the  fundamen- 
^         tal  research  community>  improye  information  flows>  and-possibly 

bring  into  play  che  operation  of  'invisii^ble  coUeg^^*  and  all  the 
strengths  they  bring  to  a  research  community.* 

We  have  up  to  this  point  focused  primarily  on  quantitative  changes 
in  system  capacity.    It  is  more  difficult  to  arrive  at  assessments 
'  of  the  quality  of  system  capacities.     Still>  most  observers  of  the 
field  would  probably  agree-  that  quality  has  hot  expanded  to  any- 
where near  the  degree  that  quantity  has.     In  fact>  in  some  areas 
■  at  least  such  as  overall  research  <^uality  there  may  have  been  a 
t  decline.    As  funding  expanded  at  rates  faster  than  what  could  be 

ustd  by  the  relatively  small  base  of  quality  performers,  many  re- 
searchers vere  attracted  to  the  field  whose  le^el  of  competence 
vas  not  up  .^to  par  with  thd  top  researchers  who  had  previously  dom- 
inated th|  award  of  research  grants  when  fundi^  was  more  limited. 
V  And  when  large  amounts  were  provided  for  new  specialties  such  as 
development  or  dlsseminat ions >  where  little  existed  in  the  way  of 
strong  cap^icity>  those  who  filled  the  vacuum  had  to  learn  how  to 
^        do  their  jobs  while  trying  to  do  then.    The.  quality  of  mUch  of  the 
y  v-'ork  produced  refeleCted  the  need  for  learning  time>  for  the  cumu" 
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la ti^e' develcpnent  of  a  knoviedge/ technology  base  for  these  spe- 
cialties, etc 

If  the  focuij  then  is  on  system  capacity  defined  as  "capacity'^ 
only  if  it  is  available  for  use  at  a  h^h  level  of  competence, 
it  nay  be  that  the  level  of  system  capacity  has  increased  only 
modestly  over^  the  past  decade  or  two>  and  is  likely  to  continue 
growing  at  niuch  ;he  same  modest  rate  unless  more  active  capacity 
building  pcsccres  are  assbmed  by  NIE  or  by  some  other  center  of 
system  leadership  (e.g.j  AERA  if  it  were^  williijig  and  able  to  as- 
sa^e  such  a  role>  but  ve  have  seen  relatively  littler  evidence 
that  it  is) , 

The  point  can  be  made  ncre  strongly  by  examining  the  likely  ia- ' 
jiact  oyer  the  next  decade  or  so  of  federal  initiatives  that  have 
been  taken  with  a  view  toward  expanding  system  capacity  but  have 
not  been  planned  in  a  way  that  takes  into  account  th^  complex 
factors  involved  in  effective  system  building.  *  '  ' 

One  good  illustration  is  the  NCER  resolution  mentioryed  earlier 
mandating  increased  funding  for  fundamental  research  through  a 
percentage  of  N'lE's  budget  set  aside  for  this  purpose.     The-  dif- 
ficulty with  this  approach  is  that  mQney  is,  not  the  only  ingredi- 
ent  required  to  expand  capacity*     Especially  in       area  like^ fun- 
damental research,  where  the  training  of  fundamental  researchers 
isV a  lengthy  process  that  can  be  carried  out  well  only  in  exist- 
ing centers  of  research  excellence,  the  size  of  the  existing  base 
of  quality  institutions  limits  the  rate  at  which  quality  work  in 
the  field  can  be  expanded-    Since  therey  is  good  reason  to  believe 
that  the' amount  of  increased  money  may  be  greater  than  what,  the  , 
quality  base  of  the  field  can  immediately  use  productively,  the 
increased  :noney  is  likely  to  attract  some  researchers  and  insti- 
tutions functioning  at  Iowrc  levels  of  quality  than  what'is  de- 
sired'-   The  funds  may^  of  tours^j  attract  first-rate  fundamental 
i^search  talent  from  fields  other  than  education,  and  this  may 
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benefit  the  ed'ucational  R/D6I  system  *by  expanding;  the  quality 
base  of  fundanencal  researchers  available  to  it.     However,  given ^' 
Che  low  prestige  of  edi^cation^  it  is  unlikely  that  there  would 
be  a  heavy  influx  of  first  rate  talent  into  education  just  be- 
cause of  the  probably  tetuporary  availability  of  funding.  More 
lil<ely>  most  of  the  talented  researchers  attracted  to  the  money 
would  have  primary  cormitmencs  to  other  disciplines  and  would  be 
using  the  educational  cPntext  only  temporarily  to  examine  ques- 
tions of  interest  to  them.    The  overall  gain  in  quality  capacity, 
thcn>  flight  be  only  temporary. 

Disseriination  and  utilization  are  other  areas  where  we  would  p*re- 
dict  that  efforts  to  quickly  expand  capacity  wili'^not  have  as 
great  an  effect  as  expected,  because  the  requirements  for  quality 
expansion  are  not  being  adequately  taken  into  account.     In  the 
case  of  disseziination,  it  appears  that  the  institutional  base  for 
dissenlnation  activity* is  expanding  faster  than  the  personnel  base 
of  dissemination  specialists.    Consequently,  many  of  the  nev  dis" 
se-inacion  programs  are  likely  to  be  staffed  by  personnel  with 
virtually     no  training  or  specialised  expertise  relevant  to  their 
dissemination  roles,     Consequently>  whatever  expertise  they  devel- 
op  will  be  gained  over  t  ime  >  largely  by  sea t-of- the-pan ts  ov^^^" 
job  learning.    And  while  the  dissemination  specialty  can  be  car- 
ried out  coripetently  with  considerably  less  training  than>  iet'us 
say>  fundamental  research*  stiTl^  there  i"^  a  body  of  useful  know- 
ledge  -and  skills,  strategies  and  techniques  that  should  be  absorbed 
for  effective  functioning  in  dissemination  roles. 

I^UT'".  che  sare  can  be  said  in  the  area  of  implementation/utilization 
Th^re  is  far  less  institutional  expansion  going  on  here  than  in  dis 
semination>  but  whatever  expansion  is  taking  place  (e.g.,  in  vari- 
ous  technical  assist>ance  ^ind  ^change  agent  programs)  is  probably  oc- 
currlag  at  a  faster  rate  than  what  would  seem  reasonable  given  the 
s-^al  r  pei»sonnei  base  w\ith  conpetenLC  in  these  specialties., 
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Federal  funding  has  b.een  us«d  to  support  the  development  of 
nunber  ct  new  craininj^  pro^ranis  tor  these  specialtiey.     But  ay  , 
yet>  there  is  no  institutional  structure  to  put  these  ntateririls 
into  use.    One  might  assurie  that  the  universities  would  respond 
to  the  need  and  provide  training  for  these  new  specialties.  How*' 
ever>  as  yet  we  have  seen  little  evidence  of  this.    The  universiv 
ties  continue  to  think  of  their  training  programs  largely  in  teriny 
of  only  teacherSj  adniinistrators  >  counselors,  curriculum  special* 
ist^,  and  researchers,    Ue  knov  of  few  academic  prograEiis  chat  ex* 
ist  to  train  personnel  for  future  roles  as  developers,  dissemina- 
tion  specialists,  change  agents  or  iEnplemen^ation  support  person- 
nel,   Taerefore,  we  would  predict  that  the  personnel  base  will 
remain  out  of    synchronization  with  the  institutional  structure 
and  linkages  being  created^  and  the  newiy  created  positions  will 
be  filled  by  personnel  lacking  {at  least  for  a  time)  in  any  speci- 
alieed  expertise  or  skills  to  perform  these  new  roles  on  a  high 
level  of ^^ompetence *    Xhe  consequence  is  likely  to  be  a  continua^ 
*tion  of  the  pattern  of  p0or  quality  functioning  and  poor  quality 
Outputs,  '  '       .  "  ^ 


E,    Knowledge/Technology  Base,  Communication  Mechanisms,  and 
Information  Flows 


There  has  been  some  hotable^progress  ^n  strengthening  the  knowledge 
and  technology  bas^  of  the  field  over  the  p^st  decade  pr  so>  and 
we  are  clear^  in  a  stronger  position  now  tOicarry  out  'R/O&l  activi- 
ties than  we  w$re ■ ten  or'fifceen  years  ago.     Iri  research,  progress 
is  evident  in- the  cumulative  developmeijt  of  knpvXedge  in  certain 
rese^irih  areas  where  existing  knowledge  has  been  synthesized  And 
critiqued  in  various  research  articles>  annual  reviews  and  handbooks 
Though  considerably  more  progress  is  needed^,  evaluation  and  needs 
assessment  methodologies  have  grown  by  giant  leaps  over  the  last 
decade..      The  underlying  knowledge/ technology  bases  for  carrying 
o;jt  development ,  dlssemina  t  ion  >  implemen tat  loo/ utilization  support 
and  change  agent  approaches  are  still  in  their  infnacy,  but  here 
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too  we  seem  to  be  light  years  ahead  of  where  we  were  a  d£;cac!e  ago. 

Some  progress  has  been  nade  in  the  professlonallzation  of  sonie  of 
these  specialties  and  in -development '  o  £  more  effective  co-zmunica- 
tion  mechanisms  and  information  flows.     The  evaluation  specialty 
has  probably  sniwn  the  greatest  progress  here.    A^e.  would  .assure 
that  this  progress  would  continue  >  and  that  the  rate  of  gain  would 
even  piick  up  soTR^-hat  gi\J'ea  tSe  s'tronger  foundation  that  already 
exists.    However,  we^rfOitttl  anticipate  a  much  more  significant  rate 
of  gain  if  more  direct  policies  were  implemented  to:  strengthen 
the  scientific  "and  technological  foundations  of  the  fieldj  identi^ 
fy  the  areas  of  work  that  warrant  priority  attention;  allocate  re- 
sources in  a  way  that  significantly  builds  capacity  and  assures 
cumulative  dev^opment  of  work        these  area^;  and  develop  more 
effective  communication  mechanisms  ancj.  information  flows  within 
and  across  R/D&X  specialties.    We  shall,  have  more  to  say  about 
these  kinds  of  policies  later  in  this  discussion. 

F>    Outputs  '  -  .  , 

Without  more  active  system  leadership,  we  would  expec^t  tc?-see  only 
modest  improvement:  in  the  quality  of  outputs/produced  by  the  system 
over  the  next  couple  of  decades.    We  would  assume  that  LEAs  vlLl 
continue  to  develop  many  of  their  own  programs  and  products,  much 
as  they  have  in  the  past.    T^iough  we  would  crxpect/to  find  some  pro- 
gress in  ■  the  work  on  identifying,  validating,  dJid  packaging  exem^ 
plary  programs,  we  assume  that  only  a  relatively  small  portion  of 
all  the  LEA  producers  and  *all  the  LEA  useri  will  be  touched  by. 
chose  efforts  and  that  r,o^t  LEA-produced  ^developr:ent  work  wi'll  re- 
main "inyisible"  and  inaccessible  to  the  rest  of  the  field. 

At  the  same  time,  we  would  expect  to  find  some  improvement  in  the 
quality  of  the  outputs  produ^ied  by  systematic  R£;D  -  a  consequence 
of  learning  time  and  of  the  evolution  oT  "a  stronger  4;nowledge/ tecn- 
no^gy  base  and  a  stronger  institutional  and  personnel  base  than 
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^i^s  available  a  decade  or  twt^  ago,     Howevt;r,  there  is  likely  to 
be  sorrevha:  less  of  this  large-scale  developr^.ent  work,  in  the 
coining  years  if  the  NIS  deemf^hasis  of  de^lopmenc  projec'xs  is 
continued  and  especially  if  other  educational  R/D<xI  sponsors 
adopt  siniilar  pollcies,^ 


Without  more  concerted  attention  co  dissemination  and  espocially 
implementation/utilisation  issues,  we  would  anticipate  some  but 
only  moderate  iiTiprovenent  in  the  di^^semination  of  these  R^D  cwjc- 
puts  to  school  districts^  and  only  nodest  increases  in  utiliza- 
tion figures.    We  are  beginning  to  see  federal  policynakers  taking 
cognizance  of  the  significance  of  the  imple">entation  and  utiliza- 
tion functions.     If  this  is  followed  by  strong  policy  initiatives, 
more  focused  atten^iof*— this  part  of  the  innovation  process 
night  produce  desired  increases  in  school  systen  capacities  to 
use  innovations,  in  willingness  to  experiment  with  new  outputs^ 
and  ultimatelyj  in  adoption  and  utiliatation  rates.    But  as  y^K> 
we  have  not  seen  any  significant  enough  changed  in  policy  direc- 
tion to  feel  confident  that  this  will  happen, 

c 

G,    System^  Capacity  to  Assess  Its  Own  Functioning  and  Improve  It$ 
Operations  and  Outj>uts 

This  is  probably  the  most  significant  single  area  of  difference 
in  th&  futures  we  would  predict  for  the  system  from  the  "perspec- 
tive of  laissez-faires  postures  vs ,  active  system  leadership. 
As  currently  operating  under  an  essentially  laissez-faire  posture 
toward  system  Issues,  the  educational  R/D£(I  enterprise  in  this 
country  has 'relatively  little  data  on  its  o^/n  operations,  a  minis- 
cule  (and  underutilized)  capacity  to  monitor  and  study  itself,  and 
relatively  little  that  coiild  count  as  a  strong  analytical  capacity 
to '^issess  system  operations,  identify  needed  areas  of  improvement, 
andi formulate  appropriate  policy  initiatives  for  the  consideration 
of  systeri  policymakers.    There  is  almost  no  R6D  or  innoyation  man- 
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ageraent  specialty  in  education,  and  few  if  any  training  prograns  * 
geared  to  neecing  Che  need  for  Rf^D^managers  o^:  policy  analy,^ts* 
Lacking- even  (outside  of  a  relatively  small  circle)  is  acceptance 
of  the  kind  of  system  perspective  that  vould  seem  to  be  required  - 
before  any  of  these  needed  steps  might  be  undertaken. 

Consequently,  in  the  last  two  ^decades  the  educational  R/D6I  field 
has  learned  relatively  little  about  itself  or  how  tlj>  improve  its 
functiortirtg  toward  more  mature  patterns*    The  fielcy  seem^  even  to 
lack  the  kind  of  "institutional  meT:ior>'"  chat  raishy  overcone  the 
tendency  to  repeat  past  mistakes),  or  to  debate  the  same  issues 
over  and  over  again  every  fe;v  years  without  even  an  appreciable  ^ 
gain  in  the  level  on  which  the  debate  is  conducted*    Unless  there 
y   is  some  reversal  of  this  head-in-the-sand  approach  to  system  man- 
age^ient,        see  little  reason  to  expect  more  than  a  rather  modest 
future  gain  in  the  system's  ability  to  assess  its  own  needs  and 
"develop  sound  policies  to  meet  those  needs  aiji  thereby  overcoiae 
some  of  the  inadequacies  of  system  .functioning* 

y 

2*      Educational  r/D6I '^^Fitt'Ore^  Assuming  Active  System  Leadership 

At  several  points  in  the  chapters  which  follow,  we  po^nt  out  the  need 
for  more  active  system  le,adership  to  guide  the  educational  r/D^I  system 
toward  greater  maturity*    Much  of  nhat  we  have  to  say^  focuses  on  poll- 
cies        believe  should  be  pursued  l5y  NIE,  for  we  take  KIE's  role  as  the 
lead  agency  for  educational  R^  as  the  starting  point  of  much  of  the 
policy  thinking  we  have  done*    If  NIE  were  to  take  a  more  active  leader- 
ship stance,  alone  or  with  the  collaboration  of'AERA  or  some  other  body 
such        the  Federal  Council  on  Educational  Research  and  Development, 
what  kinds  of  policies  vould  we  expect  to  see  implemented  and  what  im- 
pact might  they  be  expected  to  have  on  the  future  of  educational  R/D5.I 
in  this  country? 


/ 
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A,     System  Leadership 

If  SIE  Wi*re  to  coiTjnLt  itself  to  active  system  le^tdershLp  and  to 
devote  substantial  resources  and  first-rate  talent  to  its  system- 
oriented  reg^ponsibilities,  we  woujd  ejipect  the  iQstitute's  man- 
ageijient  and  staff  to  become  especially  prominent  in  exerting  in- 
tellectual ^leadersbip  for  the  field  as  a  whol^e,  br-inging  together 
key  people  in  all  segments  of ''the  field  to  collaborate  with  the 
Institute  in  developing  consensu;*  on  goals*  weaknesses,  and  direc- 
tion of  needed  work.    We  would  expect  forceful*  persuasive*  posi-^ 
tions  to  be  taken,  supported  by  plentiful  evidence  produced  by  a  , 
strong  data  base  and  monitoring  system,  espoused  before  all  the 
key  segments  of  the  s^'stem  and  its  environment.    And  in  time  (per- 
^*?feps  five  to  ten  years),  we  would  expect  th'is  to  raise  the  esteem 
in  whiT:h  the  field  is  held  and  promote  tempered,  reasonable,  re-^ 

alistic  optimism  about  what  the  field  might  be  able  to  achieve 

h  '  ^ 

given  sufficient  resources,  time,  planning*  and  skill.    We  would 

expect,  too,  that  this  optimism  would  be  realistically  related  to 
substantive  progress  in  capacity  building,  strengthening  of  know- 
ledge and  technology  bases,  information  flows,  etc* 

Agency-Field  Relationships 

A  ^rong  leadership  stance  of  this  kind  would  seem  to  require 
the  development  of  close,  collaborative  relationships  between 
NTE  and  the  field.    Before  this  could  be  possible,  considerable 
change  would  have  to  occur  iti-  the  climate  of  opinion  in  Congress 
and  in  Washington  policy  circles  as  ^o  the  propriety  of  such, 
close  relAionships  between  agency  staff  and  potential  contractors* 
A  different  perspective  would  seem  to  be  needed  on  "conflict  of 
Interest"  issues  —  one  that  takes  into  account  the  difference 
between  mature  R/D£tl  systems  that  have  numerous  strong  contractors 
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(making  open  competition  a  reasonable  approach  to  procurt^ment) 
and  irx^atur:^  systers  wliich  have  relatively  few  stcpng  centers 
of  excellence  (where,   therefore,  sole  source  procurement         .  ^ 
strategies  or  limited  Competitions  p.ay  be  considerably  more 
T^os t-ef  f ec t ive) .    And,  too,  considerable  change^would  seem  to 
be  needed  in  NTE  staffing,  such  that  agency  personnel , would  be 
oriented  t<^a^  collaborative  field  relationships,  have  the 
skills  and  expertise  to  make  such  relationships  possible,  and 

it 

perhaps,  too,  the  kinds-'of  credentials  that  would  enable  thera 
to  establish  close  working  relationships  with  the  leading 'schol- 
ars or  professionals  in  an  area  and  facilitate  the  deverlopment  " 
of  "ii^lisible  colleges"  and/or  other  coqimunlcat ion  networks  and 
structures  able  to  speed  the  maturation  of  new  research  areas,*  ■ 
etc . 

C-     Non-procurement  Activiti^gs' 

If  NIE  is  to  work-in  close  collaborat ion^ with' the  leadership 
qf  the  field  to  facilitate  information  flows,  speed  the 
accumulation  of  relevant  knowledge  and  technology  bases, 
stimulate  activities  to  increasfe  the  amount  of  knowledge 
synthesis  and  utilizaiTion,  etc.,  we  would  expect  to  see  ^' 
significant  share  o:  NIE's  resources  de^voted  to  leadership 
activities  that  do  not  involve  procurement  —  e»g.,  holding 
conferences;  attending  meetings  of  professio^l  associations 
and  possibly  making  presentations,  holdinf^ymposiO ,  leading 
discussion  groups,  and  meeting  informally  with  people^  f  rom.  the 
fields  meeting  across  the  country  with  various  members  of  key 
groups  in  the  field;  drafting  (or  commissioning  the  drafting 
of)  issues  papers  for  distributions  to  members  of  these  various 
networksatfor  their  reactions  and  comments;  working  with  other 
federal_ agencies  and  non-federal  sponsors  of  educational  r/D^1 
actLVities  as  well,  provide  a  deg^pe  of  coordination  and  orch- 
estration to  the  whoel  e;ducational  R/D^I  enterprise;  etc. 
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D.     ProcureTT^ent  Planning  ^    ^  '  ■ 

If  KIE  were  to  a<^cept  ^n  active  system  loadership  posture 
and  especially  accep^sysjem  capacity  b^^d^ng  responsifei-lifLe 
..^^^^S^would  expect  to  s_ee  rr.uch  greater  investment 'of  resources 
in  pre-procurement  planning  than  is  currently  evident-  For' 

Or 

instance,  we  vould  expect  to  find  NTE  staff  working  closely 
with  leading  figures  in  the. research  community  to  idefitify: 
■   (a)  research  areas  where  the  accumulated  knowledge  and  technol 
ogy  base  is  already  strong  enough  to  provide  a  sound  base  for 
R/D5rl  activity;   (b)''research  areas  that  have.^a  strong  base  of 
knowledge  and  technology  with  significant  potential  applica- 
tior^  but  are  still  in  need  of  certain  kihds  of  work  to  resolve 
unanswered  ques tions  that  remain  as  obstacle?  to  effective 

application  programs;  and  (c)  t)ther  areas  of  basic 
research  that  may  still.be  in  their  infancy  but  should  be 
supported  because  they  s|^em  potentially  important  for  funda- 
mentally affectAig  the  ways  we  think  about  certain  educational 
issues  in  the  future.  .  ' 

Aie  would  expect >  too,  to  see  the  agency  planning  its  procure- 
ments in  ways  that:     (a)  capitalize  on  the  possibilities  of 
achieving  more  than  one  purpose  ^t  a  time  (e*g,,  doing  sub- 
stantive wor         solve  a  problem  while  also  building  needed 
system  capacities  and  possibly,  too>  improving  the  sys"tem*s 
environment);   (b)  take  into  account  the  waysxin  which  tt^ 
various  contracts  awarded  to  an  institution  can  shape  that 
Institution  andhow  the  various  awards  and ■ contracts  made  at 

any  time  by  (ill  the  various  r/D^I  sponsors  impact  and  shape 

* 

^he  system  as  ,a  whole;   (c)  take  ^tftto  account  the  activities  o£ 
II  R/D6I  '^onsors  and  try  to  achieve  a  degree^of  coordination 
and  synergy;  and  (d)  relate  procurements ^  to  the  considerable 
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amount  of  non-rp'rocurefnerit  activity  a(ij^  agpnc^  caq^^dertake 
to  strea^uhen  system  functioning.      '* ,   I  ^  ' 

T  ^      In  ^dltlon^  we  would  expect  to.  see  p^ateur$met)t»  _^lannlng  by 

a  lead  agency  making  use  of  ^budget  plannlnjf*^trategies  that 
take  Into  account  the  need  for  balanced  growth  across  'func- 
^^^.^  ■        tlonal  areas>  maintaining  existing  capacities^  and  expandin^iy 

capacities  in  each  functional  area^at  a  rate  determined  by 
the  state  of  development  of  the  existing  capacities  in  that 
^^area^  the  ratfe  at  which  those  capacities  can  be  expanded  with- 
out I'^ss  of  qjjallty>  and  formulas  that  take  into  account 
existing  and  projected  bifrfget  levels  and  cost  factors  for  e^ich 
kind  of  functional  activity' and  for  degree  of  impact  on  capacity 
In  each  functional  area  per  dollar  invested  In  different  kinds 
of  capacity  building  strategies. 

Such  formulas  do  not  exist  at  this  tlme^  but  we  have  suggested 
^         /        In  our  funding  dhapter  the  l^in<Js  of  analytical  and  empirical 

work  that  might  produce  such  formulas  some  time  In  the  future. 
For  instance>  we  have  suggested  that  agency  budget  planners 
■        should  be  thinking  about  capacity  building  in  terms  o*f  the 
^  following  summary  questions:     (a)  Hoy  long  Is  It  likely- to 'taks^ 

^  and  how  much  is  It  likely  to  cost^  to  expand  the  base  of  quality 

institutions  adn  personnel  in  each  functional  area  to  various 
specified  levels  of  strength?    What  altelrnatlve  strategies  are 
likely  to  have  what  effects>  at  what  costs?     (b)    Given  the 
^  ^     &5(istlng  quality  base  In  each  functional  area  and  in  eachLmaJor 

^  priority  problem  area>  and  estimates  of  the  rate  at  whlcn  the 

quality  base  can  be  expanded  thorwgh  various  alternative 
'        strategiesi  at  what  rate  can  the  funding  level  be  expanded 

productively  in  each  area?     (c:)^^en  variation^  across  functional 
.  areas  tfi  in  fvferent  cost,  requirements^  In  the  amourxt  of  capticlty 
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building  required,  in  the  inherent  cost  and  time  requirements 
o^  cap*ac\ty  building,  and  in  the  rate  at  which  capacity  in^ 
each  ^n  be  expanded  while  still  maintaining  a  high  level  ^of 
quality  given  the  existi^ig  institutional  and  personriel  base 
in  educational  R/D&I),  what  allocation  o£  funding  acrosis 
'functional  areas  would  seem  to  be  suggested  as  needed  for  a 
healthy  R/D&I  system  expanding  at  a  reasonable  rate  toward 
greater  maturity  and  high  levels  of  quality? 

*  * 

V 

Ul tinatefy , *  we  have  suggested  that  a^eqcy  procurement  planning 
should  be  ?ble  to  make  tase  (either  implicitly  or  explicitly  and 
codcretely)  of.  a  multidimensional  grid  type  of  project  selec- 
tion ^rfd  bedget  planning  instrument  that  v^uld  focus  NIE 
attention  on  three  f actors (a)-  substantive  Soci  of  projects 
and  programs  (as  these  relate  to  agency  inissions  and  priority 
problem  areas^;   (b)  system*  capacity  building/tj^acity  mafiifen- 
ance  requirements;  and  (c)  the  existing  pattern  of  fun<l^g  of 
the  above  acrpss  all  the 'sponsors  of  educational  K/D&I  activity 

Balance  across  diverse  requirements  might  be  assessed  in 
terms  o£  how  well  a  r^nge  of  different  needs  were  shown  to  be 
net  by  different  grid  patterns  produced  by  different  alloca- 
Hon  decisions*  ta'ken  or  proposed*     Imbalances  mi^ht  be  readily 
pinpointed  through  such  an  instrument,  as  well  as  allocation 
shifts  needed  to  bring  funding  back  into  greater^balance 
across  areas,  ^  ^ 

E •    Data  Base  and  >Jonitorina  System  Reguirementg 

Before  mechanisms  of  this  kind  could  be  developed,  NIE  (and 
other  educational  R/DStI  sponsors)  would  require  a  strong  data 
bas4  fr<im  an  ongoing  monitoring  system  on  existing  organiza- 
clonal,  personnel,  and  .system  cpapcities.    At  the  very  least, 
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such  a  data  base  would  suggaSc:  what  ^pecif ic  R/DSl  capacities 
e>;ist  ,  where,  at  what  levels  of '  development :  who  can  best 
carry  out  v^^t  j^^s  of  educational' R/D&I  activicyj  what  ' 


mlnimai  func^^g  woiyid  be  required  to  maintain  existing  levels 
of  specific  kinds  of  capacities;  what  areas  o£  capacity  need 
to  be  strengthened  or  expanded;  what  ce^ijfers  6f  excellence 
offer  the  best  potential  for  extensive^capacity  building 
activities;  what  increases  in  fundim  levels  could  be  absorbed 
productively  each  year  for  expansion  of  capacity  in  given  centers 
of  excellence;  etc. 

\i  NIE  were  functioning  in  an  active  system  leadership  stance> 
we  would^xpect  to  find  this  kind  of  data-gathering  and  ana" 
l3'tical  and  planning  unit  tied  closely  to  the  NIE  Director's 
Office>  with  program  development  clearly  impacted  by  the 
analyses  carried  out  by  this  top  l^vel  unit* 

F,    R/D&I  System  Studies 

If  such  an  analytical  unit  was  functioning  in  a  manner  with 
significant  consequences  for  system  policy  and  deciion  making> 
we  would  expect  to  see  its  operations  linked  to  the  develop- 
ment of  a  strong  field  of  R&D  system  studies  and  guided  by- one 
or  tnore  advisory  councils  comprised  o£  the  '^invisible  college" 
leadership  of  that  field*    We  would  expect  to  find  the  top 
leadership*  of  the  field  bringing  to  bear  their  .experience  and 
insight  on  the  meaning  and  p"oi,icy  implications  of  the  data 
gatheredj  and  suggesting  directions  for  new  data  gathering  and 
analytical  work  to  form  a  sound  basis  for'  future  capacity 
building  initiatives.  i 
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We  Would  also  expect  to  see  ^is  collaborative  relationship 
between  tht;  leadership  of  the  field  and  this  agency  analytical 
unit  producing  various  kinds  o£  initiatives 'to  sitrengthen  the 
knowledge  and  technology  base  of  the  field  and  its  various 
special i^st  communities  >  as  suggested  below.. 

G.    Develooment  of  the  Knowledge  and  TechnoloRv  Base  and  thg 
Field  ^  s  SjOecialis t  Communi  ties 

If  XIE\were  to  assume  a  strong>  active  system  leadership 
postu^Je>        would  expect  to  see  a  sizeable  investment  of  ^ 
resources  in  developing  the  knowledge  and  technology  base  of 
the  field.    For  instance,  we -would  exp^^  to  find  N'lE  taking 
irfitiatives  to  stimulate:   (a)  support  for  process  analyses 
to  document  how  work  in  each  specialty  is  carried  out 
what  tasks  and  activities  are  carried  out,  by  whom,  where> 
using  what  knowledge,  skills,  and  ^ens^ivies ,  affected  how, 
by  what  sorts  of  constraints>  etc;  (b)  the  appearand  of 
handl^ookSj  review  journals,  and  other  syntheses  of  th^  existing 
knowledge  and  technology  base  in  each  functional  area,  especl^l- 
in  areas  where  such  work  has  been  minimal  or  non-existent 
(e.g.,  development  >  dissemination^  and  iraplementation/utili- 
zation);  and'^c)  the  establishment  of  professional  ^'communities" 
in  each  functional  specialty  (e.g. > ^dissemination  specialists> 
technical  assistance  specialists*  etc.)>  "invisible  college" 
mechanisms  within  each  community>  specialized  newslecters> 
jOurnalSj  and  other  information  flow  channels  within  and  across 
those  communities;  etc*, 

r 

As  a  consequence,  we  woald  expect  to  see  considerable  progress 
in  each  functional/ arei>  as  outlined  below. 
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H.    Maturing  of  Educacional  R/d&I  Functions 

Given  all  of  what  have^sugges ted  up  to  thi§  point,  we  would 
exprect  over  time  to  see  the  following  sorts  of  initiatives 'for 

strengthening  each  lunctional  area,  all  of  which  are  dis- 

J 

cussed  more  fully  in  the  chapters  that  comprise  the  reminder 
o:  this  volume: 

a .    Fundamental  Research 

-  The  attraction  of  a  large  number  of  first-rate 
fundamental  researchers  from  relevant  disciplines  to 
jci  on-going  commitment  to  researchi  on  education- 
relevant  research  qirestions: 

-  The  attraction  of  a  sizeable  and  stable  core  of 
basic  researchers  within  thfe  derivative  disciplines 
(educational  psychology  educational  sociology^  etc.); 


-  The  development  of  consensus  within  the  field  on 
the  basic  research  areas  with  the  greatest  .potential 
promise,  including  identification  of  those  areas  that 
can  already  support  application  work;  those  with 
promise  of  being  able  to  do  this  some  time  in  the 
future  after  a  number  of  unanswered  questions  are 
resolved;  and  those  areas  In  their  infancy  that  may 
be  of  fundamental^  significance  in  thefuture;  and 

-  The  identification  of  centers  of  excellence  for 
support  through  subistantive  project  funding  and 
capacity  buildir^g  activities* 
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Applied  Research  ^'  i"* 

-  The  expansion  of  the  l^rge  scale  applied  research 
moOe;  ■  . 

-  The  idencit  ication^of  centers  of  ^cellfcnce  for 
conduct  of  applied  work,  for  support  through  project 
funding  and  capacity  building  activities;  and 

4 

-  The  development  of  consensus  on  the  areas  of  applied 
work  crat  can  be  built  on  .a  sound  basis  of  existing 
fundarer.cal  research  and  Available  technologies,  wi:h 
funding  focused  largely  on  these  areas. 

Development 

-  Strengthening  of  the  system^^^c^R^rTrr^ode  through: 
strengthening  two-way  linkages  between  specialized 
developr::ent  organizations  an^  linkers;"  reorienting 
systematic  R&D  toward  developing  products  just  to  the 
point  where  they  can  be  adapted  in  any  number  of  ways 
b^  school  systens  (rather  than  devBloplng  them  through' 
repeated  cycles  until  they  conform  to  prespecified 
perfomancs  outcomes);  and  typing  some  systematic 

K&D  to  practice-based  development  work  in  a  "mixed 
mode^'  of  innovation  origin  in  the  practice  setting 
with  packaging  by  specialized  development  organizations 
ei<ternal  to  the  practice  setting; 

-  ^Strengthening  practice-based  development  work 
through  increased  linkage  among  practice-based 
development  sites  and  between  these  sites  and 
specialized  development  organlzat ion j  expecially 
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for  packaging  practico -based  "idea"  innovaCioae*; 

-  Strengthening  the  mixed  mode  of  development  work 
throiigh  strengthening  the  linkages  among  practice 
settings,  validating  bodies,  and  packaging  capacity 
in  specialized  development  organizations;  and 

-  Strengthening  teh  knowledge  and  t^chno'logy  base 
of  the  field  throS^h  focused  attention  on  process 
analyses  of  dev&loprrtent  work  in  the  different  modes. 

Dissemination 

-  Strengthening  existing  networks  and  capacities  and 
creating  needed  linkages  where  they  do  aot  currently 
exist ; 

-  Strengthening  the  resource  base  for  dissen^ination 
through  increased  rtetvorking  and  linkage  of  exisi^ing^ 
resource  basesj 

-  Establishing  alternative  channels  and  facilitating 
the  developujent  of  alternative  dissemination  strategies 
to  per:nit  redundancy  in  the  systeth  and  establish  a 
"fail  safe"  quality; 

-  Increasing  coordination  among  networks  and  channels 
to  increase  the  efficiency  of  dissemination  opera- 
tions "^^ithout  necessarily  eliminating  a  useful  level 
of  system  "fail  safe''  redundancy;  and 
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-  Strengthening  the  knowledge  and  technology  base 
01  the  field  through  procos^i  analyses  docuryenc ing 
different  dissemination  strategists. 

Inaplemenatlon  and  Utilization 

-  Creating  additional  implerrr^ntation/utilization 
capafcity  both  within  operating  systems  and  in 
specialized  linkage  organizations  associated  with 
groupsirigs  of  school  districts; 

/ 

^Establishing  nore  effective  linkages  among 
operating  syscens,  disseniina  tion  specialists  and 
resources,  and  KP  organizations;  and 

1 

-  Strengthening  the  knowledge  and  technology  base 
of  JLmplenentation  and  utilization  through  process 
analyses  and  more  practice-oriented  and  practice- 
based  research . 

Evaluation  ap.d  Policy  Research 

-  Increasing  the  impact  of  evaluation  research  and 
policy  studies  by  providing  information  in  forms  that 
are  most  useful  to  decision  makers  and  placing  eval- 
uation and  policy  researchers  in  units  strategically 
linked  to  decision  makers;  and 

-  Strengthening  the  methodological  base  of  the  field 
through  focused  attention  to  methodological  issues 
and  developing  some  consensus  on  existing*areas  of 
disagreement. 


/ 
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I .    sTh&  Future  of  the  Svstem^s  Institutional  Base 

If  tTtE  were  to  assutne  a  strong  leadership  stance,  we  vould 
expect  to  see  a  considera)>^^  strengthening  of  the  institu- 
tional'base  of  the  £ield>  most  nota,bly  through  uiore  selec- 
tive procurement  strategies.    We  would  expect,  for  instance, 
that  the  system's  ongoing  moaftoring  system? vould  provide 
system  decision  makers  vittyinfortnation  about  which  organi- 
zations have  the  strongest  capacities  for  each  kind  of  R/D&I 
activity;  that  this  information  would  be  used  as  a  basis-  for 
procurement  decisions:  that  this  infonnation  would  also'be 
used  as  a  basis  for  future  capacity-building,  vith  an  exten- 
sive amount  of  active  agency  seeking-out  and  jwpoing  of  poten- 
tial contractors  with  strong  capacities  through  sole  source 
procurements;  and  that  the  system's  data  base  would  be  pro- 
vising  information  about  such  issues  as  cost-effectiveness  of 
various  institutional  types  for  specific  kinds  of  R/D&I  work.. 

We  would  expect,  too,  to  see  a  considerable  investment  of 
resources  in  strengthening  the  linkages  among  institutions  and 
subsystems,  so  that  system 'functioning  and  information  flows 
would  be  morepproductive  both  within  and  ^mong  the  thres  sub- 
systems we  id^tified  (i.ei.  ,  academic  institutions,  other 
private  and  quasi-public  sector  institutions,  and  operating 
system  institutions)  .  ■  ^  '  - 

As  for  specific  institutional  types,  we  might  anticipate 
the  following  kinds  of  progress: 
I 

^1.    Academic  Institutions 

-  Gre^ater  linkage  among  education  schopls  (departments, 
or  colleges)  with  university  departments  and  research 
centers; 
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-  Gi^eacer  linkage  between  research  (and  r/D£<1) 
activity  and  training  for  r/d&I  specialties  through 
apprenClceshlp  programSj  research  assistantships, 
etc  I ;  ^nd 

-  More  active  academic  roles  in  practice-oriented 

research  and  process  analyses  of  r/d&I  activities  in 

different  functional  areas  and  in  different 

institutional  settings,  ^ 
*- 

Private  Sector  and  Quasi-^Public  Sector  Institutions 

-  More  active  roles  for  publishing,  media  houses^  and 
other  organizations  in  the  commercial  sector,  especial- 
ly, in  the  packaging  o£  practice-based  development  work; 

-  More  active  roles  for  regional  la'boratoreis  in 
dissemi«ation  and  linkage  activities^ 

-  Continued  expansion  of  the  strong  non-profit  and 
for-profit  research  corporations  that  function  at 
high  levels  of  competence^  with  some  weeding  out  of 
the  firms  that  have' been  producing  mediocre  work;  and 

-  Strengthening  of  strong  R&D  centers  identified  as 
centers  of  excellence  for  applied  research  work- 

Operating  System  Institutions 

-  Expansion  of  R/d&I  capacities  in  SEAs,  LEAs»  and 
especially  ISAs; 
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-  Increased^  linkage  to  systematic  R^D  and  packaging 
ciipacity  to  permit  tht?  packaging  and  disserrtinat  ion  of 
locally  developed  innovations  for  use  elsewhere; 

"  Increased  attention  to  self-renewal  an^  local 
problem-solving  strategies  and  capacities; 

-  Increased  linkage  to  available  KP  resources  and 
linkp^e  agents;  and 

"  More  active  SEA  roles  in  assuming  educational 

leadership  roles  vis-a-vis  the  school  districts 

} 

under  their  jurisdiction. 
J .    Personnel  Base 


If  these  various  Initiatives  to  strengthen  and  expand  the 
field's  institutional  base  were  to  be  effective,  ^considerable 
attention  would  hve  to  be  directed  at  development  of  the  field's 
personnel  base.    This  would  require  policies  oriented  ^oward^ 

-  projecting  personnel  requirements  for  planned 
^  initiatives; 

-  inventing  substantial  resources  in  process  analyses, 
surveysj  and  other  strategies  for  determining  personnel 
competencies  required  fpr  effective  functioning  in  ^9^^ 

,     needed  R/DStI  activity;  ' 
*  * 
"  developing  various  pre-service  and  in-service 
training  programs  to  provide  personnel  with  these 
needed  capacities; 
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-  providing  incentives  for  acaderriic  ini^titutions, 
professional  associations,  training  organizations, 
consortia  of  R/D^d  performers  and/or'operating 
systems,  etc.  to  recruit  the  needed  numbers  of 
personnel  and  provide  the  required  training  programs; 

-  providing  the  necessary  career  Incentives  and 
professional  supports  to  attract  and  maintain  the 
expanding  personnel  base;  and 

-  monitoring  these  operations  sufficiently  to 
insure  the  expansion  of  the  institutijonal  and 
personnel  bases  of  the  field  are  well  synchronized 
and  in  balance. 

K,  Outputs 

r 

Over  the  long  run,  as  a  result  of  all  these  initiatives 
(including  the  improved  system  linkages  between  KP  and  KU 
institutions  and  processes),  we  would  expect  to  find  an  improve 
ment  In  the  quality  of  research  and  MT>  outputs,  and  probably 
an  increase  in  the  quantity  of  usable  and  used  outputs.  And 
with  a  well  developed  monitoring  system  able  to  measure  and 
assess  the  production  and  utilization  of  outputs,  we  would 
expect  information  about  quality  and  utilization  to  be  avail- 
able and  visible,  for  use  in  policy  development  and  in  direct 
and  indirect  strategics  for  improving  the, system's  environment. 

The  System's  Environment 

As  a  consequence  of  all  these'  initiatives,  we  would  expect  to 
see  the  educational  R/D£(I  system's  environment  substantially 
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improved*     Mot  only  would  y<i  expec t  ^ongrt^ss  and  the  general 
public  to  have  nor^  positive  , views  about  educational  ?JT)^1 
and  the  venefits  accruing  from  its  support>  but  £llso  we  would 
expect  to  see  educational  R/d^iI  received  more  enthusiastically 
by 'the  practice  comunity  and  regarded  more"  positively  by  the 
nation's  scientific  establishment>  both*researchers  working^  - 
in  areas  potentially*  relevant  to  education  and  the  scientific 
coTTiniunity  more  broadly.    Once  educational  R/D&I  thereby  over- 
cones  its  low  prestige*  it  is^likely  to  have  less  difficulty  in 
attracting  first-jrate  talent  and  other  resources  needed  to 
further  enhance  system  functioning  and  ultimately  facilitate 
educational  improvement.  ' 

3-     Conclusions  ' 

This  visionary  exercise  has  taken  us  off>  no  doubt>  into  wild 
flights'of  fancy>  and. we  clearly  recognize  this  as  su^*    The  sorts 
of  policy  i^tiatives  we  are  proposing  are  extrei^ly  complex  and 
difficult,  and  the  obstacles  to  their  ever  seeing  the  light  of  day 
are  considerable>  iavolving  much  more  than  simple  the  leadership 
stance  of  NIE* 

Still,  we  think  this  may  have  been  useful  —  both  to  anticipate  for 
the  reader  some  of  the  policy  options  we  consider  in  the  remainder 
of^his  volume  and  to  suggest  to  the  reader  the  importance  of  bearing 
in  mind  throughout  the  remainder-  of  the  volume  such  questions*  as; 
the  proper  stance  to  be  taken  by  KIE  (or  other  potential  centers  of 
system  leadership),  and,  how  much  intervention  may  or  may  not  be  ^ 
possibie>  with  what  likely  or  unlikely  effects  on  the  maturation  of 
educational  k/d^I  functioning. 

We  turn  now  in  the  renaming  chapters  to  consideration  of  each  of 
the  key  r/DJ^I  features  suggested  by  our  analytical  scheme,   their  P. 
current  state  of  development,  and  possible  future  needs  in  the  field 
of  education* 
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Several  kinds  of  organizations  have  come  to  be  referred  to  as 
^^centers"  in  the  "labs  and  centers"  usage,  but  various  docu- 
ments differ  as  to  whether  or  not  all  of  these  types  of  centers 
are  included  in  the  enumeratiti^  how  niari^  "centers"  there  are 
or  have  been  at  any  one  point  in  time.     In  addition  to  the 
original  centers  created  between  1964  and  1966,  the  number  of 
organizations  now  generally  included  under  the  "center"  rubric 
includes  two  vocational  education  research  centers,  two  edu- 
cational policy  re^arch  centers,  the  network  of  centers  referred 
to  as  the  National  T-aboratory  on  Early  Childhood  Ed^ucation,  and 
a  center  for  the  development  and  management  information  systems 
for  riigher  isducation.    The  picture  is  further  cornplicated  by  the 
fact  that  one  o£  rhe  original  R^D  centers,  the  Center  for  Urban 
Education,  because  a  regional  educational  l^oratory  when  the 
laboratory  program  began.    For  the  best  summary  description  of 
this,  see  N'IE:,-  1976  Databook,  op.clt. ,  pp.  39-^*3- 
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15,.   For  a  good " suinnary  of  che  Icgisiacion,  see  f^IE>  1976  Databook, 
Qp, cit  *  ,  pp-  16-20,  \ 

16.  See  che  full  volu^.e  of  the  J^rnal  of  Research  ^ind  DevelQpmeni 
in  Education,  Vol.   L>  Ko.  4>  Surruner  1968,  USOE-Funded  Research 
and  Dav^ilopman^  Centers:     An  Assessment>  esp^^cially  the  cirticles 
by  Chase  ("Educational  R^D:    Pronise  or  Mirage,"  op, cit . ) , 
Boyan  and  Mason  ("Perspectives  on  Educational  R&D  Centers*" 
op,cit , ) ,    and  Bloom, 

17,  Chase*  "Educational  K^D:    Ppomise  or  Hirage^"  op, cit, ;  Bloom 
in  Journal  ^of  Research  and  DevelopraenL  in  Education>  Vol .  1 , 
No.  A,  Summer  19^)8,  op, c iL  ^ ;  Boyan  and  Mason,  "Perspectives  on 
Ed^icacional  R£,D  CenCers,"  op,ciL. ;    OE,  Educational  Research 
and  Develop:nenL 'in  che  United  States,  op,  cit ,  ,    .pp. 75-77  ; 
:sIE>  1976  Dacabook,  op, cit , ,    pp.  40-^3- 

13.     Bailey,  "The  Energence  of  the  Laboracory  Program,"  op ,cic .  ; 

Chase,  The  National  Progran  of  Edvicational  Laboratories,  op,  clc,  ; 
OE,  Educacional  Research  and  Development  in  che  Uniced  States, 
op,cic,,  pp,  39-Al;  and  Dershimer,  The  Federal  Government  and 
-Educacional  R$D,  op, cit. 

19,  For ^  some  discussions  of  this  and  che  racio^ale  for  che  shift, 
see:    Francis  S,  Chase,  "The  R&D    Institutional  Base:    What  *More 
is  Keeded?"  Journal  of  Research  and  Development  Education, 
Vol.  2,  No,  ^,  Sunnner  1969;  Bailey,  "The  Emergence  of  che 
Laboracory  Program>'^  op.  cit .  ;      Chase,  "The  Laboratories:  1970 
and  Beyond,*'  op, cit,  \  Schmidciein,  '*Tne  Pro_gram$  of  the 
FiEceen  Regional  Educational  Laboratories/'  op,cic, ;  NIE>  1976 
Dacabook,    op.cic, ,  p,  39;  and  Dershimer,  The  Federal  Govern-  ; 
menc  and  Educational  R^lf^  op, cit , 

20,  For  instance,  this  is  suggesced  in  Chase,  The  Nacional  Program 
of  Educational  Laboratories,  op. cic, ;  Francis  S.  Chase,  "R&D 

^  in  the  Rehodeling  of  Education,"  Phi  Delta  Kappan,    February  L970, 
Reprinted  in* The  Oregon  Studies,  Vol.  Il>  op. cic. ;  and  Fraftcis 
S.  Chase,  "Educacional  Research  and  Development  in  che  Sixcies; 
The  Mi:<ed  Reporc  Card, ""in  The  Oregon  Scudles^Vol.  11,  op. cic,  ; 
Janes  W,  Becker,  "Incorporacing  the  Products  of  Educational 
Development  into  Practice,"  Journal  of  Research  and  Development 
in  Education,  Vol,  3,  No,   2,  Winter  1970  (This  piece  was  also 
reprinted  in  Th"^  Ore^^or.  Studies  ^  Vol, II,  op,  clc.     and  in 
Hemphill  and  Rosenan,  Educacional  DevelopmgnCi    A  N'ew  Discipline 
for  Self-Renewal,  op.  cic) 

21,  For  instance,  see:     Egon  G,  Cuba,  "The  Place  of  Educational 
Research  in  Educational  Change>**  in  The  Oregon  Studies, 
Vol,  It^,  Qp ,  c  It . 
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22.  Ibid.  •  ,  . 

23,  Conversatiop.  wicn  ^Vard  S.  >£ason,  April  1974. 

2A*    For  instance  J  see:    Cnase^  The  National  Program  of  Educational  Labora- 
tories, op.  cit.;  Chase  J  "R£tD  in  the  Remodeling^  f  Education,"  op.  cit. 
Becker^  "Incorporating  the  Products  of  Educational  Developnent  inco 
Practice/'  qd.  cizl 


25.  Ibid 
26 


27 


Chase^  **R^D  in  the  Remodeling  of  Education/'  op-  clt.;  Chase,  The  Na- 
tional   Pro^rap  of  Educational  LaboraCoTlesv^  op.  cit. 

On  the  ^'regional  blanketing"  concept^  and  che  current  debate  about  the 
need  to  possibly  restore  such  a  "regional  blanketing/'  see  Dutwaixi 
Hoflecj  Michael  Radnor  >  and  Harriet  Spivak  ,*  Re^ionalisn  iri  Educatlo?.al 
K/Piil:    A  Policy  Analysis  for  the  National  Institute  of  EducatJ-ori 
(Evanston:     Center  for  the  Interdisciplinary  Study  of  Science  and  Tech- 
nology^  Northwestern  University,  1977). 

23.    Whether  the  precise  number  of  labs  and  centers  is  17  or  some  other  nu=i- 
ber  depends  on  which  types  of  centers  one  does  or  does  not  include  un- 
der the  "labs  and  centers"  rubric.     See  our  discussion  above  in  foot- 
note '/14.  'officially  NIE  counts  17  organizations  as  "labs  and  centers/' 

29.  For  instance,  see  "Clearinghouse  Merger  FoH'"&ws  Rands  Report  on  ERIC 
Network/*  Educational  Researcher^  Vol.  1^  No.        April  1972  ;  and  Carolyn 
R.  Davi5j  "CICE:    A  Question  of  Cost?"    Educational  Researcher^  Vol,  3^ 
No,  4,  April  1974. 

> 

30.  See  our  subsequent  chapter  on  che  institutional  configuration  of  the 
educational  R/D&I  system. 

31.  For  instance,  see  our  chapters  on  the  dissemination  function  and  on  in- 
formation flows  in  the  educational  R/D&I  and^ operating  systems. 

32.  This  argument  is  made  particularly  veil  in  Egon  G*  Cuba  ^nd  David  L. 
Clark  I  The  Cor.f  igurational  Persoectiye:    A  Challenge  to  the  Systen^s 
View  of  Educ4,tional  Knowledge  Production  and  Utilization  (Bloocjington: 
School  of  Education^  University  of  lndiana>  1974).    See  also  Egon  G. 
Guba  and    Dayid  L.  Clark,  "The  Configurational  Perspective:    A  S'ew 
View  of  Educational  .Knowledge  Production  and  Utilization/'  Educational 
Researcher  >  Vol.  4,  .N"o .  4^  April  19  75. 

33.  John  BrademaSj  "A  Congressional  Vie6  of  Educational  R^D  and  N'lE," 
Educational  Researcher,  Vol.  Jy^^.  3^  ^brch  l?74;,  Claiborn  Pell, 

.    "Building  Partnerships  of  Educational  Research  and  Deyelopment /'  Educa- 
tiona.l  Researcher^  Vol,  4^  No.        January  1975;  David  tCrathwohl,  "Im- 
proving Educational  Research  and  Developnent/'  Educa t lonai  Researcher  > 
Vol.  6,  ^10,        April  19  7  7;     and  David  L,  Clark,  "Federal  Policy  in  Edu- 
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cational  Research  and  Develop:nent ^ "  Educational  Researcher^  Vol.  5> 
No.   1,  January  1976. 


34.  Ibid, 


35-     For  inscance^  ste  data  on  chis  in  N'lE,   Buildinj;^  Capacity  for  Renewal 
a::d  Re£onn>  op.  cit. 

36.  ^  See  our  Outputs  chapter. 

37.  Bailey^  *^The  Emergence  of  the  Laboracory  Program/*  op.  cit. 

38.  Dershimer,  The  Federal  Governuient  and  Educational  R&D>  op,  cit.  "/ 

39.  For  niore  on  this  argument^  see  Hendrik  D.  Gideonse^  "Research  and  De- 
velopment in  JEducatlon:     A  Market  Model,"  in  The  Ort^eon  Studies  in 
Educational  Research,  Developnent ,  Pi f  f usio:^ ,  and  Evaluation.  Vol  ■  III: 
Conceptual  Frameworks  for  Viewing  Educational  RLD&£>  K,  Del  Schalock 

and  G.  Roger  Sell  ^  eds.  (Mon:nouth>  Oregon;  Teaching  Reseasch  Division^'^^^ 
Oregon  State  System  of  Higher  Education^  1972). 

40.  Ibldj. ;  also  see  NIE^  Building  Capacity  for  Renewal  and  Reform^  op.  cit. 

41.  OEj  Educational  Research  and  Development  in  the  United  States^  op.  cit.; 
Dershimer^  The  Federal  Government  and  Educational  R&D>  op,  cit, 

42.  For  instance,  see  Dershiraer^  The  Federal  GovernEnent  and  Educational 
R&O,  op.  cit. 

43.  For  some  discussion  of  this,  see  Daniel       Hoynihan,  Maxiaum  Feasible 
Misunderstanding^    Community  Action  in  the  War  on  Poverty  (New  York: 
The  Free  Press,  1969 

44.  i.See  espcially^  tflE^  Building  Capacity  for  Renewal  and  F[efonn>  op.cit .  ; 

NIEj  A  concept  Paper  for  the  School  -practice  and  Service  Division^ 
op,  cit,;  Glennan^  *'NIE:    A  Personal  View,"  op.  cit.;  NIE,  Dissemina- 
tion and  Resources  Group  PrograEn  Plan,  FY  1978.  op.  cit,;  NIE^  FY  1976 
^     Proaram  Budget,  op,  cit,;  NIE,  Preliminary  Program  Plans ,  KY  1978, 
Executive  Summary^  pp.  cit;  NIE,  School  Capacity  for  Problem*  Solving 
Group,  Progran  Plan,  May  1975  B^^hington:     NIE^  1975);  and  NIE^  Office 
of  Dissemination  and  Resources  ^  R£[D  System  Support  Program  (Washington; 
>:iE,  April  12,  197/0^ 

45.  For  instance,  see  Gallagher,  "A  National  Institute  of  Education:  Proi:>- 
ise  and  Problems,"  op .  cit .  ;  and  Dershimer,  The  Federal  Government  and 
Educational  R&D,  op.  cit. 

^6  .     For  instance,  see  Krathwohl,  **Some  Questions  and  Answers*  Concerning 

the  National  Institute  of  Education/'  o;j>,  cit .  ;  Gallagher,  "A  National 
Institute  of  Education;    Promise  aa#  Problems o^  cit,;  and  Gagne, 
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See  especially  the^eported  interview  with  Daniel  P-^  Moynihan  in 
*  Ja:?.es  v;elsh>  *'D/C.  Perspectives,'*  Educational  Researche^T,  Vol.  2l> 
.SeDt^rnber  1970, 

i 

48,  Uelchj  *'Fimds  for  Research:    A  Complex  o£  Issues/*  op-  cit. 

49,  James  S.  Colecian  was  the  -only  eminent  researcher  among  the  15  appointees 
to  the  Council,  and  his  appointment  was  for  only  one  year, 

50,  This  seems  strongly  suggested        Richard  E.  Schutz,  **The  Politicaliza-- 
tion  of  American  R^D  in  Education:    A  Program  Report/'  Educational  Re-  , 
searcher,  Vol,  2,  No.   12,  December  1973;  and  Brademas,  ^*A  Congression- 
al ViefW  of  Educational  RSD  and  NIE/''  op.  cit. 

51'.  Welch,  "Funds  for  Research:    A  Complex  of  Issues/'  op.  cit, 

52.  Bradenas,  *'A  Congressional  View  of  Educational  R&D  and  NIE/'  op.  cit. 

53,  Stivers,  "^NIE:     Learning  About  Congress  the  Hard  Way/'  op.  cit. 

5^.  Stivers,  *'NIE;     Anotjier  Approp'riations  Crisis,*'  op.  cit. 

55-     Dershimer,  The  Federal  Government  and  Educational  R&D,  op .  cit . ;  Stivers 
"NIE:     Learning  About  Congress  the  Hard  Way,**  op.  cit.;  Gallagher,  "A 
tJational  Institute  of  Education:     Promise  and  Problems,"  op.  cit.^  and 
Krathwohl,  "Some  Questions  and  Answers  Concerning  the  National  Institute 
of  Education/'  op.  cit. 

56,  See  especially.  Stivers,  **;;1E:    Learning  About  Congress  the  Hard  way," 
op.  cit.;  Brademas,  "A  Congressional  View  of  Educational  R^D  and  NIE," 
op.  cit.;  and  David  L.  Clark,  "Federal  Policy  in.  Educational  Research 
and  Development,"  Educational  Researcher^  Vol.  5,  No.  I,  January  1976. 

57.  Stivers,  *'?JIE;     Learning  About  Congress  the  Hard  Way/*  op.  cit, 

53.     Schutz,  "The  Politicalization  of  American  R&D  in  Education/'  op.  cit, 

59.  For  the  most  recent  report  on  the  activities  carried  out  by  the  AERA 
Governmental  and  Professional  Liaison  Progran,  see  David  H.  Florio, 
"Educational  Research  and  the  95th  Congress:    AERA  Governmental  and 
Professional  Liaison  Report/'    Educational  Researcher^  Vol.   7,  No.  11, 
December  1978,  ^  ^ 

60.  For  one  signiflca:it  example  of  this  and  the  dire  consequences  it  had 
for  N'lE's  appropriat fSjjs  stuggle  with  Congress,  see  Stivers,  "NIE: 
Learning  About  Congress^  the  Hard  Way/'  op,  cit.  , 

6K     For  instance,  see  the  following  NIE  docu:;:ients ,  Building  Capacity  for 
Renewal  and  Reform,  op.  cit. ;  A  Concept  Paper  for  the  School  Practice 
and  Service  Division,  op.  cit;   FY  1976  PrOj^ram  Budfie  t  /  op^  .  ci  t .  ;  Fiscal 
Year  1977:  ^pVo^ram  Plans ,  Execytive  SummarVt  op.  cit. ;  Dissemination 
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and  Resoui:CBS.X^<J^  Proarcm  Plan^  FY  1978t  op.  cit.  ;  Pro^ran  for 
>fonLt:oring 'the  Education  KPl'  System:    Current  and  Planned  Activicies^  - 
op>  ciu,;  and  RFPs  for  contracts  to  establish  what  was  originally  caM- 
ed  the  "Dissemination  and  Feedforward  System:   (later  renamed  the  "RiD 
Exchange  Program") ^  to  evaluate  the  State  Capacity  Building  Program 
in  Dissemination  J  to  conduct  studies  in  the  utilization  of  R^D  in  edu-^ 
cation^  and  to  conduct  a  survey  of  insitutions  which  carry  out  educa- 
tional R/DSI  activities. 

62.     For  instance>  see  Glennan ^  "NI£:    A  Personal  View/*  op,  cit. 

63<     In  FY  19  75^  research  and  problcta-solving  (materials  development>  poli- 
cy formulation  demonstrations  >  and  evaluation  research  accounted  for 
approxirnately  91%  of  NIE  obligations.     Research  and  materials  develop- 
ment alone  accounted  for  approximately  40%  or  SIE  obligations.  See 
Appendix  3  cable  in  Ward  S,  Mason,  Carnot  E.  Nelson^  and  William 
Sowers  J  Federal  Funding,  for  Education  Kno'^led^e  Production  and  Utiliz-/ 
ation:     rCPU  Function^  By  Agsncy  (Washington:     N'ational  Institute  of 
Education^  Dissemination  and  Reosurces  Group,>  R^D  System  Support  Divi- 
sion>  19  77). 

64<     On  the  federal  educational  R^D  tjudget  and  Its  distribution  across  a- 

gencies  and  functions>  see  our  chapter  on  funding  of  educational  R/hLl. 
AlsOj  for  the  increasing  federal  emphasis  on  the  dissemination  and 
utilisation  functions  in  education>  see  our  chapcer  on  dissemination. 

65.  ,  N^IE>  n  1976  Propir^m  Budget,  op,  cit, 

66<    National  Institute  of  Education^  Preliminary  Program  Plans>  FY  1978. 
Executive  Summary  (Washington;    NIE>  ^uly  1976). 

67,  Ibid. 

68,  Center  for  New  Schools  and  Center  of  Educational  Policy  and  Management > 
DTA  Project  Overview  1977  (.Chicago;     Center  for  New  Schools  >  1977)>  p,  4. 

69,  Ibid, >  p<  6- 

70,  One  of  the  aiAhors  of  this  analysis  participated  in  the  December  1977  - 
NIE  review  panel  which  recommended  a  substantial  reduction  in  funding 
for  the  program  and  a  phase-out  of  most  of  its  planned  activities, 

71<    For  more  abotit  "research^on^research see  our  subsequent  chapter  in 
this  vol]^e>  "Research  on  the  Educational  R/Dc^I  System." 

72.  ^  SlEj  FY  1976  Program  Budget^  op.  cit. 

73.  NIEj  Building  Capacity  for  Renewal  and  Reform,  op>  cit, 

71 ,  SIEj  A  Concept  Paper  for  the  School  Practice  and  Service  Dlvii^lon> 
op>  cit. 
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75.  NIE,  Preliminary  Program  Plans .  FY  78,  Executive  Suriunary,  op,  cit:, 

76.  For  instance,  see  NIE,  School  Capacicy  for  Problem  Solving  Group,  Pro- 
gram Piaii,  May  1975,  op^  cic, 

77.  Ibid. 

78.  Glennan,  "NIE:    A  Personal  View,"  op.  cit. 

79*     Ibid. ;  and  Levien Preliminary  Plan  for  the  Proposed  Inscltutie,  op,  cit:, 

§0.  NIE,  Preliminary  Program  Plans  ^  FY  1978,  'Executive  Summary,  op,  cic,  , 
pp,  1-2,  4-5, 

81,  'NIE,  R&D  System  Support  Program,  op,  cit, 

82,  Dershimer,  The  Federal  Governiaent  and  Educational  R^P^  op,  cit, 

83',    Gallagher,  *'A  National  Institute  of  Education;    Promise  and  Problems, " 

^p,  cit,;  Welsh,  *'D,  C,  Perspectives,"  Educational  Researcher  (Mewsletter)  , 
September  1970j  op,  cit, 

84,    Patricia  StiverSj  '^Researchers  at  NIE;    From  Planning  into  Action,*' 
Educational  Researcher,  Vol,  3,  No,  5^  May  1974, 

85-    Michael  Radnor,  Draft  materials  on  Historical  Development  as  a  compara-- 

tive  feature  across  R/D£tl  Systems^  (Evanston :    Center  for  the  Interdisci-  ^ 
plinary  Study  of  Science  and  Technology,  Northwestern  University,  April 
1975), 

86,  '    Michael  Radnor,  Durward  Hofler,  and  Harriet  Spivak,    Draft  materials 

prepared  for  NCER  1977  Report  to  Congress  (Evanston;    Center  for  the 
Interdisciplinary  Study  of  Science  and  Technology,  Northwestern  Univer- 
sity, December  14,  1976), 

87,  See  our  subsequent  chapter  on  the  development  func?lon  in  educational 

r/dsi, 

m 

88,  Foe  discussions  of  this  linked  R£tD  notion;  see:    OE,  Educational  Re- 
search and  Development  in  the  United  States,  op,  cit,,  p,  6;  Chase, 
The  National  Program  of  Educational  Laboratories,  op,  cit, ;  and  Boyan 
and  Masonj  '^Perspectives  on  Educational  R£tD  Centers,*'  op,  cit, 

89,  For  an  analysis  of  some  of  the  assumptions  underlying  this  attackj  see 
Harriet  Spivak,  School  Decentralization  and  Community  Control:  Policy 
in  Search  of  a  Research  Agenda  (New  York:  Center  for  Urban  EducatioHj 
1974),  * 

9Q,  See  our  subscq'jent  chapters  on  the  developinent  and  dissemination  func- 
tions in  educational  r/D6I, 
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91.  Lee  .J,,  Cronbach  and  Patrick  Suppes>  ed..  Research  for  Tomorrow's 

t  Schools:    A  Disciplined  Inquiry  for  Education  (New  York:  Macmillanj 

'  1569). 

92.  David  L.  Clark  and  John       Hopkins;  A  Report  on  Educational  Research^ 
Development^  and  Diffusion  Manpower,  1964-1974  (Bloomington:  Indiana 
University  Research  Foundation>  1969);  Sieber  and  La2arsfeld,  The 
Organization  of  Educacional  Research  in  the  United  States>  op ,  cit, , 
Robert  Bargar,  Egon  Cuba  and  Corahann  Okorodudu  Development  of  a 
National  Register  of  Education    Researchers  (Columbus:    Ohio  State 
Universlcy  Research  Foundation,  1965);    Guy  T*  Buswell,  T.  R.  McConnell, 
Ann       Heiss,  and  Dorothy  M.  Knoal,  Training  for  Educational  Research 
(Berkeley:     Center  for  the  Study  of  Higher  Education>  University  of 
California,  1966);  Danel  E-  Griffiths,  Research  in  Educational  Adminis- 
tration:   An  Appraisal  and  a  Plan  (New  York;    Bureau  of  Publications 
Teachers  College,  Columbia  University,  1959);  Nicholas  A,  Fattu,  **The 
Role  of  Research  in  Education  -  Present  and  Future,^*  Review  of  Educa^ 
tional  Research  >  Vol.  30>  Ko.  5>  December  1960;  Cuba,  *'The  Place  of 
Educational  ResearQh  in  Educ^itioaal  Changes/'  op.  cit-;  OE^  Educational 
Research  and  Development  in  the  United  States^  op,  cit. 

93.  aERA  membership  alonegrew  in  little  more  than  a  decade  from  around  3,000 
to  13,000  members, 

94.  The  most  important  of  these  structural  changes  are  the  establishment  of 
large-scale  research  centers  or  R^D  organizations,  both  on  and  off  uni- 
versity campuses,  employing  large  teams  of  full-time  research  or  R&D 
personnel.     Included  here  are  the  regional  laboratories  and  R6D  centers^ 
also  multi^disciplinary  research  centers  as  a  more  established  organiza- 
tional form>  and  large  thriving  private  sector  non-profit  research  or- 
ganizations, and  large  numbers  of  smaller  for-profit  research  organiza- 

'  tions  that  survive  largely  on  gov^^ment  contracts, 

95.  For  instance>  see  Marshall  Arlin>  "One-study  Publishing  Typifies  Educa- 
tional Inquiry,^*  Educational  Researcher^  Vol,  6>  No.  9>  October  1977. 


96.  For  a  broad  discussion  of  some  of  these  points  see  Ronald  Corwin,  Beyond 
Bureaucracy  in  Educational  Research  Management:,    Paper  presented  at  the  ^ 
Mid-Year .Meeting  of  the  Special  Interest  Group  on  Research  Management, 
American  Educational  Research  Association>  November  1^73.    Reprinted  in 
Tne  Generator  (Newsletter,  AERA  ^Division  G)  ,  Vol,  5^  No,  2,  Winter  1975, 

97.  The  evaluation  research  function  has  expanded  so  rapidly  that  it  became 
a  separate  AER/\  division  a  few  years  agONand  now,  with  around' 4,000  mem- 
bers is  one  o£  AERA*s  largest  divisions, 

9-8.     For  instance,  see  N'lE,  Building  Capacity  for  Renewal  and  Reform,  op,  cit, 
and  Ilene  N-  Bernstein  and  Howard  E.  Freeman^  Academic  and  Entrepreneur- 
ial Research;    The  Consequences  of  Diversity  in  Federal  Evaluation  Studies 
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99.     For' a  broad  sampling  of  reprinted  articles,  see  especially  the  ^ 
evaluation  secclon  in  The  Oregon tiidies ,  Vol.  II,  op.  cit.  and  Carol  * 
^    H.  Weiss  J  Evaluating  AcLion  P^rograms:     Readings  in  Social  Action  and 
Educat ion  (Boscon;    Allyn  and'^Bacohj  1972).    See  especially  our  chap- 
ter on  Evaluacion  Research  and  che  sources  cited  in  that  chapcer. 

100.  For  instance,  see  Clennanls  stacement  about  chere  being  "no  modal  de- 
velopment cycle"  in  Glennan,  "MIE:    A  Pefson.al  View,*'  op,-  cit. 

101.  for  instance,  see:    Harold  Home  II,  "Education  Research  -    The  Promise 
and  the  Problem,"  Educational  Researcher,  Vol.  5,  tfo.  6,  June  1976; 
Chase,  '"Educational  R^-D;  Promise  or  Mirage?"  op.  cit.;  Chase,  The 
N'acXonal  Profiram       Educational  Laboratories,  op-  cit. 

102.  For  instance,  see  che  AERA  colloquiuia  reported  in;    Richard  Dershiner, 
ed. ,  The  Educational  Community;     iLs  Cotnmurtication  aAd  Social  Structure 
^Washington;    American  Educational  Research  Association,  1970),  ERIC 

ED  057  275.    See  especially  the  colloquium  recapit\ilatiOQ  by  Dershiner 
and  Che-  piece  by  Ronald  G.  Corvin  and  Maynard  Seider  entitled  "Patterns 
of  Educational  Research:    Reflections  on  Some  General  Issues."  Also 
see:    Home,  "Education  Research  -  Thfe  Promise  and  the  Problem>"  op.  cit. 
and  see  comments  made  by  Bidwell  and  Storer,  quoted  in  Dershimer,  The 
Federal  Government  and  Educational  R&D>  op.  cit.,  p.  24. 

103.  Benjamin  S.  Bloom,  "Twenty-five  Years  of  Educational  Research,'*  American 
Educational  Research  Journal,  1966,  No.  3;  Chase,  "EducatiAaal  iJiD: 
Promise  or  Mirage?"  op>  cit:  N.  L. 'Gage,  "Paradigms  for  Research^ on  Teach- 
ing," in  Handbook  of  Research  on  Teaching.  N-  L.  Gag&>  ed.   (Chicago;  Rand 
McNally>  l^fTf  y 

104.  Norman       Storer,  "The  Organization  and  Diffeijentiation  of  the  Scientific 
Community:    'Basic  Disciplines,  Applied  Research>  and  Conjunctive  Domains," 
in  Dershimer,  ed..  The  Educational  Research  Comrfunity:     Its  Communica-  ^ 
tI^^  and  Social  Structure,  op  >  cjt .  * 


I 

105.  C.  W.  Sherwin  and  R.  S.  Isenson,  First  Interim  Report  on  Project  Hind- 
sight, June  30,  1966,  No.  AD  642-400,  Clearinghouse  for  Federal  Scien^ 
tific  and  Technical  Information,  Springfield,  Va.;  C.  W.  Sherwin  and  R-  S. 
Isenson>  "Project  Hindsight,"  Science,  156  (I9£t7) ,  pp.  1576-1577. 

■ 

106.  R.  L.  Ebel,  ed. ,  Encyclopedia  of  Educational  Research,  Fourth  Edition 
'(New  York:    Macmillan>  1969T. 

107.  Gage,  Handbook  of  Research  on  Teaching>  op-  cit.;  and  Robert  M.  W.  Travers, 
ed..  Second  Handbook  .of  Research  on  Teaching  (Chicago:  Rand  McNally,  1973), 

> 

108.  This  quarterly  had  an  important  change  in  publication  policy  in  1969. 
Untilythen,  all  articles  were  solicited  by  the  editors  and  covered  a  spe- 
cif     re  la  Lively  unvarying  set  of  subjects  tied  to  educational  practice;  ^ 
with  the  full  list  of  subjects  repeated  again  In  cyclical  fashion  everyti 
fey  years.     Thus,  on'e  issue  in  each  cycle  would  be  devoted  to  reviewing 
what  had  been  happening  in  curriculum;  another  issue,  evaluation  research; 
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^ — ^tc<  'In  1969j  the  journal  was  transformed  to  focuy^on  researffi 

atreas  rather  than  practice  areas,  with  all  articles  unsolicited  and 

\^   no  prsspecif ied  set  of  areas  to  be  reviewed.    With  the  change,  the 

R^vie^'  becan;e  an  e:';tremel7  useEul  journal  for  the  edudAttonal  research 
jcoinmunity  < 


109. 
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annual  Review  of  Research  in- Education  have  been  ■ 
Peacock,  located  in  Itasca,  Illinois.     Vol,  i,  1973,^ 
Kerlinger.    VoT,  2,  1974,  was  edited  by  Fred  N\ 
Carroll.     Vol,  3,  1975,  was  edited  by  Fred  N, 


All  volumes  of  the 
publ^hed  by  E, 
was  Edited  by  Fred 
Kerlinget  and  John 
Ksrlinger.    Subsequent  volumes  h^ve  been  edited  by  Lee  S;  Shulnan. 


Campbell  and  J-  C.  Stanley,' "Experimental  and  Quasi-ExpeMmental 
^De^signS^or  Research  on  Teaching,"  in  Gage,  ed,  ,  Handbook  of  Research.'. 
on  'leach^TA.  op>  tfit. 

The  best  synthesis  of  the  knowledge  base  of  the  dissemination  function 
is*  Ronald  G,  Havslock,        Gub:kin,  M.  Frohtaan,  M,  Havslock,  H,  Hill, 
and  J-  Huber,  Planning  for  Innervation  through  DiS5eminat;ion  and  Utili- 
zation of  Kno'^led^e  (Ann  Arbor:     Center  for  Rese^ch  on  the  Utilization 
of  Scientific  Knowledge,  Institute  for  SociaJ  Research,  University  pf 
Michigan,  1969)-     For  some  of  the  key  synthef^es  of  the  knowledge/tech- 
nology base  of^  the  e\^luation  reseottch  functi6n,  see  our  chapter  on 
this  functioned  especially  t\ia  soiAtes  cited  below  in  footnotes 'Tli8^120 


112. 


113. 


See  especially  John       Hempliill,  *'The  Relationships  Between  Research 
^nd  Evaluation  Studies,"  in  The  OreRon  Studies,  Vol,  II,  op.  cit;  John 

Hemphill,  "Educational  Research,  Educational  Development,  and  Evalu- 
ation Studies,"  in  Hetnphill  and  Rosenan,  Educational  Development :  A 
New  Discipline,  op.  cit. 

For  instance,  see:     Egon  G*  ,Gul^  "Development,  Diffusion  and  Evalua- 
tion," in  Knowledge  Productiprr  and  Utilizatignyln  Educational  Ad^ninis-' 
tration,  T*  Eidell  and  J.  Kicchel,  eds  <  (Eu^enel^    Center  for  the.A4van- 
'  ced  Study  of  Educational  Administration,  19?\I ,  also  reprinted  in  The 


-Oregon  Studies, 
as  Enlightenment  for  De 
bp.  cit, ;  Robert  E 
.Teaj:hers  College 
Oregon  Studies, 
ating  Action  Prog 
Aliyn  and  Bacon,  197 


cit. 


Dani'^l  L 


lebeam,  "Evaluation 


sion-Making, in  Tlte  Oregon  Studies,  Vol  II, 
e,  "The  Countenance  of  Educational  Evaluation," 
cl.  68,  tjf,  7,  ipril  1967,  reprinted  in  ^e 
€it.;  and  in  Carol       Weiss,  ed, ,  Evalu- 


Readings^  in  Svjpi^^l  Amnion  and  Education  (Boston: 

0 


.  -See  especially:     Michael  "Scriv^en,  "Tue  Methodology  of  Eva3st,iatlon,'^|^ 
"^"^HP-erspectives  of  CurrijculTim.  EvaTuation,        W<  Tyler,  R-  M.  GAgne,  and 
J  -.M-.  Scriverf,_  eds.  ,  AERlA, Monograph  Series  on  Curriculum  Evaluation  (Chica- 
go:    Rand  'McNally,  1967),  reprinted  in  The  6regon  Studies,  Vol.  T^I>  0£. 
cit,  and  in  Weiss,  Evaluating  Action  Pr<igrams,  op ,  cit ,  ;  Stahe,  "The  , 
Countenance  6t  Educational  Evaluation,"  op  <  cit , ;  Sut  ff lebeam,  "Evalua- 
tion ai  Enlig'ntenment  for  Decision-Making,  "^o£^__c^* ;  Donald  T< 
"Reforms  as^  E::periments , "  American  Psychologist,  Vgl'  24,  No.  A 
1969*  reprinted  in  l^i^s,  Evaluating  Action  Programs,  0£.  clc,; 


Weiss  and  Martin  Rein^  "The  l^valuation  of  Broad-'Aim  Programs 
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faculties  in  Experimental  De^signs  and  an  Alterative/'  reprinted  in 
WeisSj  Evaluat^^^  Action  gro^rams^  op,  cit, 

115,  For  instance;  VJeiss>  Evaluating  Action  Programs.  op>  ci t ,  ;  The  Oregon 
Studies^  Vol.^  11^  op,  cit,^  Chapter  II;  Francis  G,  Caro»  ed,»  Readings 
in  Evaluation  Re'^argh  (New  York;     Russell  Sage  Foundation^  1971); 

and  the  annual  review  published  each  year  by  Sage  Publications  of 
Beverly  Kills»  Evaluation  Studies:     Review  Annual^^ol,  1»   1976»  Genfe 
V,  Glass,  ed.,;^ol,  2,^  1977,  Harcia  Guttentag,  ed, ;  Vol,  3;U978, 
Thomas  D*  Cook^Aed, 

116,  Scriven,  "Th^  hfethodplogy  of  Evaluation/'  op,  cit. 

117,  Stuff lebeam,  "Evaluation  as  Enlight^ment  for  Decision-Making,*'  op,  cit, 

US',    For  instance,  see  the  articles  on  evaluation  models  in  Scarvia  B.  Ander" 
son,  Samuel  Ball,  Richard  T*  Hurp'hy,  et.  al*.  Encyclopedia  of  Education- 
arl  Evaluation:     Concepts  and  Techniques  for  Evaluating  Education  and 
Training  Programs  (San  Francisco:    Jcssay  Bass,  1974);  also  the  articles 
on  evaluation  models  in  Gary  D*  Borich,  ed,.  Evaluating  Educational  Pro- 
grams and  Products  {Englewood  Cliffs;    Educational  Technology  Publica- 
tions, 1974).    Also  see:    Stahe,  "The  Countenance  of  Educational  Evalu- 
ation," op.  cit,;  Stufflebeam,  "Evaluation  as  Enlightenment  for  Decision- 
Making,"  op.  cit,;  and  the  following  other  pieces  from  The  Oregon  Stud- 
ies, Vol,  II,  op,  cit. :    Robert  S,  Randall,  "An  Operational  Application 
of  the  CIPP  Model  for  Evaluation;"  Pater  Crane  and  Clark  C.  Abt,  **A 
Model  for  Curriculum  Evaluation;**  Willjlara  C,  Theimer,  Jr*  »  "A  tfodel' for 
PDst  Hoc  Evaluation;"    John  B,  Peper,  "Summary  of  Program  R^evance 
Evaluatilon  Hocf^l;"  and  Esther  Kifesh,  "An  Overview  of  the  Discrepancy 
Evaluation  Model  and  a  Related  Case  Study,"    Also  see;    Gene  V,  Glass, 
"Educational  Product  Evaluation:    A  Prototype  Formab,"  Educational  Re- 
searcher ,  Vol,  1,  No,  1,  January  1972;  Marcia  Guttentag,  "Subjectivity 
and  Its  Use  in  Evaluation^ Research,"  Evaluation,  Vol,  1,  No,  2,  1973; 
Daniel  L,  Stufflebeam,  Walter  J,  Foley,  William  J*  Gephart,  Egon  G,Guba, 
Robert  L,  Hammond,  toward  0*  Uherriman  end  Malcolm  Provus  (PDK  Commis- 
sion on  Evaluation),  Educational  Evaluation  and  Decision  Making  (Itasca, 
Illinois:     F,     E,  Peacock,  1971);  W,  James  Popham  and  Dale  Carlson,  ^ 
"Deep  Dark  Deficits  of  the  Adversary  Evaluation  Model,"  Educational  Re- 
searcher ,  Vol,  6,"  No,  6,  June  1977;  David  Hamilton,  David  Jenkins, 
Christine  King,  Barry  MacDonald,  and  Malcolm  Parlett,  Beyond  the  Numbers 
Game:    A  Reader  in  Educational  Evaluation  (London:    MacmilLan  Education 
Ltd,,  1977);  end        Provus, i  Discrepancy  Evaluation  for  Educational  Pro- 
*   gram^mprovemen  t  and  Assessment  (Berkeley:     McCutchan  Publishing,  1971), 

1L9,    For  instADce,  see  Robert  Stake,  "Prototypes  of  Curriculum  Evaluation," 
^       in  The  Oregon  Studies,  Vol,  II>  op>  cit^, 

120,    These  handbooks  includei^   B,  S*  Bloom,  J,  T*  Hastings,  and  G.  ,F,  Madaus, 
Handbook  on  Fortnative^nd  Summative  Evaluation  of  Student  Learning  (New 
York;    McGra^^-Hlll,  1971);  Marcia  Guttentag  and  Elmer  L,  Struening,  ed,. 
Handbook  of  Evaluation  Research  (Beverly  Hills,  Sage  Publications,  1975); 
Anderson*  Ball>  Muifphy  et,  al.,  EncycJ.opedia  of  Educational  Evaluation, 
op >  cit  >  ;  arrd  BoVich,  Evaluating  Educational  Programs  and  ^Products, 


op  -  cic.  Another  useful  synthesis  is  Edwa^  A.  Suchman^  Fyaluative  - 
Research:     PrLnf:Lples  and  Practice  in  Publi/:  Service  and  Socifil  Acpion 
ProRrauis  (-^s:,  York:     Russell  Sage  Foundati^jn^  1967)? 

A  numbel:  of  handbook-type  reference  works  h^ve  also  been  publi&jhed  for 
practLtionerSj  including  tiie  following:     Lynn  Lyons  Horrtsij  Carol  Tyler 
Fitz-Gibbon^  and  Marlene  E.  Heverson^  Program  Evaluation  Kit  (Beverly 
Hills:     Sage  Publications  ^  1978);     Bruce       Tuckman^  Eval^feti^n^  In-  ^ 
s  true  tional  Programs  (E<ocklt;igh  ^  N.  J.:  ^Allyn  "^dd  Bacon,  Longsvood  * 
Division^  1979);  and  John  Mv'Gottman  and  ttobert  g.  Clasen>  Evaluation 
in  Education:     A  Practitioner's  Guide  (^tasca^  Illincris:     F,  E.  Peacock^ 

"">w     •     .  ■    '  ^, . 

121.  For  instance^  see  Selma  J.  Mushkln,   "Evaluations:    Ui>e  with  Caution^  | 
Evaluation^  Vol.  1^  No.  2>  1973;  William  L-  Sperz-nanj  "Evaluation:^  An 
Evaluacioii  from  a  Sbciologital  Perspective/'    197^  Yearbook  of^the  Na- 
tional Society  .  fors  the  Study,  of  Education  (Chicago:    University  ef 
Chic^o  Press^  1974);  Egon  G.  Guba^   ''The  Failure  of  EducaSftonal  Evalu- 
ation/' Educational  Technology^  Vol.  9^  ,Bo^y5j  1969^  reprinted    in  Weiss^ 
Evaluating  Arctlon  Pro^rams^  op.  cit.;  and  Carol' H*  WeifiS^  **The  Politi- 
cization  o^  Evaluation  Researcli/'  i^  Weiss,  Evaluating  Action  Programs, 

'  Qg  ■  cit .  ;  and  *'Signif  icant^  Olrf  er^nces  on  the  Social  Insignificance  of 
Statistical  Significance  —  A  Pica  for'  New  Strategies,^  Evaluation/' 
Educa tional  Researcher  (Newsletter)  ^  Val.,  20^  October  i969. 

122.  Se*  our  chapter  on  the  evaluation  research  function  in  educational  R/d&I. 
Among  the 'sources  useful  for  gaining 'an  insight  into  some  of  these 

^  dilemmSj  see:     R.  W.  Tyler^  ed.^  Educational  Evaluation:     Neu  Roles, 

N'ew  Means,  68tn  Yearbook  of  the  National 'Society  for  the  Study  of  Educa- 
tion^  Part  II  (Chicago:    University  of  Chicago ^Press »  1969) »  and  especi- 
ally the  following  articles  in  the  yearbook:     Benjamin  S.  Bloom^  "Some 
Theoretical  Issues  Relating  to  Educational  Evaluation/*  and  Robert  E. 
^  -Stake  and  Terry  Denny^  ^'Needed  Concffepts  and  Techniques  for  Utilizing 

More  Fully  the  Potential  of  Evaluatron."    Also  see  the  excellent  selec- 
tion of  articles  (and  bibliography)  in  Weiss^  Evaluating  Action  Programs > 
op.  city    Also:     Peter  H.  Rossi  and  Walter  Uilliarns,  ed .  ,  Evaluating  - 
Social  Programs:    Theory,  Practice^  and  Polltfcs^New  York:  Seminar 
Pressj  1972);    "-J,  W*  Charters,  Jr.  and  John  E.  Jones,  '*0n  the  Risk  of 
Appraising  Mon-Events  in  Program  Evaluation/   Educational  Researcher> 
Vol.  2,  No.   II,  November  1973;  John        Evans ^  "Evaluating  Education 
Programs  -  Are  ^^^e  GetDing  Anywhere?**  Educational  Researcher  y  Vol.  3> 
No.  8y  Septeznber  197i;  Carol  H.  Weiss/'Where  Politics  and  Evaluation 
'  Research  Fleet/'  Evaluation,  Vol.   1,  No.   3*  1973;  Ernest  R.  Housej  ed.^ 
Sc^i^Jol  F'/;^luation:    The  Politico  and  Process  (Berkeley:    McCucchaa,  1973); 
niene  N . 'Bernstein »  "Validity  Issiies  in  Evaluative  Eesear*ch/*  Sociologi- 
cal Methods  and  Resear£jv>  August  l^J5;^and  Francis  G.  Caro^  ''Issues  in 
.Che  Evaluation  of  SocfiTl  Programs  .^tevlew  of  Educational  Research^  Vol.  f^ly 
No.  2y  April  1971. 

123.  See  especially  Ronald  G-  Havelock^  "Disseminatiork  and  Transl^-ition  Roles/' 
in  Elidell  and  Kitrhel^  tCppuledj^s  Production  and  Utilization  In  F.duca- 
tional  Admin  LSt  r^it  ion>  op.  cit.;   R.  G,  Havelock  and  K.  D.  Benne^  "An 


ERIC 
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KJtpIoratoiry  S^tudy  of -Knowledge  Utilisation,"  in  C.  Watson>  ed 
Concepts  for  Sobial  than^e  (Washiagtroa;  ^  tjatipnai  f^tarinin^  Labora- 
tor\es,  \^^7)\  and  thfi  foll'owAngJpru^fc  publications;  Rpnald 

H^veiofikj^  A  Cogiparat'lve  ^StadV       th^'Litecnture  on  Dissemination 
and  IJpilizatlon  of  Sciaotif  fc  jCn'cH^d^e,  1968,  rravelocir  et.^^l. , 
Planning  tat  Jinnovation  thro^^  piW^minaclon  and  Utlligation  o£ 
Knwl'edge/  op.  cjt, ;  Ronald^  Havelock^  A  Guide.  tQ  Innovation  in- 
EduGation>  1970  (republished  8>  Edyetrf^onal  Technology  Publications 
in  1973  as  The  Chaoga  Ag£nt:'*s  Gi.rf^  U)'  Innovatiqu,  in  Education);  and 
^  Ronald  Havelock  and  Mary  Havelock /  Educational  Innovation ■  in  thet, 

[/nieed  States,  1973vn  .      ,  ^        .  «  ' 

N  ■  -  * 

.Havelock>' Guskin>  Frohiaan:,  .;9aveiock,  Hill,  ?nd  Huber>  Planning  for 
Trmovation  throaah  pissemin'ation -^d  Utilisation  of  Knowledge,  op.  cit!, 


For  details  on  thi^,  sae  dttr  chapt^  on  the  ^dissemination  function  in  ^ 
educational  R^D&I.  ^^.^^  ^ 


126.  There  are  soQe  exceptions  to  this,  including  the  following  marketin^^ 
oriented  analyses;    Philip  Kotler,  Gerald  Zaltman,  Louis  P.  BucTTIri, 
Bernard  Dubois,  Harold  Kassa'rjian,  Edgar  Passemier,  and  Ja^diSTi  Sheth , 
The  Role  of  Marke  t In^  -  ir^  a  National  Instfitu^  of  Education,  PreliTui- 
nary  Report  of  a  Planning  Conference,  April  2-3>  if9'?2  (Washington:' 
N'lE,  1972)>  ERIC  ED  088  155;"'Righard  Batemaa>  Stanley  Ghow,  and  Larry 
Hutchins,  A  Projected  Role  for  Marketing  in  the  Dissemination  of  Pi 
ucts  DeveloD€^d  by  R&D  Agencies  >  paper  presented  at  the  Annual  Meeting 

.    of  the  American  Educational  Research  Associationj  Hew  Orleans,  Feb.-  V 
March  1973>  ERIC  ED  078  597;  Linda  A.  Sikorski  and  G.  L.  Hutchins,  A, 
Study  of  the  Feasibility  of  Marketing  ProRraiming.  for  Educational  R^lA 
*7roduc ts  (San  Francisco:    Far  West  ^Laboratory  for  Edncational  ResearclK 
an|l  Development*  1974),  ERIC  ED  095  625;  and  Philip  Kotler",  Bobby  J. 
Calder>  Sriaa  Sternthal,  and  Alice  M.  Tybout>  "A  Marketing  Approach  t9 
the  Development  and  Dissemination  of  Educational  Products,"  in  Michael 
Radnor,  Durwacd  Hofler^  and  Robert  Rich,  eds..  Information  Dissejnina- 
tion  and  Exchange  for  Educational  Innovations:     Conceptual  and  triple- 
cieTitation  Issues  of  a  ReE;iOQallyL  Based  Nationvide  System  (Evanscon; 
Center  for  the  Interdisciplinary  Study  of  Science  and  Technology, 
Northwestern  University,  1977). 

127.  'See  the  exemplary  devalopment  projects  included  in  The  Oregon  Studies: 
Ha^LPy  L,,Amm€rmanj  Darrell  Clukey,  and  Gregory  P.  Thomas,  eds  * ,  The 
Oregon  Studies  in  Research^  Development,  Diffusion  and  Evaluation,  Vol* 
IVi^'Case  Profiles  (Moi^outh,  Oregon:     Teaching  Research  Division,  Oregon 
State    Systen  of  HLgtjer  Education>  1972).    Also  see  the^  materials  In- 
ciLided  in  Hemphill  ar^d  Rosenau^  Educational  Dc^veloipnent :    A  ^^ew  Disci- 
pline, op,  cit. 

128.  tiemphill  and  Rosenau^  Educational  D^elopment:     A  New^Dxsciollne^  o^. 
ci t  ,  and  R.  L.  Baker  and  R.  £,  Schutz^  eds.>  Ins tr ucrionaL  Product 
Development  (New  York;    Van  Nostrand  Reinhold/  1971).    We  were  able  no 
revi^^w  only  the  Heniphill  and  Rosenau  volume. 


129.     For  discissions  of  this  literature,  see  our  ch^ipters  on  the  acquisition 
function  and  the  implementation/utilization  functions  in  educational 
^        R/D&I.  "     ,  * 
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130,  See  especiallv;    Everett  M,  Rogers^  Diffusion  of  Innovat Ions  (New 
York:     The  Free  Press^  1962);  and  Machew  B.^Miles,  "innovation  in 
£dL:ca:ion:     Sor.e  Ger.eralizat  ions  >     in  Innovation  in  Educaplon^ 
Mathciv  B.  Milcs^  ed,     (N'ew  York:     Bure^iu  of  Publications  ^  Teachers 
College^  Colunbia  UP-iversity^  1964), 

131,  For  instance^  see;     Seynour  B,  Sarasor.^  The  Culture  of  the  School 
and  the  Problem  of  Change  (Boston:    Allyn  and  Bacon^  1971);  ^^eal 
Grosi^  Joseph  3.  Giacqulnta  and  Marilyn  Bernstein^  Imple:ner>t:inR 
Organizational  Innovations:     A  Sociological  Analysis  of  Planned 
Educational  Change  (New  York:     Basic  Books^  1971) ;  L.  M.  Smith 
and  P-        Keiths  Anatony  of  Educational  Innovation  C>^^w  York: 
'.^'iley^  1971);  and  the  publications  fro"  the  Rand  Corporations  » 
Change  Agent  Study^  see  especially  the  su^nary  voIu::ie,  Paul  Ber- 
nan  and  Milbrey  Wallin  McLaughlin*  Federal  Programs  Supporting  Ed- 
ucaiional  Change,  Vol.  IV:    The  Findirt.^s  in  Review  (Santa  Monica  :\ 
Rand  Corpordtionj  1975) .  ■ 

132.  See  especially  Havelock^  The  Change  Agent's  Guifc  to  Irtrtovation 

in  Education,  od.  cit, 
  — '  

133.  For  instance^  see;    Ricfiard  A,  Schmack  and  Mathew  B.  Miles,  Organ- 
isation Development  in  Schools  (Palo  Alto:    Mayfield  Publishing  Co.^ 
1971);  and  Richard  A,  Schranck,  Philip  J,  Runkel,  S,  L.  Saturen,  ^  / 
T,  Martellj  and  C,  B/  Derr  »  Handbook  of  Organization  Development  l/i 
Schools   (Palo  Alto;    Mayfield  Publishing  Co,^  1972), 

13i.     National  Institute  of  Education,  Request  for  Proposals  tor  a  Survey 
of  Institutions  IJhich  Pei'form  Educational  R6D  -  Research^  Develop- 
taent,  Dissemination,  Evaluation  ^nd  Policy  Studies  (Washington: 
NIE,  1976). 

135.  These  materials  are  dravn  from  Radnor,  Hofler,  and  Spivak,  Draft 
Materials  Prepared  for  NCER  1977  Report  to  Congress,  op >  cit^ 

136.  This  30  includes  only  the  20  original  regional  laboratories  aod  10 
original  R^D  centers.     It  does  not  include  the  additional  vocational 
education  research  centers »  and  ether  miscellaneous  centers  created 
in  addition  to  these  30f soae  of  ^/h Ich  are  still  in  existence  and  in-* 
eluded  among  the  17  institutions  now  classified  under  the  '^labs  and 
centers''  rubric.    Of  these  30^  only  lA  remainj  plus  "an  additional  3 
[Tilsce llaneous  centers/     For  clarification  on  this^  see  footnote  14 
above  and  >,"TEj  Databook,  Qj> .  cit.;  pp.  39-A3. 


137.  ,  OE^  Educational  Research  and  Development  in  the  United  States^  op , 
cit.;  r'rancis  S.  Chase>  "The  gducatfional  Laboratories:    How  Do  They 
Pit  IntD  trie  Future  of  American  Education/'  reprinted  in  Chase^  The 
'ir^tior:al  Program  of  Education  Laboratories,  _op_^  c_ii:T  ;  David  L.  Clark, 
"Federal  Poli?:y  In  Educational  Research  and  Development,"  Educational 
Researcher^  Vol,  S,  No.  1*  January  1976. 


133. 
139. 


140. 
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149. 


Bailey^  "E^^^rgence  of  che  Laboratory  Program/'  op',  ci t  . ;  Chai;e> 

The  NaiLoaal  ?ro£:raTn  of  Edi:cfl.tional  Laboratories  ^  op.  cit." 

:  7 

For  instance^  see  Blpor:  arcjLcIe  ia  Journal  of  Research  ^and  Develop- 
^ment  in  ^Educatioa^  yol.  1>  No.  4>  op.  cit. 

"Cleariaghouse  Merg^eV  Follows  Rand's  Report  on  ERIC  N'ettjork/'  op. 
c_i_r.  ;  and  Davis,  "CICEs^    .A"  Question  of  Cost?"  op.  cit. 

Westinghouse  L"^araiag  Corporation       one  example  of  this. 

NIE,  Prelininary  Program  Plans,  FY  78.  Executive  Su^nary^  op.  cit. 

For  a  description  of  the  pretest  results  of^  this  survey,  see  Joanne 
"Franker^  .^Iber^  D.  Bideman^  ^tnd  Laure  M.  Sharp;  .Rei;istry  and  Survey 
of  Research  OrRanizatiiDrLS 


DOS  i:>  Education  (Washinstoa:  Bureau  of  Socialj 
>  1977).     Prellrcinary  anafyses  of  the  full  sur- 


Scier.ce  Research,  Inc, 
vey  data  are  scheduled  for  presentation  in  four  symposia  at  the  AERA 
annual  r.eeting  in  San  Francisco  in  April  1979. 

Ciark  and  Hopkins,  A  Report  on  Educational  Research,  Developneat  and 
Dj/&jusion  Manpb^jer,  op .  ci  t .  ;  OE,  Educational  Research  and  Develop- 
ment in  the  United  States,  op.  cit;  and  NIE,  19  76  Databook,  op.  cit. 

Roald  F.  Campbell  et  al".  ^  RctD  FuT\diag  Policies  of  the  National  In-. 
stitute  of  Educations    Review  and  Recommendations , Final  Report  of 
Consultancs  to  the  Director  arri  the  Natioaal  Council  on  Educational 
Research  .(Washington:     SIE,  1975). 

y 

Clark  and  Hopkins,  A    Re:)ort  on  Educational  Research,  Development 
agj  Diffusion  Manpower,  op .  cit .  ;  J,  E.  Hopkins,  An  Upjatin^  of  the 
ClarkpHopkins  Manpower  Projections  AERA  Task  Force  Tarchnical  Paper 
:iO.  25  (Washington:     AERA,  1971);  NIE,  1976  DatabookC  op ■  cit;  and 
also  see  demographic  data  on  AERA  members  published  annually  in  re- 
cent years  in  the  Educational  Researcher,  such  as  Bernard  J-  Fleury, 


Jr.,  Er.na  M*^Cappel uzzo ,  and  W.  C*  Wolf,  Jc 


Demographic  Data  for 


Tr*i-iners  of  Educational  Researchers      Educational  Researcher  (News- 
letter), Vol,  21,  A^ril  1970;  Arliss  L,  Roaden  aad  Blaine  Worthen, 
"A  Profile  of  AERA  Members  ^s  Researchers Educational  Researcher 
(^■ewslecter)  ,  Vol,   21,  October  1970;  and  Joe  A.  Johr.ston,  "AER.A 
^^eInbers:    A  Profile^  1969,  Educational  Researcher  (Newsletter),  Vol. 
■  21 ,  December  1970, 

Buswell  et  al..  Training^  :  or  Educcitional  Research,  op.  cit,;  Cron- 
bach  and  ^uppes.  Research  for  Tomorrow's  Schools,  op,  citi 

NrE>  1976  D^itabook,  op_.  cit.;  Cuba,  "The  Place  of  Educational  Re- 
st?arch  in  Eciiit^ition-il  C^^nge,"  op.  cit. 


:JIE,  1976  DatAb^^ok^  op .  cit. 


/ 
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Y  150.  For  instance,  see  Sam  D.  Sieber^  Analysis  of  USOE  Researcii  Training; 
I  V  —  —  — —        ■      I     ■ ■  ■  ■    ■  ■  ~  ■ 

Pro^rar.s ,  1966-6?  (New  York;    Bureau  of  Applied  Social  Research, 
Colur.bia  I'niv^rsity,  1968). 

/  151 .     For  ins  cane  t »  ste :     D.  L  .  Stuff  iebea:a»  Proposal  to  Design  ^ew  Patterns 

1  fer  Training^  Research,  Developnentj  QeT^^onstracion/pisserrartacion  and 

Evaluatio.^  Personnel  in  Education  (^'ashington:     DMLW ,  1970);  Paul  Hood, 
Final  Report  gf  a  Design  of  a  Survey  for  D^erTniniag  Train^n^  and  Per- 
sonn.el  Requirements  for  Educational  Research^  Developnt^nt,  Disseiaina- 
t ion y  and  Evalua t ion^  2  Volur^es  (Ber'rceley:  Far  West  Laboratory  tor 
Educaiional  Research  and  Developiuenc ,   19  72);  and  Richard  A.  Dershiiner* 
U".  Jaries  Pophani,  and  Uillian  J. -Russell,  Developir.ent  of  Training  Models 
for  Educaiional  Research:     A  Conceptual  Schene  for  a  Professional  As- 
sociation {^'ashington:     AERA,  1973). 

152\   H.  Del  Schalockj  Gregory  P.  Thoiias^  Kevin  R.  Morse,  Clark  A.  Smithy 
an^  Harry  L.  Arjr^err^an,  The  Ore;^ori  Studies  in  Research,  De »e loDir.enC , 
Diffusion  azid  Evaluation,  Vol.   I-     Su:r",ar/  Report   (Monnouch ,  Oregon : 
Teaching  Research  Division,  Oregon  Srate  System    of  tligh'er  Education^ 
1972). 

133.    These  figure^  were  provided  by  the  RiiiD  Systert  Support  Division  of  NIE. 
They  represent  upward  revision  of  the  estimates  they  provided  in  the 
1976  Databooky  op .  cit.  ^  based  on  continuing  staff  analyses  in  1976 
and  1977. 

154.    NIE>  1976  Da!:abook>  od.  cit . 

155-     Sieoer  and  La2aj::£feid,  Tae  Organization  of  Educational  Research,  op . 

cit . ;  OE.,  Ed^jcational  Research  and  Development     in  the  United  States,  ^ 
op.  cit.;  and  Levien,  Nlfe;  Prelininary  Plan  for  the  Proposed  Insti- 
tute, op.  cit- 

156.     Carnot  E.  Nelson,  IViiiiara  M.  Sowers,  and  vvard  S.  Mason,   19  7  5  Federal 

FundijTg  J^or  Education  Knowledge  Production  and  Utilization:     A  Co'^.p^os-* 
Ite  Estir:ate,  by  A^encyj  Usin^  Four  Data  Bases   (Washingtoa:     RoiD  Sys- 
tem Support  Division^  Disser.iriation  and  Resources  Group,  liIE,  1977). 

157..    NIE,   1976  Databcjok,  op.  cit.,  pi  16.  , 

153.     For  instance,   see:     Chase,  The  National  Program  of  Educational  Labora- 
tories >  op.  citi  ;  Chase  "The  Educational  Laboratories:     Ho'.j  Do  Tney^ 
JkFit  Into  the  Future  of  Ainerican  Education?'^    op.  cit.,;  Cr^*A5>  "Educa-- 
tiotuiL  Researcn.and  DGveiop.Ttint  in  the  Slxtitjs:     The  MiAM^^teport  Card,*' 
op.  cit.;  Chase,  "The  Laboratories:     1970  and  Beyond,"  op.  cit.;  and 
Bailey,  "Sigj^lficc^nce  of  the  Federal  InvestPent  in  Educational  R6D," 
op.  cit.^ 

159,     Mich^iel  Radnor^  Harriet  Spivak,  Durward  Hofler,  with  Earl  C.  Youngs 

A;;ency- field  Relationships  in  the  Educational  R/D£il  Systerii:     A  Policy 
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Analysis  for  Che  Hacional  InstLtuce  of  Education  (f-vanstort:  Cen- 
ter for  Che  Incerd Lsc ipl L nary  Study  of  Science  and  Technology, 
No  r chwas  ter n  L'nivers  Ley ,   1976) . 

160.     As  an  LllustraCion  of  how  liccle  attention  is  paid  Co  chese  systemic  — n 
consideratiojis,  note  che  controversy  over  KIE*s  funding  of  fundarien-  ^  ) 
tal  rasearch.  relevant  co  educacioa.     See  especially  our  analysis:  / 
Michael  Radnor,  Durward  Hofler,   and  Harriet. Spivak,  S tr^n^theain^ 
Fundanieacal  Research  Relevan  c  to  Education:    A  Discussion  of  the 
Reports  of  the  National  Academy  of  Sciences'  and  the  NCER  Program 
Co!ri?.i tcee  (Evaaston:     Center  for  the  Interdisciplinary  Study  of  Sci- 
ence and  Technology,  Northwestern  University,  1977).     See  also  the 
earlier  documents  to  which  we  were  reacting:     Sara  B.  Keisler  and 
Charles  F.  Turner*  eds.>  Fundamental    Research  and  the  Process  of 
Education ,  Frnal  Report  o:  the  Committee  on  Fundamental  Research  Rel- 
evant to  Education  {Wash^Lngtoa:    Assembly  of  Behavioral  and  Social 
■Sciences,  NationaliResearch  Council,  l^acional  Acadeniy  of  Sciences, 
197?;;  and  National  Council  on  Educational  Research,  NCER  Program 
c6-:nL:tee  Report  and  Draft  Policy  Resolution  on  rundar;ental  Research 
Relevar.g  to    Educatioa  (Washington:    'KIE,  July  8,  1977J. 

1'61.     For  instance,  see:     Cronbach  and  Suppas>  Reseai^ch  for  Tomorrow's 

Scnools ,  op .  c  it .  ;  Michael  ,Scriven ,   "The  Philosophy  of  Science  in  Edu- 
cational Research,"  Review  of  Educational  Research,  Vol.   30,  1960; 
N\  A.  Fst tu,  A  Survey  of  Educational  Research  and  an  Appraisal  by 
Scientists  from  Other  Fields  (Bloomington :     School  of  Education>  In- 
diana University,  1967);  Corvin  and  Seider,  "Patterns  of  Educational 
Re5earch>"  op .  cit .  ;  F,        Banhart,  ed .  ,  First  Annual  Phi  Delta  KafS^pa 
Syr:>osium  on  Educational  Reseai^ch  (Blooniington  ,  Indiana;     Phi  Delta 
Kappa,   1960);  R,  C.  Collier,  Jf.  anil  S.  M.  Elam,  eds..  Second  Annual 
Phi  Delta  S^^appa    Symposiui!!  on  Educational  Research:    jlesearch  Design 
and  Analysis   (Bloomington,  Indiana:     Phi  Delta  Kappa,   1961);     E.  Cuba 
and  S,  Elam,  ^ds..  Sixth  Annual  Phi  Delta  Kappa  Sysmposium  on  Educa^ 
tional  Research!    The  Training  andNurcureof  Educatidnal  Researchers 
(b^Do-ningtonj  Indiana:    Phi  Delta  Kappa,  1965);  Bloom,  "Twenty-five 
Years  of  Educational  Research/'  op.   cit.;  W.  B,  Michael>   "Teacher  Per- - 
sor.r.i^l:     A  Brief  Evaluation  of  the  Reseatch  Reviewed, Review  of  Ed- 
ucational Research^  Vol.   33,  1963;  and  Ralph  W. 'Tyler,  '^Analysis  of 
Sc^^;ngchs  and  Weaknesses  in  Current  Research  and  Science  Education," 
^       as  reprinted  in  The  Oregon  Studies^  Vol,'  II,  op.  cit. 

162,     A  pjblit^ation  entitled  Standards  of  Evalua^tions  of  Educational  Pro- 

^ra^a.  Projects  and  \Matprials  has  been  drafted  by  a  Joint  Comn^ittee  of 
1^  ^'-^'ocrr,-^  fror^  12  ^ro:G5sional  associations  of  ^^Jucators  a:id  psycholo- 
.ff-,z-^-     Th5  project  is  headed  by  Daniel  Stuff lebea::!  and  is  housed 
I  ^-j  -/valuation  Center,  '.Western  Michij^an  University,  Kalama^oo,  Michigan. 
rjr-L:t>  of  these  f^tandards  are  avaialble  now  froni'the  AERA,    After  na- 
ti  iral  hearings  3re  held  in  varijous  sites^  across  the  country  in  19?9> 
a  f;riol  version  of  these  standards  is  scheduled  for  publication  in 
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TKere  are  already  numer'ous  models  in  the  literature  for  cibsessin^; 
the  nethodoiogical  adequacy  of  research  reports.     These  include; 
Bruce  5.  Sartos,  A  Review  of  Instrunents  D£:veloped  to  be^Used  in 
the  Evaluation  of  trie  Adequacy  Reported  Research  (Bloor^ih^ton >  In- 
diana;    Phi  Delta  Kappa,  1969);  Caroline  Kodges  (Pjersell),  Measuring 
Educational  Research  Quality  and  its  Correlates,  Unpublished  Masters 
Essa;'  (^ew  York:     Colu-Tibia  University,  1967);   Er  At  Dvorak,  ''General 
Guide  to  a  Study  of  Res^^rch  Reports,"  Peabody  Journal  of  Edijcation, 
Vol.  34,  1956;        U.  Farquhap-  and  J-        Krui?boltz>  "A^Checklist  for 
Evaluating  Experimental  Researcn  in  Psychology  and  Education," 
Journal  of  Educational  Research,  Vol.  52,  1939>  G.  B.  Johnson,  "A 
Method  for  Evaluating  Research  Articles  in  Education,"  Vol,  51,  1957; 
R.  L.  Kohr  and       N.  Snydam,  "An  Instrument  for  Evaluating  Survey  Re- 
search ,  "  Jourr.al  of  Educational  Research ,  Vol ,  6^  >  19  70f  .S .  St  rauss  , 
"Guidelines  Tor  Analysis  of  Research  Reports,"  Journal  of  Educational 
Research,  Vol.  63,  1969;  P.  M.  Symond,  **A  Research  Checklist  in  Edu- 
cational P^ychclagy,"  Jourr.al  of  rducational  PsvLhalo^y,  Vol.  47,  1936; 
D,  3.  Van  Dale?,,  "A  Research  Checklist  m  Education,"  Educational  Ad- 
niiniscraiion  and  Supervision,  Vol.  44,   1958;  Wiliiar^  J.  Cephart^ 
Develop":ant  of  an  Instrurr.ent  f or  Evaluat ing  Pveports  of  Educational 
Research  (Washington :    u.  S.  Cooperative  Research  Project  Nor  S-014 , 
1964);  and  William. J.  Gephart,  "Criteria  for  Methodological  Adequacy 
for  Research  on  Educational  Change,**  in  The  Oregon  Studies,  Vol.  II, 
op.  cit. 

163.  Cooley,  as  cited  in  Tyler,  "Analysis  of  Stengths  and  Weaknesses  in 
Current  Research  in  Science  Education,!'  op.  cit. 

164.  Stake,  '^The  Countenance  of  Educational  Evaluation ,     op.  cir. 

165.  One  ejcanple  of  this  is  the  controversy  over  the  national  ir.pact  study 
of  thej Head  Start  program.     A  good  discussion  of  this  controversy  is 
to  bs  found  in  Jerome  Hellmuth,  edr.  Disadvantaged  Childj  Vol.  3, 
Cor^pensatory  Education:     A  National  Debate  (New  York:  Brunner/Mazel, 
1970J,  Chapters  9-10  c;  Sheldon  H.  White,  '*The  KatiOnal  Impact  Study 
of  Head  Start;"    Donald  T.  Campbell  and  Albert  Erlebacher,   '*How  Re- 
pression Artifacts  in  Quasi-Experimental  Evaluations  Can  Mistakenly 
Make  Compensatory  Education  Look  Harmful;"  Victor  C.  Cicirelli,  "The 
Relevance  of  the  Regression  Artifact  Problem  to  the  Wes t inghouse- 
Ohio  Evaluation  of  Head  Start:     A  Reply  to  Campbell  and  Erlebacher;" 
John  W.  Evans  and  Jeffry  Schiller*  "How  Preoccupation  with  Possible 
Regression  Artifacts  Can  Lead  to  a  Faulty  Strategy  for  the  Evaluation 
of  Sori?il  Action  Progra^is:     A  Reply  to  Canpbell  and  Er lebacher ; and 
Donald  i-  Campbell  and  Albert  Erlebacher,  "Reply  to  the  Replies." 

The  controversy  over  the  Coleman  Report  to  another  case  in  point,  as 
illustrated  by  tvo  particularly  useful  volumes:     Harvard  Educational 
ReviCw>"£qual  Educ^itional  Opportunity"(Cambridge:     Harvard  University 
Press,   1969),   (a  republication  ot  the  special  issue  of  the  Harvard 
EducationA  Review  published  in  Winter  1968);  and  Frederick  Hosteller 
and  Dan ieF P .  Moynlhan  ed..  On  Equality  of  Educational  Opportunity 
f:;-^  York:     Vin:a:;;e  Eo-)ks ,  1972). 

J       •  ■  ■  , 
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166.  The  Qre>^on  Studies,  Vol.  I,  op.  cU.:  David        Clark,  '*5crategios 
and  Dynamics  In  Changing  Educational  f^ractice^"  in  The  0re2;on  Stud- 
ies >  Vol  ■  11 ,  op .  c ir  ■ ;  The  R,ole  of  Research  in  Developcerit      in  , 
The  0r5gar>^^St-^d!€s,  Vol.  II,  op.  cic;  Stuff lebeani,  "Evaluation  £3 

■    Enlightenment  ior  Decision-Making/*  o;> .  cit . ;  and  Randall^  "An  Op- 
erational Applica:ion  o£  the  CIPP  Model  for  Evaluation,"  q:j  >  cit. 

167.  Cronback  and  Suppes^  Resear;;h  for  Tomorrow's  Schools,  op ■  ci c ■  > 
pp.  249-50. 

16S.     Schalockj  Tho:?.as  ^  Morse^  Smithy  and  Anniern:an>  The  Oregon  Studies^ 

Vol.  I>  op ■  cit ■ ;  Robert  M.  Cagne^  "Qualifications  of  Professionals 

in  Educational  RicD/'^  Educational  Researcher,  Vol.  4^  No.  2,  Febru^  v 

ary^ll^75;  and  Joint  Comniittee  (Stuff  lebean  et  al. )  >  Standards  for  \ 

Evaluatiohs  o:  Educational  Prograxs,  Projects^  and  Materials^  op . 

cit. 


16^.     On  cms  J  set  for  instance,  Corwin^   "Bevonc  Bureaucracy  in  Educa- 
tional Research  Management/'  op.  ci^.  '       .  '  / 

170.     Schalock,  ThoF.as ,  Morse,  Srtith^  and  Anmerrianj  The  Oregon  Studies, 
Vol ,  op.   cit.;  H.  Del  Schalock  and  C.  Roger  Sell^  "A  Framework 
for  the  Analysis  and  Empirical  Investigation  of  Educational  R,D,D> 
iiE/'  in  The  Oregon  Studies,  Vol.  Ill,  op .  c  it .  ;  B-  R.  Worthen  and 
R .  M .  Cagn e J  The  Oevelop:aent  of  a  Classification  System  for  Func- 
tions and  Skills  Required  of  Research  and  Research^Related  Personnel 

EducatloHT  Technical  Paper  ;;o.   1  (Boulder^  Colorado:  AE?vA  Task 
Forc^:  on  Research  Training^  Laboratory  of  Educational  Research,  Uni- 
versity of  Colorado^  1969^;  B.  R.  Vorthen  and  J.  R,  Landers,  Toe 
Development  of  and  Interview  Technlq^ue  to  Collect  Data  on  Iz^.portance  , 
and  Availability  of  Selected  Cop.petencies  iji^Research  >  Deyelopmer.t 


S.  R,  Worthen,  An  Analysis  of  Employers*  Perceptions  of  the  Relative 
Importance  of  Selected  Research  and  ReseSrch-Related  Conpetencles 
and  Shortages  of  Personnel  vlch  Such  Competencies  (Boulder ,  Colorado : 
Laboratory  o:  Educational  Research ^  University  of  Colorado,  1970)^ 
C.  V.  Class  and  B.  R.  Worthen,   Irtterrelationshlp  Amon^  Research  and 
Research-Related  Roles  in  Education:    A  Conceptual  Frar^ework^  Tech- 
nical Paper  Wo,   4  (Boulder^  Colorado:     AERA  Task  Forcfe  on  Research 
Training,   Laboratory  of  Educational  Research^  University  of  Colorado, 
1970);     C.  V.  Glass  and  B,  R.  Worthen,  Essential  Knovled^e  and  Skills 
for  Educational  Research  and  Evaluation^  Technical  Paper  No.   5  (Boul- 
cer^  Color^di.:     ALR.A  Task  Turce  on  Rt;=,e^i:;n  Tr^*Lning,  LaDoracory  of_ 
educational  Research^  University  of  Colorado;  1970);  A.  R.  Coller^ 
A  Taxonomy  o f^  Programmatic  T^asks  in  an  Educational  Evaluation  Facili- ■ 
tatlon  and  CcordiPition  Syste::i  (N'or  chf  ield  ,  I llinois  :  Cooperative 
^:duc^itional  Research  Laboratory^  Inc.,  1970  {USOE  Contract  OEC-3- 
3Q61391-3061);        D.  Anderson^  J.  M.  &optick,        T,  Rogers,  and  B.  R. 
.1.^ o r t h e n J  A n^ _A na lysis  and  Interpretation  of  Tasks  and  Consgtencles 
R-.-'i^t!  ■  r_ed_of_  ? l? r^^^nne  1  J^ori^d^i-v  t  i  n^  A^^_^Pj r h  ^ n d  R o s e n r c n - 
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Related  AcCivleiea\n  Education,  Techaical  Paper  No.  23  (BoVTdL-^r, 
Colorado;    AEELV  Ta^k  Force  on  Research  frainiag,  Laboratory  of  Edu- 
cational Research,  University  of  Colorado,  1971);  3<  R/Wortht;n,  Sone 
T ajks  an d  Cc^petejic ies  Frequently  Required  ir.  Edacatioaal  Research 
and  Lvaluacioaf  Research,  Evaluation,  and  Duveloprent  Paper  Ko.  5 
(Porclaad,  Oregon:    Northwest  Regional  Educational  Laboratory,  197A); 
■S.   R.  tiOrj:hen,  '*Co'":j-tencie3  ^or  Educational  i^ea?ch  and  Evaluation," 
Edijcat  tonal  Researcner  ^  Vol .  4  ,  No<  1 ,  January  1975< 

Ibid. 

172<     Schalock,  Thonas,  MarSe,  Snith,  and  Animernan,  The  Oregoh  Studies^ 
Vol.  I ,  op,  cit, 

173,     Sfee  especially  our  chapters  on  infonnatlon  flow  and  on  the  need  idea^ 
t  i:  ica t  Ion,  ac^iuisir  ion  ,  anc*  dlbseuiin^Lioa  functions , 


iVi.     Setr  Our  vnap^er  on  the  disser.ma tion  function. 

175,     For  instance,  see:    Lazarsfeld  and  Sieber^  Organizing  Educational 

Research ,  op.  clt. ;  Hood ,  ^'Disseipination ^  Distribution ,  and  Utiliza- 
tion of  Laboratory  Products/*  op ,  ci t ,  ;  PincijS,  ''Incentives  for  In* 
novation  in  the  Public  Sch^Sols,"  op .  c_i t .  ;  Havelock  et  al,  ,  Planninfi 
for  Innovation  throjgh  Dissenination  and  Utilization  of  Knowledge, 
.  op.  cit ,  :  Sarason,-The  Culture  of  the.  School,  op.  cit,;  Sam  Sieber, 
'^Organizational  Influences  on  Innovative  Roles, in  Knouled^e  Produc* 
tion  and  Utilization  in  Educational  Administration,  T,  Eidell  and  J. 
Kitchelj  eds,   (Eugene^  Oregon;     Center^ for  the  Advanced  Study  of  Educa- 
tional .-^dministrationj  University  of  Oregon,  1978);  and  Richard  0, 
parlson.  Adoption  of  Educational  Innovations  (Eugene,  Oregon:  Center 
for  the  Advanced  Study  of  Educational  Administration,  University  of 
^        Oregon^  1965);  Lindeniao,  Bailey,  Berke,  and  Naun,  Sone  Aspects  of 

Educational  Research  and  Develcipment  in  the  United  States,  op.  cit.  ; 

and  OE ,  Educaciopal  Research  and  Developinent  in  the  United  States,  ^ 

op.  cit*  ,  pp.  K7-l53< 

V 

176*     The  most  significant  exceptions  here  are  the  A£Rj\  sysmposiuni  published 
^      as  Dershimer,  ed<,  Tne  Educational  Research  Commuhity:     Its  CoEonunica" 
tion  and  Social  Structure ^  op  *_cj t .  ;  and  the  various  analyses  by  Carnot 
E.  Nelson  and  his  associates  discussed  extensively  in  our  chapter  dn 
information  flows  in  education, 

177,     For  Instance^  see;    William  J,  Paisley,  *'*The  Role  pf  Invisible  Colleges," 
in  Der^'-^^  iTier ,  ed..  The  Ejucatlonal  Research  Co'nr.Mntcy:     Tts  Comriun  ica-* 
,  tion  and  Soc_ial  Structure^  op,  cit,   (republished  in  revised  for:n  in  ^^he 
Educational  Researcher ,  ~Vol .   1,  No,  4,  April  1972;  Dershimer,  The  Fed- 
eral Government  and  Educational  R^D,  Op._clt.;  and  Corwin,  '^Beyond 
B'lre^iucracy  in  Edu:,ationai  Research  Managen^en  t ,  *'  op.  cit, 

173. _   Dftr^nir.er,  ed..  The  Educational  Research  CorLTiunity:     Its  Communi cacloii 

ar'!  So£_Lal  Struct: '.ire,  op^^cir. 
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179.     Chase,  "The  EducaClonal  Laboratories:    How  Do  They  Fit  into  the 
H  Future  of  i\jueric^n  EcKicatio^V^     op.  cit. 

ISO..    For  inst^ncej  see;     :ier>ry  M.  Brickiill,  Organizing  Mew  York  State 

for  Educational  Cnan.^e  (Albany;    New  York  State  Department  of  Edu^ 
cation^  1961);  Gaba^  "The  PTace  of  Educational  Research  ia  Educa- 
tional Change,"  op,  c i t . ^  OE^  Educacional  Research  and  Development 
in  the  United  States^  op.  cit.;  Bailey*  *'Signif icance  of  the  Feder- 
al Investment  in  Educational  R^D,"  op ■  cit.;  Lindeman,  Bailey,  Berke, 
'^nd  Naum,  Some  Aspects  of  Educational  Research  and  Development  in 
the  United  States ,  op.  cit.;  Sarason,  The  Culture  of  the  Schools 
op.  cit.^  Goodlad  et  al.*  Behind  the  Classroom  Poor,  op.  cit.;  Have- 
lock  and  Havelockj  Educational  Innovation  in  the  United  States^  op ■ 
cit.;        A.  Cliffox6>  "History  of  the  Impact  of  Research  on  Teaching* 
in  TraverSj  Second  Jfandbook  of  Research  on.  Teachia^*  op.  j^i  t .  ^  Philip 
Jackson  and  Sara  B^-  ^eslar*  "Fundamental  Research  and  Educa^wf^" 
Educational  Researcher,  Vol.  6,  No.  8,  September  1977;  Kies^r  and 
Turner*  Funda:?>ental  Research  and  the  Process  of  Education^  op .  cit .  ; 
and  Fred  i^.  Kerlinger*  "The  Influersce  of  Research  on  Education  Prec^ 
tice/'  Educational  Researcher ^  Vol.  6>  No.  8^  September  1977. 

181.  *Brichellj  Organising  New  York  State  for  Educational  Change,  op.  cit. 

182.  Ronal^  G,  Havelook^  "Dissenina t ion  a,nd  Translation  Roles  in  Educa- 
tion and  Other  Fields>"  in  Eidell  and  Kitchel^  KriQwledge  Produc tion 
and  Utilization  in  Educational  Administration >  op .  cit . ;  Pincus^ 
*^Incentives  for  Innovation  in  the  Public  Schools/'  op.  cit. 

1S3.     For  ins tance >  see  the  chapters  on  the  need  iden t i f  ica t ion  ^  dissemina- 
tion ^  acquis  it  ion  ^  and  implementation/utilization  functions  and  on 
, *  information  flows . 

ISA.     For  instance^  see  Brownell  in.  Journal  of  Research  and  Development  in  , 
Education,  Vol.  1>  No.  4,  Summer  1968;  NIE^  "RFP  to  Establish^ an  ^R^D 
Dissemination  and  Feed  forward  System^      op .  cit.;.  Radnor >  Hofler> 
and  Rich,  Information  Dissemination  and  E?^ch'ange  for  Educational 
Innovation^  op .  ci  t .  >  especially  the  following  two  chapters:  Susan 
Klein*  Richard  McCann,  and  Mary  Saily*  *'The  R^D  Exchange;    An  Ener- 
'  ging  Effort*"  and  ^lichael  Radnor*  Robert'Rich>  and  Durward  Hofierj 


Hendrik  D.  Gideonse*  "Elements  of  National  Science  Policy;    A  Per*- - 
spective  fron  the  Behavioral  and  Social  Sciences/*  in  The  Oregon 
^Studies  *  Vol .  11  ^  op.  cit.;  Hendrik  D.  Gideon^e,  '^Research*  Develop- 
meTit  and  the  Improvement  of  Education,"  Science  *  Vol.  1^2*  November  i* 
1968  (reprinted  in  The  Oregon  Studies,  Vol.  IC*  op .  cit.;  and  T.  H. 
Bell*  "Educational  -Research  and  the  Public  Interest*"  Ed\Jcational 
Research*  Vol.        No. ^5*  June  1973. 

135.    See  especially  Gideonse*  "Research  and  Development  in  Education:  A 
-  Market  Model/'  op^.  cit .  ;  Cidfonse*  "Elements  of  National  Science 
Policy:     A  Per^ipectivp  fron  the  Bf^havLyml  and  Social  Scioncos**' 
op .  cit.;  and  Cideonse*  "Research,  Development  and  the  Improvement 
of  i^ducation*'*  op    cit  . 
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186,     For  an  especially  good  analysis  of  the  wido  range  of  organizational 
types  involved  in  linkage  activities  in  education>  see  Matilda  But- 
ler-PaisU:-  and  V.'iLIian  Paisley,  Cornnunication  for  Change  in  Educa- 
tion:    £;dk,caCional  Llnka;>e  ?rQ>;ram:^  in  the  1970'5  (Palo  Alto:  Insti- 
tute for  Conmunication  Research>  Stanford  University,  1975). 


S7.     See>  for  instance:    Jarr^s  U'elch>  "Renewal:     p^TTatest  Word/'  Educa- 
tional Researcher,  Vol.  1,  No.  2>  February  1*972;  Philip  J.  Runkelj 
Linking  Organizations  to  Maintain  Organizational  Development  and 
Transml t  Innovation   (Eugene:     Center  for  the  Advanced  Study  of  Edu- 
catioaal  Administration,  University  of  Oregon>  1970);  Miles>  Or^ani- 
zation  Develoz^:ttent  in  Schools^  op.  cit. ;  Schmuck  >  Runkel ,  Sa  turen, 
Martell,  ar.d  Derr  ^  Handbook  of  Organization  Development  in  Schools, 
op.  cit.    For  more  on  thisj  see  oar  chapter  on  the  implementation 
^and  utilization  functions  in  education. 

:3i.     The  best  d:  trese  Is  probably  Havelock,  The  Charge  A^-^ont's  Guide  to 
Innovit  ion  in  Educa t  ion ,  op  ..  ci t^. 

139.     For  instance>  see:     Becker>  "incorporating  the  Products  of  Education- 
al Development  into  Practice,"  op .  cit .  ;  and  Paul  D.  Hood,  "Dissei?.- 
ination,  DistributiOHj  and  Utilisation  of  Laboratory  Products/'  re- 
printed in  The  Oregon  Studies,  Vol.  II,  op.  cit.  and  also  reprinted 
in  Henphili  and  Rosenau>  Development:    A  Kew  Discipline>  op.  cit. 

190.  See  our  chapter  on  the  dissemination  function  in  educational  R/D&I, 

"J 

191.  See  our  disseniination  chapter. 

192.  NIE's  Diss^min'atioa  and  Technical  Assistance  in  Urban  Schools  Pro- 
ject,    Hovever,  this  project  was  not  successful  in  arcJducing  useful 
materials  *  4 

193.  A  brief  description  of  this  program  and  what  happened  to  it  is  in- 
cluded in  Dershimer^  The  Fed^al  Government  and  Educational  R&D, 
op-  cit, 

19i.     National  Institute  of  Education>  Catalog  of  N'XE  Education  Products 
(Washington;     MXE,  19)16). 

195.  Ibid. ;  >:iE,  1976  Databook,  op.  cit, 

« 

196.  For  instance,  see:     Council  for  Educational  Development  and  Research, 
Cf-ID^iR  Catalog  o^  Se locted  Educational  Research  and  Develo^F^ent  Pro- 
grams and  Products  (Denver:     CEDaR,  1972);  S.  N,  Henrie>  ed.>  ALERT: 
A  Sourcebook  of  Elementary  Curricula  Programs  and  Products  (San  Fran- 
cisco:    Far  Vest  Laboratory  for  Educational  Research  and_  Development , 
1972>;   D,  i;.  Kratochvil  et  al.  >  Product  Development  Reports  (Palo 
Alto:    /VT.erican  Institute  for  Research,  1971-72);  Mortimer  Smlth> 
Richard  Peck,  c^pd  Georj;e  Ueber,  A  Consumer's  Guide  to  Educational 
[nnovM th>T\'^  f "..'a.ih in-^ton :     Counci  1  for  Bas ic  Kducat  ion,   19  72);   B.  J ." 


Turnbull  ec  al.  y  Promoting  Change  in  Schools:    A  Diffusion  Casebook 
(San  Franpisco:     Far  U'est  Laboratory  for  Educational  Research  and 
Developr.a^:,  197A) , 

*  1 

197.    These  proj-ects  include  the  PSSC  physics  program,  the  BSCS  biology 
progranij  the  QHEM  chemistry  prograra^  the  SMSG  mathematics 'program. 
For  a  summary  of  impact  data  on  these  programs,  see  OE,  Edocationajl 
Research  atfd  Developmeat  in  the  United  States,  op.  cit, 

198<  For  instance,  see:^  Chase,  The  National  Program  of  Educational  Labor- 
atories ,  06.  cit,j  Walter  R.  Borge,  *'Educa tional  Research  and  Dev.e>- 
oproent  and  ^Educational  Change/^  in  Hemphill  and  Rosenau,  Educational 
Developnenc!:  A  :)iew  Discipline,  op.  cit,;  Becker^  "Incorporating  )the 
Products  oc  Eduo'ational  Development  into  Practice,'*  0?.  cic;  Chaa^, 
'^Educational  Research  and  Development  in  the  Sixties:  The  ^lixed  Re^- 
port  Card,'*^  op^  cit\ ;  and  Chase,  '^R&D  ^in  the  Remodeling  of  Edudation," 
op cl  t .  For  an  interesting  case  study  on  the  development  of  Sesame 

Stresrt,  see, The  Oregon  Studies,  Vol,  IV,  op,  clt.^ 

k 

199.  ME,  1976  Databook,  op,  cit,,  pp-  52-55.    ^The  two  projects  that  iden- 
tified these  ejiemplary  outputs  are  described  in  Kratochvil,  Produc t 
Development  Rt^ ports ,  op.  cit.  and  Turnbutl  ,* Promoting  Change  in 
Schools, . op .  cit , 

200.  For  instance,  see:  OE,  Educational^^Research  and  Development  in  the 
United  5tates>  op.  cit.>  pp.  139-153;  J-  Cetzels,  ^'Paradigm  and 
Practice:  On  the  Contributions  of  Research  to  Education,"  as  cited 
in  ibid. ;  Daniel  E.  Griffiths,  "The  Ten  Most  Significant  Education- 
al Research  Findings  in  the  Past  Ten  Years,"  in  The  Oreg;on  Studies, 
Vol,  II  y  op.  citu?  Cronbach  and  Suppes,  op.  ci^.;  and  Keisler  and 
Turner,  Fundai;:en tal  Research  and  the  Process  of^  Education  (National 
Academy  of  Sciences  Report)j  op,  cit, 

201.  Chase,  "R&D  in  the  Ifemode lling  of  Education/'  op,  cit.;  Chase,  '*The 
Laboratories:     1970  and  Beyond/'  Chase,  "Educational  Research  and 
Development  in  the  Sixties:    The  Mixed  Report  Card,"  op,  cit. 


20; 


Chase,  yEducational  Research  and  Development  in  the  Sixties:  The 
Mixed^^port  Card,"  op,  cit. 


203      CorwiHj  "Bryond  Bureaucracy  in  Educational  Research  Management,"  y 
op.  cit . 

204<     Carnot  E*  Nelson  and  Ward  S.  Mason,    1975  Federal  Funding  for  Education 
ICnovIedge  Production  and  Utilization:    Project  Content  and  PerforFier, 
By  A^GncY_  (Washington:     R^fD  System  Support  Division,  NIE,'  l977)y 
pp,  33-34,  Tables  15-16,  ^ 

205.     Ibid,  p,  52. 

20^.     National  CounLil  on  Educational  Research,  Resolution  NCER-GP--77 
September  16,  1977. 
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All  R'D&I  systems  are  significantly  affected  by  the  environ:nents  in 
which  they  operate.    A  systetn^s  environment  influences  the  nature^ 
quantlty>  and  quality  of  inputs  provided  to  support  system  functioning. 
And  tOQj  with  some  degree  of  variability  from  system  to  system^  the 
environment  affects  the  demands  made  on  a  system^  as  tif'what  it  should 
or  should  not  do^  can  or  cannot  do.    Consequently ^  the  pervasive  effects 
of  a  system's  ^^rop.ment  can  be  traced  throughout  virtually  every 
dimension  of  system  functioning       on  the  determination  of  goals^ 
priorities,  policies^  and  strategies;  on  the  identification  of  needs;  en 
the  k^inds  J  levels,  and  quality  of  such  inputs  as  personnel  and  funding; 
and  on  the  manner  in  which^  and  the  effectiveness  with  which^  these 
system  inputs  are  utilized  in  the  performance  of  system  functions. 


Since  R'D&I  involves  change-producing  processes^  the  direction  of^' 
influence  can  run  both  ways        not  only  from  the  enirironiiient  to  a  system^ 
but  also  from  a  system  to  its  en^ironnien^    R£tD  outputs  can  produce- 
major  transformations  in  user  systems  in  a  particular  sector-  If 
sufficiently  consequential  (e.g. ^  the  atomic  bomb ^  or  computer  technology)^ 
ripples  of  these  effects  may  be  discerned  in  and  peireps  even  bring  about 


significant  transformations  themselves  in^  the  broader  social>  ^ultural^ 
economic^  technological >  and  political  environment.    Afe  the  very  least^  ^ 
the  success  of  an  R/D&I  system  in  producing  observable  gains  will  affect^ 
perhaps  more  than  any  other  factor>  the  esteem  in  which  the  system  is 
heldj  the  degree  or. support  its  leaders  are  able  to  muster>  and  the  nat\^r2> 
levelj  and  quality  of  inputs  likely  to  flow  to  the  systeni  in  the  future. 

An  understanding  of  en^iifonmental  influence  is  especially  important  to 
grasp  the  difficulties  of  educational  R/DSd  functiioning^  and  the  serious 
constraints  that  must  be  taken  into  account  in  developing  feasible  palicy 
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options  and  njaTtagsir^eut  strategies  for  this  systen.,  .Of  all  the  sectors 
we  hare  considered  in  our  comparative  analysis,  education  is  clearly 

***the  most  vulnerable         the  most  opeji  to, ^  and  subject  to^  social  and 
political  Influence.    There  are  several  reasons  for  this  vulnerability, 
and  we  consider  them  in  some  detail^   We  then  exandne  some  of  the 
problezis  the  environnient  poses  *for  educational  R^D6tI,  the  ways  in  which 

^ it  affects  El'DSd  functioning,  and  consequently  the  extent  to  whicIY 
environniental  fectors  must  be  tdken  into  account  in  assessing  the 
feasibility  of  different  policy  options  and  oanag^ineat  strategies* 
M€xt,  we  consider  the  question  of  possible  policy  interveations  to 
transrorm  the  environment  into  one  mor&  favorable  to  educational  R/D6tl' 
We  analyze  the  interrelated, web  of  influences  on  environnent-sys tem 
boundary  transactions,  and  suggest  the  extent  to  which  different  environ^ 
'mental  factors  cmst  be  viewed  as  fixed  or  as  amenable  to  various  types  of 
policy  interventions  with  various  degrees  of  likely  impact  over  the  short 
and  the  long  run.     Finally,  we^try  to  sum  up  our  assessruent  of  where  the 
field  is  at  this  point  in  time  in  :     (a)  understan3ing  environmental 
influences  on  educational  R^D£:Ij  and  C^)  using  this  understanding  to 
formulate  policy  options  that  might  improve  this  environment  an4  make  it 
more  supportive  of  the  educational  R/D6tl.     We  consider  the  literature 
(what  is  and  what  is  not  there) ,  some  kiy  questions  in  need  of  research, 
and  sone  thoughts  on  how  we  might  proceed  both  to  further  our  understanding 
and  to  use  this  understanding  to  assist  in  the  develojpment  of  educa^tional 
R£cD  policy.  '      ^  .  , 

•  *  /  ■ 

I-^  THE  EDUCATION  SSCTQR  IS  SO  VULNERABLE  TO  ENVIROr^NTAL  INFLUENCE 


Ths  ei'jcation  sectorVs  hig'i  ^grec  of  vulnerability  to  social  a^Vid  political 

nfl^jence  is  attributable  to  several  fac'tors:     the  nature  of  education  afe 
an  institution;  the  nature  and  status  of  the  knowledge  and  technology  base 
of  the  field;  the  nature. of  educational  innovations;  and  the  governance 
structure  of  education  and  educational  R/U&l  in  this  country^  and  its 
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resultant  dependence  oa  political  processes  for" -needed  resources.  .We 
consider  each  of  thess  factors  In  turn. 

I.      The  Nature  of  HlducatLon       an  Ins t: Itublon 

A.      A  Public  Service  Institution  ^ 
 ^  

Schools  are  a  public  service  institution  supt>orted  by  public 
funds  an4  administered  and  regulate*^  by  public  agencies* 
Thereforej  they  affect  all  Subgroups  of  the  population^  as  , 
citizens  and  ta:<payers.     Since  the  proportion  o£  local  funds 
spent  on  public  education  tends  to  be  quite^.igh,  and  In  nany 
localities  school  taxes,  bond  issues,  and  budgets  are  voted  on 
in  special  elections,  schools  tend  to  be  more  salient  to  t^-- 
payers  than  any  of  the  other  sectors  we  have  considered  in  our 
conipaSfet^ve  analvsis. 

.  /  .  ■  ' 

B-  /  Faith  in  Education  as  the  Kev  to  Future  Success 

—r  '  

Tf         For  those  taxpayers  who  are  parents  of  school-age  children,  the 

level  of  concern  about  school  functioning  tends  to  be  eVen 

2  ,  ' 

higher.      American  society  has  been  characterized  by  tretnendously 


high  expectations  for  schooling.    .One  _wrlter  nas  described  this 
as  "the  great  school  legend'*         faith  in  education  as  the  great 
social  leveler,  Vne  key  to  occupational  ability  and  future 
success.     Recent  research  has  cast  soirie  doubt  on  t>ie  validity  of 
this  beliefj  suggesting  instead  that  home  environment  is  mor^ 

critical  than  school  factors  In  explaining  diff.erences  in 

^  4 
academic  achievement  levels  and  future  occupational  status.  If 

this  is  indeed  tru^,  and  If  schooling  as  an  institution  (and 

edircatlonal  R/D£^I  as  a  support!  systen  for  that  institution)  is 

inad^qijate  to  ^eef  society's  high  expectations,  then  this  helps 
ft 

to  pxplain  the  e:ctr^^me  vMln^rahility  of  the  educ^ttion  sector 
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and  Che  intensity  with  which  it  has  come  u^der  atcacjc  in  recenC 
years .  ' 

C.      Education  as  Key  to  Work  Force  Preparation 


Taxpayers  and  parents  are  not  the  only  sectors  of  the  public  who 
have  been  expressing  concern  over  school  functioning  in  recent 
years.    Leaders  of  Industry  and    business  have  been  bemoaning 
the  poor  quality  of  work  force  preparation  for  the  world  of  work. 
Many  companies  ha^e  been  forced  to  develop  extensive  training 
program,  at  considerable  expense  to  themselves,  to  overcoire  the 
problem  of  finding  sufficient  numbers  of  qualified  personnel  to 
fill  positions  requiring  little  more  than  functional  literacy 
and  nlniMl  s(rltlnetic  skills^"   Characteristic  of  the  concern 
of  the.  business  cfcmmittee  is  a  trenchant  statement  made  by  the 
Cormittee  for  £c<|nomic  Developnsent ,  an  organization  of  leader's 
of  business  and  Industry:     "The  nation  cannot  afford  to  waste 
its  resources  byVnvestlng  them  in  schools  that  fail  to  achieve 
the  level  of  operational^  efficiency  and  effectiveness  In 
instruction  whlcJ^J-e  now  within  their  reach*"^ 

X>*      Diffusen^s  and  Value-Laden  ^^atyre  of  Educational  Goals 

The  education  sector,  then,  evokes  a  higher  level  of  concern  acong 
Its  relevant  publics  than  other  s'ectors  we  have  considered  in  our 
analysis.     Education,  by  its  nature,  also  has  more  diffuse  goals 
than  other  sectors  -7  goals  that  are  more  subject  to  value 
jud greats  ,  risinterpretfatlon,  and  cont  f  oversy ;  and  goals  that 
are  harder  to  specify,  less  measurable,  and  harder  to  use  as 
performance  standards  against  which  to  judge  system  perf otTT^nce* 
What  precisely  is  meant  when  it  is  said  that  schools  should 
educate  students^     And,  education  toward    what  ends?  Philosophers 
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have  been  debating  the  ends  of  education  £or  centuries. 


«  iiSprovement?    Given  the  dl£fu^eness  and  value-laden  nature 

of  educational  goals  compared  to  other  sectors,  the  functioning 
and  effectiveness  of  edticators  and  educational  K/U^l  personnel 
are  more  likely  to  be  subject  to  scrutiny  and  debate. 

The  Knowledge  and  Technology  Base  of  the  Field 


A.     Relatively  Limited  Spgciallsed  Expertise  Required  Compared 
To  Other  Professions 

Contributing  to  the  vulnerability  of  the  education  sectors**  is  the 
edi:cat;or*s  legititnacy  problems  in  claiaing  specialized  e::pertise 
and  pro^ssional  status.     Conpared  to  doctors,  lawyers,  scientists, 
or  engineers,  the  specialized  training  needed  to  function  ss  a 
teacher  or  principal  does  not  seem  particularly  awesome^    We  do 
not  TPean  that  school  pro^fessionals  are  not  accorded  a  considerable 


atnourt^  of  respect  and  some  awe  by  parents  in  general.  Public 
opinion  data  strongly  support  the  impression  that  most  parents 
in  most  localities  express  substantial  admiration  for  educators.^ 
However,  were  comparative  data  available,  few  would  d#ibc  Chat 
even  the  most  respectful  parent  would  be  more  likely  to  question 
the  functioning  of  a  teacher  than^^a  doctor,  lawyer,  scientist, 
engineer,  fireman,  or  even  a  farmer. 

The  reason,  clearly.  Involves  familiarity  with  what  the  tea^cher 
does        from  personal  experience  and  from  close  observation  of 

i 

the  experiences  of  others.     Virtually  Qvet^fShe  has  attended 
achool  and  therefore  knows  from  personal  experience  what  teachers 
do  and  how,  and  probably  too  with  what  de5^roes  of  adeqi:acy. 
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.There  Is  considerably  more  taystique  surrounding  less  familiar 
occupations,  even  those  that  m^y  require  less  formal  training, 
(An  urban  mother,  for  instance,  would  be  far  more  likely  to 
question  how  a  given  teacher  interacts  with  her  students  than 
what  a'fanner  does  in  growing  his  crops.)    Parents  help  children 
with  their  homework  and  frequently  engage  in  teaching  their 
children  one  thing  or  another.    Therefote,  particularly  for 
the  better  educated  p'arent,  there  is  far  less  of  a  gap  in 
expertise  between  the  general  public  and  other  professions  or 
fields  with  strong  knowledge  or  skill  bases. 

Si:nilarly,  compared  to  fields  with  well  developed  knowledge  and 
.technology  bases  and  highly  specialised  developrent  (e.g,  ^ 
engineering)  activities,   there  does  not  appear  to  be  ouch  of  a 
gap  in  expertise  between  the  R£tD  personnel  who  develop  many  of 
the  learning  materials  on  the  market  and  the  teachers  who  develop 
their  own  materials^  or  even  the  parents  who  peruse  the  materials 
used  by  their  children.     Consequently ^  the  mystique  that  surrounds 
R£tD  in  other  sectors  is  generally  lacking  in  education^  and  a 
Congressman;  or  a  parent^  or  a  school  professional  is  more  likely 
to  question  the  wisdom  of  investing  public  resources  in  a  given 
R£tD  project  in  education  than  in^  let  us  say^  public  healthy  or 
agriculture^  or  aerospace  or  defense. 

Weakness  of  the  Scientific  and  Technological  Base:  Education 
as  Qn  Applied  Social  Scienge  Field 

Th^  weakness  of  the  scientific  and  technological  basp  of  education 
and  ^diic^tional  R/Dul  is  at  the  crux  of  much  of  the  environmental 
v^jlnerability  of  this  sector.     Education  is  particularly  vulner- 
able on  this  J  but  it  shares  much  common  ground  with  the  social 
sciences  and  other  applied  social  science  fields  as  well.  The 
past  thre*^  decades  of  '^big  science/*  clos^^  ties  between  the 
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federal  goirerninent  and  the  scientific  community,  and  enormous 
scientific  a'^.d  technological  progress  have  substantially  rein- 
forced our  society*s  highly  positive  attitudes  toward , science 
and  great  expec tuitions  about  the  benefits  to  be  expected  fron 
the  application  of  science  and  technology  to  any  and  all  ' 
probleTiis-    ^n  the  '60s,  the  i::ystlque  gelnerat-ed  by  the  natural 
sciences  vas  generalized  to  the  social  sciences,  a«i,Jx  vas  ^ 
widely  ass^ned  that  eocial  probleir^  would  be  as  anenable  to 
solution  as  the  naturaT  science  puzzles  unlocked  and  harnessed 
in  the  pre^rious  decades.    The  federal  investment  in  the  social 
Sciences  expanded  considerably,  and  with  it  tbe  investment  in 
such  applied  areas  as  education-     But  by  the  late  '60s,  these 
hign  expectations  eroded  into  disillusionment,^  in  part  because 
the  expectations  based  on  experience  with  the  natural  sciences 
had  been  so  high.     As  a  coa3equence>  we  have  been  seeing  in 
recent  years  intensive  questioning  of  the  wisdom  of  expending 
federal  funds  on  social  research,  or  such  applied  social  areas 
as  educational  r/d^I- 

C.      Weakness  of  the  Scientific  and  Technological  Ease:  ^^^^^ 
Education  as  a  '^Perlvat tve*'  Discipline 

All  fields  with  social  science  knowledge  bases  face  far  greater 
difficulties  in  conducting  research  and  r/D^*!  activities  than 
fields  with  natural  science  bases-    We  consider  some  ofjthese 
difficulties  later  in  this  chapter  when  we  examine  how  environ- 
mental factors  such  as  the  nature  of  the  field's  knowledge  base 
affect  R/D^il  functioning  in  education-     But  what  must  be  under- 
scored here  in  explaining  v/hy  the  ed^jcation  sector  is  particularly 
vulnerable  is  the  weakness  of  the  education  and  educational  R/D&I 
knowledge  and  technology  base,  even  in  comparison  to  oth^r  social 
science  fields-    The  education  knowledge  bAse  is  mde  up  of  areas 
of  jspecialization  that  can  be  called,  at  best>  "deriVaji\ve 
discLplln&s"  (educational  psychology,  educational  socio  logy ^  etc.) > 
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with  (.Vtrak  links  to  the  parent  disciplines.     The  problem  with 

^  J 

deriuativfe  disciplines,  is  that  they  generally  Eail^to  transmit 

the  full  power  of  the  theoretical  paradigms  and  inquiry 

8 

technologies  of  the  pat'ent  disciplines*      Inquiry  in  the  field 
is  not  structured  by  powerful  paradigm.     Consequently,  the 
knowledge  base  is  fragmentary  and  ijpn-cumulative,  and  has 
extensive  gaps.     Research  and  VoStl  methodology  are  weak.  And 
research  and  R^D^tl  personnel  are  trained  inadequately  in 
rigorous  procedures  for  research  design,  instramentdtion,  data 
analysis ,  product  development  'and  testing,  evaluation,  etc*  The 
field  generally  lacks  valid,  reliable  instrumentation  for 
neasurement  and  evaluation       the  most  basic  of*all  requirements" 
for  effective  conduct  of  research  and  R/d&I  activities. 

As  a  result  of  these  problems,  progress  in  educational  R/D5c1  has 
been  slow*     Generally  lacking  are  the  kinds  of  impressive  system 
outputs  that  fegitimate  R/D£(I  activities,  give  a  system  prestige, 
and  generate  sufficient  support  to  guarantee  an  influx  of 
resources*    What  makes  the  system  so  vulnerable  is  not  simply 
the  lack  of  significant  outputs  to  date,  but  the  suspicion^  given 
the  weaknesses  of  the  field's  knowledge  and  technology  base,  that 
the  system  is  unlikely  to  produce  significant  outputs  in  the* 
-future  either       regardless  of  the  si::e  of  the  investment  that 
might  be  rrade'in  the  educational  R/D6tl  system* 


The  /:ature  of  Educational  Innovations 
 (  ?  


^Ain^^  to  thft  vulneraBillty  of  educational  RyD*5eI  is  the  nature  of 
•B^ational  innovations  compared  <to  the  more  technological  outputs  of 
R^D5cI  systens  in  other  sectors*    Technological  products  are  easily 
packagecJ  Instiilled*    Their  use  rarely  conflicts  with  rfflfcvalues, 

attitudes,  and  serftitivities  of  operating  system  personnel The 
products  can  be  ^er-^oectejj  to  behave  reliably  in  accordance  with  tK^r 
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perfonnance  specifications  as  long  as  they  are  used  properly^ 

9 

Educational  innovations,  in  contrasCj  tend  to  involve  "people  ch^nge'\ 
e,g.>  creation  of  new  capabilities  or  organisational  st^rategies  or 
instructional  approaches-    They  are  therefore  more  likely  to  be 
resisted,  by  Che  people  who  make  adoption  decisions  and  those  who  must 
implement  them.    As  *'people-change'*  products,  there  is  far  greater 
reactiveness  between  product  and  users  (both  school  personnel  as 
interciediate  users  and  students  as  end  users)-    This  inCeraation  ' 
between  th^  iunovatlon  itself  and  the  human  element  in  the  imple- 
pentation  process  makss  implenentation  far  more  difficult,  and  effects 
far  less  predictable-     Innovations  of  this  kind  cannp^  be  judged  * 
"successful-  until  the  new  capabilities,  approachetfV  etc .  have  been  ^ 
incorporated  effectively  into  the  d^ily  practice  of  the  user  system 
and  have  had  the  expected  effects  on  the  target  students  as  ead  users- 
The  effects  of  major  innovations,  nay  take  years  to  become  visible 
for  instance>  how  long  does^t  take  to  create  a  humane  learning  environ- 

r       ment,  and  children  who  behave  more  humanely  towards  others?    And  such 
effects  may^  be  far  moire  difficult  to  measure  than,  let  us  say,  the 
effectiveness  of  a  new  engine  design  to  reduce  fuel  consumption,  or  a 

^     ne^  strain  ^of  hybrid  com  for  producing  a  higher  crop  yield-     How  do 
we  know  we  have  created  individuals  who  are  more  "hutnane*'?\  How  do  ,we 
operationalise  and  measure  such  a  goal  >  or  set  performance  specifications 
for  an  innovative  program  to  reorganize  school  learning. environments  to 
a  c  h  i  e  ^re-^:  hL>s;jbj  e  c  t  i  V  e  ? 

"  >■ 

Clearly>  we  have  overdrawn  the  contrast  and  taken  a  particularly 
amorphous  educational  innovation  to  illustrate  our  points     But.  having 
admitted  that,  the  point  we  ajre  trying  to  make  still  seems  valid. 
Educational  innovations  by  their  very  nature  tend  to  be  more  vulnerable 
to  oraticism.    They  are  more  likely  to  come  Into  conflict  with  strongly 
held  attitudes  and  values.    They  are  harder  to  implement  effectively. 
And  evn  if  they  are  effective,  they  are  ha^rder  to  prov^  effective: 
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their  effects  are  harder  to  demonstrate  objectively  and  .are  j^erefore 
more  subject  to  dispute* 

4.      Governance  Structures 

0£  all  the  ^vironmetftal  factors  that  make  the  education  sector 
vulnerable  to  so<tlal  and  political  influence^  the  one  that  has  the 
most  visible  and^direct  effect  on  system  functioning  is  the  governance 
structure  of  education  and  educational  r/D£cI  in  this  country/ 

t 

A-      f^o/ernance  o:  Public  EducaticJn 


School  systems  are  legally  controlled  by  agencies- in  thfeir 
environment.     Both  school  systems  and  educational  R'D^tl  insti- 
tutions axe  largely  dependent  on  these  agencies  for  thei^:  tauding. 
Legal  control  over  the  operating  system  is  vested  in  lay  iJbards 
of  education^  elected  or  appointed  by  ejected  Officials  >  in  each 
/  of  the  17^000  or  so  school  districts  across  the  country.  This 

l#y  control  J  \ts  relationship  to  political  processes ^  and  its 
extreme  decentralisation  are  factors  of  some  consequence.  Although 
professional  {i<e*j  the  Superintendent)  dominance  of  the  lay 
boards  of  education  is  the  rule^  thet^  are  frequent  exceptions. 
And  the  fact  that  the  Superintendent  is  appointed  by  and  account- 
ablV'^to  the  lay  boards  means  that  unless  fhe  Superintendent  iS'a 
person  with  strong  leadership  abilities  and  a  clear^-j^sion  of 
.the  kind  of  education  he  wants  his  district  to  provide ^  community 
pressures  can  have  a  major  impact  on  school  functioning^  espe- 
ciall  y in  natters  involving  controversy  and  strong  feelings 
(e<g,,  bussing  or  education)* 

y 

In  terins  of  formal  governance  structures,  the  educational  system 
In  the  U.S.  is  characterized  by  extreme  decentraulizatlon.  In 
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^   ^       ^        contrast  to  nations  with  highly  centralised  school  systems,  with 

centrally  prescribed  courses ,  tex^b^oks,  and  learning  materials > 
centrally  develop^  examin^Elon  systems,  and  eictensive  monitor- 
\      *        ing  of  school  operations  by  school^rinspectors ,  each  pf  tPfe  17,000 
or  so  local  school  districts  in  this  country  is  largely 
„  autonomous.     Legally,  authority  to  estabc^sn  and,^regulate  schools 
^  in  this  countjfy  is  vested  in  the  governmi^nts  of  the  fifty  States. 

Operational]^,  houevier,  most  decision  makirtg  authority  and 
^  virtTualLy  total  responsibility  for  .running  the  schools  is 

delegated  to  the  Local  EsJiication  Agencies^(LI^s)  .     In  most. states 
the  regulatory  role  of  the  *5i;ate  Educatior/^ency  (SEA)  is 
^in^mal,  and  irhe  monitoring  function  ts  almost  jrK)nexistent.  * 
Decisions  about  curriculmfi^  personnel,  ,l^amir>g  rnat^rials, 
budgets  and  the  like  are  made  locally^^  l/rtre  ai^  excaj^ti^ons 
to  *this  rule        for  Instance,  statewide  textbook  adopt^n  in 
^man^  of  the  steles.    State  agencies  do  perform  some  regulatory 
functions  In  an  attempt  to  insure  minimum  performance  standards 
*■  e.g.i  accreditation  of  educational  institutions' and  certi f icat;4l^|ht 
.of ^teachers /    Sut  for  most  school  districts  in  most  states,  xhe 
role  and  influence  of  the  SEAs'is  difficult  tofrdiscern, --Jhis 
situation  is  beginning  to  change  with  more  and  more  SEAs  ex&T- 
^cising  positive  leadershy)  functions.  ^However,  ^'i^  to^ early 
,   to  a^ses^  the  <ffegree  of  impact  of  this  new/  strong^  SEA  leadership, 
)  .  ^  ^  '        ^  . 

The  Federal  role  in  educ'btion  has  become  prominent  sijic^  the  '*» 
%  *       early  IBOs  with  the  infusion  of  large  ^ums  of  new  Federal  money 

for  specified  purposes  (e.g.,  ESE?t  Title'  I  apd  ^itle  III  funds). 
Hove^er,"  ev^n  iJhen  Faderal  funds  were  disbursed  pr^suriably  to 
b,e  spent  in  accord  with^Fj^deral  guidelines,  it  was  not  uncommon 
to  find^LEAs  ignoring  tjfi?  guidelines  and  spending  the  money  in 
a  manner  that  flagrantly  violated  the  guidelines  and'^the  FederalV 
intent.    And  u^til  recently,  there  was  littfle  Federaweffort  to 
sue  for  retur^^j^f  misspent  funds- 


^  -  < 
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Public"  school  decLSionizia^^ng  ^  decentralized,  then,  v^en  ^ 
analyzed  irr  fierrs  of  general^LEA^erating  autonomy  /rem  State 
ftr  Sederal  authorities,    tn  operational  tertns  ^  decentraliza- 
tion  , tends  to  go  considerably  beyond  the*  decis ionnaking 
autonony  of  the  LEAs.    Within  each  district,  there  is  considerable 
aUtonony  at  the  school  building  levels  in  the  hands  x>£  principals 
and  also  the  teachers,  who*  in  most-schobls  have  a  great  deal  of 
leeway  in  d^ermining  what  happens  in  their  classrooms  despite 
^the  hierarchical,  bureaucratic  organization  o^  sctapol  ^administra- 
tion.    This  degree  of  autonomy  down  to  the  school  and  classroom 
l^vel  is  a  factpr  of  considerable  inportance  i^;^^|j|^la(Lning  why 
innovations  thaf         formally  adopted  by  a  school  district  are 
so  often  not  implemented  in  practice^  or  are  so  transforaed  during 
^  impler^entation  that  they  amount  to  little  more  than  "the  same 

.  'Old  thing. "^"^    Given  *tie  extreme  decentralization  of  decision- 
.  making  in  Che  system,  and  the  extreme  sensitivity  school  per- 
sonnel  demonatrate  to  even  the  possibility  jpf  community  criticism, 
,  en7lronmental  influences  continually  intrude  on  school  system 

*'       "      ^    decisionmaking       not  just  once  at  the  official  school  board 
^  level  'but  a^aln  at*the  level  of\he  school  administration  and 

^  again  at  the  cl^sroom  level  as  well. 

-   \  .  ■         ^  : 

■  B.      Governance  y  Educatiorial  r/D^1  /  ,  ^  i 

Unlike* the  operational  system  of  public  education^  the  educational 
f        ^       •     R/D^il  system  is  not  a  "system"  in  the  sense  of  being  an  integrated^ 
coordinated* set  of  easily  definab^e^  boun^ab-le  upxt^  governed  by  a 
specific  set  of  Authorities  i^ho^'lnake  ^olici^>  rules  ^  and  the  likp 
•  that  are  in  turn  carried  out  by  all  units  of  the  system-     (tSven  in 
,      the  case  of  th^.  operational  system  ^ -this  definition ''is  more  true  on 
pap^r  than  in  r^^^llty.)    As  we  shall  see  in  a  later  chapter  when  w4 
^consider  the  institutional  configuration  of  wl^t  we  have_  been  calling 
the  system,  the  units  that  make  up  the  educational  p/D&I  system  tend 

* 

o 

ERIC 


to  be  highly  autononious  in  teins  of  their  R/DSI  purposes  and 
activities!;  To  whatc^^e-r  extent  the  system  is  "governed'^  or  even 
"[uanaged'^j   that  governance  is  a  cortcomitant  of  funding  the 
sponsors  of  educational  r/DSI  ca^Cand  pften  do)  tell  contrac-  ""'^ 
tors  or  grantees  vhat  they  can  Cagjd,  presaT^ably  but  not  always 
in  fact>  cfepnot)  do  with  the  sponsor's  money>  and  occasionally 
hov  to  proceed  as  well  as  what  to  produce.    However>  even  within 
the  Federal  goveriiinent>  as  we  shall  see  in  our  chapter  on  funding, 
there  are  a  large  nunber  o£*agerLcies  that,  function  as  eclucattional 
-R/p^l  sponsor^^   ^-nd>  neither  NIE  (which  was  created  to  have  ke^^. 
rSiponsibility  for  f ederallv-SDOnsored  educational  R/DSI)  nor 
OE  (vhich  has  thi*  largest,  cHunk  o:  th-£  available  money  for  funding 
educational  R/D&I)  have  functioned"  as  yet  as  lead  agencies  to  ' 
coordinate  --^much  less  attempt  ^any  governance  of  educational"' 

k 

The  ^systeui,  then>  Is  onet  that  Is  largely  ungoverned^  not  unlike 
r/D6I  systems  in  othea^  sectors .    The  problrem  here>.  hoVevjer  ^  is 
-that  ther^  are  no  strong  interiial  ^Ejvsrnance  mechanisms  lor  the 
f/eld>  such  as  a  strong  professional  associai:ion  that  can  regu- 
late, or  at  le^t  set  standards  /or,  the '  functioning  of  th^  t^eld. 

^    '      7     *         ■  ' 

In  a  different  sense  Ci^e^>  in  the  sence  of  lin^uence  over  rather 

W  ^ 

than  formal  govenjance  of  the  field)  the  Congtfess>  as  the  source 

*  *'  '  *  " 

of  most  educational  R/D&I  funds>  is  certSli^^  a  key  element  ip 

tfie  governance  of  the  edtldational  r/D6I  system'     Given  the  Con-  * 

sres9'  lack  of  confidence  in  ihe  ability  of  educational  K/Dltl 

{.0  provide  a  reasorrable  return  on  the  taxpayers'  investrnent>  t^^is 

ha^  :T;eant  almost  constant  troubles  for  Che  educational  R/D6I 

systejj  until  the^past  year  or  so  in  vhlch;  ^s  discussed  *in  a 

prevLoOs  cbapter>  there  has  beep  an  apparent  truce  between 

Conj^ross  and  NIE/OE. 


I 


r 


Lconoaic  rorces 


£couo^i*^  forces  in  the'  environnent  of  the  operating  and  R^D£fI 
system^  in  the  education  sect^' have  been  felt  particularly  severely 
in  recent:  years.    On  Ch^State^hnd  local  level ,  school  system  func- 
tioning has  become  one  or'^hg  paramount  Ts'sues  of  the  day  as  we  find 

easing  nuiiibers  of  State  ^nd  local  communities  struggling  Over  ^ 
equitable  .  financing  fo.rTau1aSj  S^tes  "  butt  ing  assist;anca  to  local 
districts  as  thev  struggle  with  theii^^^  " financ ial  dif f iculties  ^  and 
voters  in  local  districts  defeating  school  budgets  and  bond  issues  in  ^ 
an  effort  to  stave  off  further  increases  in  local  taxes.  Econorr^ic 
recession  has  .also  tneant  a  shortage  of  alack  resources  in  the  private 
sector  to  Invest  In  high  rlsk^'lov  return  R/D£fl  activities 


6.     SuDOorts/  Deniands,  and  Cfenstituencies 

^  ] 

In  sammaryj  we  can  characterize  the^environment  pf  the  education  Sector 
|**^as  on|  that  is  weak  in  supports  for  \^  system  and  assertive  in  demands 
about  what  can  Or  cannot ybe  dona,  what  should  or  should  not  be  done, 
RiD  in  ^education  lacks  prestige  or  legitimacy^  or  ev^n  a  demand  for  \ 
tj^  i^s  products  or  its  very  a^stence .    Thi&  is  apparent  whetHS^  we  focus 
on  the  attitudes  of  resear^cbers  and  scholars  in  the  disciplin 
educatlor^al  practitioners,  laymen^  membena' of  Congress^  or  even  the 


educational  research  and  R6sD  cotj^rninitles,  ^  The  system  has  developed  no 
constitijency  pf  its  own  and  is  J>uffeted  by  ^i*be  initiatives  of  various 
other^  constituencies  able  t<o  art iculat^ demands  reflecting  broad 
^oc*t1il ,  cultural  J  and  political  moveu^e'ntt  {e»g.  ^  demnds  for  programs 
in  black  history  or  for  mat||Fials  that  present'nore  positive  imges 
or^blac/s,  /ilspanic*Ane  iTcans ,  ^^atlve  ^^eric^ars,  white  ethnic  groups, 
woneji,  etc  . ) .  *  , 

/ 
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II.     }n:  E.NviRd>r>Ei-rrAL  r>TiUE:N'CES  affect  svstfm  Fu,\-ctio:;i:>-g 

The  envlronrenr  o:   Lh^^od>acation  sector  affects  virtually  everv  feature 
^  cf^^tne  R'Diil  systea.     It  affects  the  deiLriLtLon  of  gosls^  ne^dsj  policies^ 

ar-d  s^ratez;ies.    -It  sffectj  the^  kinds,   levels,  and  q^jallty  of  ir.piits 
that  fl'^v  iuKg  the  systen.     Environmental  influences  csn  sven  1:5  seen  in 
th^  coTjd'^ct  of  varioiiS  syst^n  functions,     i>e  consider  each  of  these  areas 
of  enVLronm^TfCal  infliience  briefly. 


ErJc 


1.     Definitbop  of  Goals  and  .'seds^  '^^hat  vill  be  studi^t^^    Wrat  viill  be  furded^ 


Several  "rrirt^rs  --^^7  have  dlscss^d  tre  definition  o^^oals  and  .needs 


,  in  the  €:duc^tior[  sector  have  corrnented  pn  the  tension  ^e^ve^n  de'"arids 

o:  the  disciDlin^s  and  fields  of  knowledge,  on  the  one  har.d,  and  demands 
^  0:  ^he  client  system  and  society,  on  the  other.     In  selecTi-^.^  topics 

fo-r  resea,rch  or  ^^J)  activities,  for  instance,  the  researcher  is  affected 
^  by  his  own  interests  >  which  are  in  turn  affected  by  the  psrticJ^lar  disci- 
plines ^n  ^?hich  h0  has  been  trained  and  socialized,  by  the  differential 
^        prestige  re  perceives  to  be  attached  to  particular  dlsciplins;s  and  types 
of  work  J  by  his  coHe^^g^es  and  the  research  subcultures  in  which  they 
function^  and  by  the  particular  institution(s)   in  which  he  vorks.     But, he 
Is  also  affected  by  the  desires  of  clients  or  sponsors  wh^are  villing 
to  fund  specif^ic  kl^nds  of  research,  or  'P/D^^I  a^:tivities  that  are  congruent 
vlth  their  interests  ^r  perceived  needs.  "  j 

Tn  educational  R"*D^fr,  clients  and  'spotisors  tend  overvhelr^ingly  :o  be 
^ot^ rnTe'iral  agencies  --  Federal  a^enc ies  ,  SEAsr ,  and  Li/s .     Consequently  , 
soc  ial 'poH  t  ical  r^ovenents  affect  their  operation's,  their  definition  of 
^oais  **and  their  perceptii^s  of  pro^ra^n  and  product  nee^s      In  the  late 
*^jOs.  af^er  the,  polirt  ica  T  shock^f  tjie^^vie^  launching  of  Sputnik  I  set 
^         in,  oro/rap  and  product  demands   focused  on  the  pursuit  of  ey.cel  1  encje^nd 
'i^\;f^lop,renS  of  the  abilities  of  the  gifted,  especially  in^the  sciences  | 
and  nathenntics  .   ^     Even  rrore  RirKg^feant  i^l  ^va/nping  of  school  p^licies^ 
:>ro^r'i'^<5 ,  sCaffin;^,  ad-^inls  t  rat  ion ,  and  learnTni;  m^i^rials  in  the  past 


r  -  ■  ' 

two  decaies  is  :rsc^!SDie  co  sjch  Sr^ad  social  and ^ political  environ:T\ental 
influences  as  Che  Suprferr.e  Court's  school,  de^se^egatlon  dec  is  ions  and 
Federal  court,  orders  sinc^  1954,   the  poverty  ^gjrogram  focus  on  the  economical- 
ly disadvantaged  in  th?  '60s,  and  thj^^j^ssertive  ethnic  and  other  *'mi»^orl- 
-ties"  movements  of  recent  years.     As  a  result^  the  study  of  vario-js 
^j^^^^^flfegacion  strategies ,  their  inplepentat  ion,  their  inipdcc  on  student 
attitude^  and  achieve^^ent,  and  their  social ,  political  >  and  denogr^ipriic 
effects  has  erer^^^'s  an  active  research  area.     And  too,  developne.pt  of 
h".7ar>  relations  orogra-^.Sj  crisis  prevention  progrars,  and  the  like  have 
becoT^fe  th-ir  focus  o:  a  specialized  srea  of  M^veloo^ent  vork.     Des  i'^n  and 
evaluation  o:  progra^-S'  for  :he  di sad /a" taged  (e.7.-  Title  I  *  ESHA  programs) 
and  of  r^ateriqls  focused  on  various  riinorities  (e.g.:  bilingual  materials, 
material's  concerned  -  about  add  'or  for  At  ro- Americans  ,  Kis pa nic-.taer leans  , 
Native  Americans,  and  other  groups,  anti^sexist  na^erials,  etc.)  have       '  ^ 
b fee  one  boorsing  Indus  t  ries . 

N'ot  only  are  -ser  systen  oper^^:ions  and  therefore  prograTr*  ajid  product 
needs  affected  by  the'se  sociaJL  and  political  fJhrces  in  the  broad  envlron- 
nen:  of  e:^icationaI      DaT;  even  the  researchers*  ovn  iiiterests  and 
pr.ed i lec ti o\c^(iS  are  affe,cted  by  these  broad  movements.     Issues  of  race  and 
poverty,   fo^  Instance,  have  been  particularly  intriguing  to  researchers, 
vho*  b^r^y^pol  it  icil  conscious  and  politicaUy  sociali^^ed  during  the  '50s 
^ind  *60s.     A  nurber  of  analysts  have  fioted  th&  predominantly  liberal 
and  Democratic  Party  leanings^of  rrost  social  scientists^   includ In^^duca- 
tional  R'D^I  oersonn^l,  ^Therefore,  in  deternining  what  research  or  R^D^I  ^ 
activities  he  viU.,p.:*sue  A  the  res>?archer  isr^affected  by  the  intellectual  '  ' 

prqile'r^s  a-^.d  Research  s f.:b'cul tures  of  the  disciplines  in  which  he  has 
'**-tr"  trai'^eJ  ar'^  ioc :  ai  I     i ,  his  ;jvn  p-li:ic^I  and  social  or  it^nt^tion^  and 
<i'^n<i  it  ivi  t  ies     and  Cne  priorities  defined  by  ed'icational  R^D^  clients 
an  i  spons^r^i^       *  "  "  ,   '  ^ 

Or.'^  fu'rt^^r,  ^^ve^  -^^t^  dlcectlv  Dt^Mcic^l  l^iflu^ncc-  should  bp  notod. 
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Political  in  Wasr i^^t on  "isve  Sad  a  ^ajor  effect  on  educational 

.  research  apd  R  'D£il  spo'nsorshiD,     Political  support  for  educat  ionsl  R        ,  \ 
for  instance^  peaked  durini;  Lyndon  Johnson's  Great  Society  years,  and 
dropped  off  si-bstantiallv  during         ^Mxan-i^ord  period.    To  take  anortb'er 
exanple,   foundation  support  for  social  reform  initiatives  was  also  quite 
con^nk^rabls  during^  the  '60s,  and  (dropped  ofr  substantially  after  that 
in  pare,  it  would  see^^,  because  l^rge  SDonsors  such  as  the  Ford  ^c^un^auion 
ca^e.to  See  theoselvea  as  havin;  been  '^burned*'  by  icvolvenent  i^^  hot 
:?olitical  issues  such  as  school  decentralizatiorL;  b-jt  also,  in  pa'rt, 
becau'i^f  o:  t.h%*'pc)li:ical  threat  :o         fc'jr,da t ions  *  ta>:-e7:c"^p t  s t a tus 
rrobllized  by  opoonents  of  son^e  of  these  r4*fpm  initiatives  funded  by  t"^.e 
foundatio^.s  ,     Clearly,  then  educational  R^D£;I  "funding  is  as  inuch  if  not 
more  affected  by  broad  pplitical  forces  in  the  system^s  envlfronr^ent  as  by 
any  internal  systen^developnents  or  internally  defined  needs  or  plans, 

2,     The  Personnel  Pool  ^ 

The  effect  of  *ifin7lroar;ental  influences  on  such  systen  inputs  as  funding, 
then,  is  obvious.     Perhaps  les3  apparent,  though  no  less  critical,  is  th^ 
^effect  of  en^irorj-^ental  i nf luencess'on  the  personnel  pool  available  to' r^eet 
sysc ei^  needs ,     We  have  comented  in''several  chapters  on  the  relatively  lov 
f^r^^stige  of'  educaCional  ?/Dixl  and  hov  this,affecLs  the  system's  ability  to 
attract  high  calibre  persopnel  to.tb^fi^ld.    The  lov  i^stig^of  the  field 
tendn  to  discourag*^  capable  social'  scientists  or  established  researchers 
from  other  fi^l^fron  joining  R^D'6I  ins ti^tut ions  or  projects  In  the  eduoatixjn 
sector,     r.ilenteU  st*ti(ients  deciding  ^xi  future  career  opportunities  are 
diverted'  fron  pos^lble^  interest  ir^  ed^Jcatton  Oo  work  in  other  ^PU  systens- 
th^t  have  '^rore  vr^s^il^  a'^d  ereein'  tp  arver  better  chances  fo-r  sie^nificant 
^chLe7PTT^ent  ^nd  re^o^ni  t  Ton  f  roD/JEheflty*rG  &^encq^  group.     The  pr^^tige  ^per-- 
'^onnel  probleH"  i'vdif  ticutt'''to  s^l^? -  ri^^^e^  the  r^evant  factorsT^r'^ 
i''-n:£>rrelnre"^J  in' a  Vicf  ^us  .  c^rc     *  tht*  l/>w  pr^stj^^"^of  the  field  nakes  ,Lt 


176 


hard  for  educational  R'Dc^I  to  attract  talented  pers'&nnel,  and  vith^ut 
an  adequate  supply  o:  talented  personnel  the  field  is  less  likely  to 
pnJdace  the  impressive  achievements  that  will  raise  its  prestige**  Until 
the  en^iro-^ment  of  the  -^^ijcjtional  R^D^I  syster^  becomes  nore  favorable 
and  more  supportive  of  system  f unct-ioning,  persdnnel  problems  are  likely 
to  r'enaiTi  a?  critical  barriers  to  significant  achievement. 

3.    The  Conduct  of^esearch 


'Various  o^.^r  aspects  of  syste:?  functioning  are  affected  by  envixonc^ental 
influences        by  the  nature  of  the  field's  kn3wledge  and  technology  base, 
and  by  its  orinipresent  political  and  social^uInerabiVity.-    As  a  field^ 
with  a  social  science  knowledge  base,  ^eveloped  through  study  of  hutnaas 
rather  than  non-humans,  the  conduct  of  educatidnal  research  and  R^&il  ^ 
must  frequently  face  questions  of  values  (e,g.^  what  should  b^  studied  and 
hov)  ,  ethics*  ''e.g.^  how  to  safeguard  the  rights  of  those  studied),  and 
reliabilitv  fe.g.^  ho'«^  to  Insure  that  bindings  are  notv-unduly  influenced 
by  bla,<ing  factors).     These  questions  are  far  rnore  intrusive  and  problem-- 
atic  in^social  science  fields  than  in  areas  of  knowledge  based  on  the 
natural  sciences  and  on  the  stud/  of  inanimate  "or  animate  but  non-hu^ein 
subjwts. 

V  ■  I 

The  values  and  ethics  issues  are  fairly  ob^rious,  and  have  prod^i^ced  various 
legisl^tire  end  adniirastrati'^e  ^f  eguards  to  protect  r^earch  subjects 
a^inst  unv;5rran,ted  Intrusions  on  their  physical  or  emotional  well-being,  ^ 
their  privacy,  or  their  tin?e.    ^Consequently,  in  the  condu^ct^  of  their  worli, 
ro^^^^rchz'Vs  hav^*  t:?  c:^*ply  vith  carton  ciir^bers^~e  Torres  clearance  proce^iurVs 
and  att'indant  delays  in  be^innin^^  dsta  collection;  they  hav.e  to  insure  , 
subj'^^ct.s  0^  Che  confidentiality  of  their  Responses  and  indicate  to  them 
th^r  th^>/  ^ire  not  required  to  provide  certain  kinds  of  information  unless, 
they  so  ch:^^s^  thev  nnst  prc^id^  dt'scriptlons  of  planned  ri^asures  to 
psotect  the  cW^f  id^rtti^l  ity  of  resp.^ns^^s;   thf'y  must  b*^  prepared  to  have 
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rerCai.n  research  ap^roacnes  or  q^jestionnaire  or  Interview  items  or  data 
rrinagerre'^t  proce  J  ..r%^  ^r- jected  by  clearance  officials  as  unethical  or 
unacceptable  on  privacy  confi-dentlality  tlr'=^  burien^'etc,  grounds. 

The  reliability  issues  are  less  obvious  but  evfen  more  troublesonie  beca'Jse 
of  the  co-^s iderable  amount  of  uncertainty  they  introduce  into  the  research 
situatlj-^.     Unlike  recks  or  molecules^  the  humans  studied  in  social  science- 
based  research  have  and  exercise  free  will.     In  ansverir.g  questionnaire 
or  intervi--'.^  iter.s,  they  ^ay  lie^  trey  niay  misinterpret  q^stions,  they 
--av  have  difiere-^t  views  on  a  given  subject  fron  day  to  day>  their  responses 
^i-'.ot  b-  s  Lgr .  I  leant  I V  ifceeted  b    wording  or  bv  reactions  to  the  in::er- 

viewer  asking  a  questlonj  etc.     An^  givt^n  th^-  vai^ue-laden  nature  of  what 

13 

is  generally  studied  in  sec lal-science-based  research,      there  is  a 
greater  likelihood  t^an  in  the  natural  sciences  for  bias  to  creep  in  through 
tie  if^searcher-*  s  own  predilections,  or  through  the  quality  of  the  interac- 
tiVn  between  researcher  and  subject.     Experirental  designs  calling  for 
rarfcoTTiisation  or  various  kinds  of  r^igorous  controls  are  also  less  feasible 
with'^^^anSj  especially  in  field  settings  as  opposed  to  laboratory  research, 
Conse<^ently,  the  procedures  for  conducting  research  in  social-science- " 
based   fields  n^ist  constantly  take  reliability  problenis  into  account  --  in 
the  ways  instrurrents  are  designed  and  administered;  In  such  precautions 
as  rTtatchlng.  Interviewers  and  subjects  wherever  possible  by  race,  sex, 
a:^t|back^round ,  etc:  in  research  designs;   i(t*data  analysis  techniques; 
in  reporting  conventions:  etc, 

f  "  * 

Research  Outputs  and  Length  Tand  Costs)  of  R^D  Cycles 

Co'^pared  to"  the  natural  sciences,   social  science  research  tends  to  involve 
far  rore  field  j^ese^cn  and  proportionally  much  less  laboratory  res^arch^ 
r !  e !d*  research  tends  to  be  more  ton^plex  than  laboratory  research-  it 
;;-ner il ^ anvol ves  irany  rore  variables  and  r^uch  le^s  control,*  Therefore, 
it  j^' (^i^^-ra  11 7  TlUcK  ^ressier,  its  results  are  harder  to  replicate,  anrf 
tnj^*q  u  H  t  y ,  cnrniletive  knowledge  base  develops  slowly  i  /  at  all. 
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The  ^social  science  nature  of  th^  field's  kn:iwledge  base,   then,   ir  and 
of  itself  inhibits  the  svste'^/s  rapid  develop-^^nt  aad  cprr^plicates 
R'D^il  functioning.    And  beyond  ^at^  the  weakness  of  this  particular 
social  science  knowledge  base^   the  educational  R^D^^I  kno'^ledge  and  t^^ch- 
nology  base,  severly  constrai-ris  ti\e  per-dollar  payoff  to  be  expected 
from  investing  in  R/D&I  in  the  edi-cation  sector.    The  large  gaps  in  the 
available  kndwledge  base,  and  therefore  the- large  nurber  of  unkno-^ns  in 
nanv  research  probl^tns  and  the  inadequacies  of  existing  research  tech- 
nologles  for  filling  rr-any  of  those  gaps  rake  nore  diffic-jlt  the  trans- 
formations between  R'DiiZ  stages        e.g.  -  fron  research  to  design^  fron  ^ 
d':'Sii5n  to  developrsent ,   from  development  and  testing  to  refirLerent,  frcn 
product  refineruenc  5o  <^i^ ser^inat ion ,  acquisitionj  and  isrpleyrentation. 
Consequently^  conpared  to  R^!36Its^steris  vith  :;ell  developed  knowledge  and 
technology  bsses/         more  research  is  J-ikely  to  be  needed  in  education 
^  prior  to  or  during  the  design  and  development  stages^  and  more  iteilations 
of  the  development  cycle  are  likely  to  be  needed  as  nore  and  mere  is 
learti^d  fron  each  field  test  about  weaknesses  In  the  p roduct '^design. 
Where  r^ore  resources  need  to  be  allocated  to  the  research  and  developr:ent 
phases  prior  to  production  and  distribution,  there* is  relatively  less 
Dayoff  per  dollar  invested  in  a  given  product, 

5.     Defining  Research  Problens  and  Planning  Research. Strategies 

The  ."-weakness  of  the  field's  knowledge  and  technology  basej  therefore,  nay 

dls^o'irage  Invi^stri^ent  in  ed-jcational  R'D^il  program  or  product  development 

/^s*  too  co?tly  for  the  potential  benefits  to  be  expected.     This  weakness 

also  makes  i  t  "more,  di  f  f  i  cul  t  for  researchers  or  R^iD  personnel  Jo  define*^ 

research  or  develop-nent  probler^  and  plan  hfew  to  attack  it.     There'  has 

:>een  50T?e  d lscu3<> i on ^n  che  U t era t'-ir*^  of  hoV  inadequately  educational 

rrs^^rch'^rs  define  research  problers        ho"-j  little  grasp  educational 

r osei rch'^r *^  ^e^:?  to  hav**  o:  what  a  research  problem  is,   or  how  to  dtfijne 

:t  in  ^  wav  that  nak^s  It  researcharle  giten  the  existing  knowl'^dge  and 

r  f'Ch  nolo^v  b.is^      Kducat  lO'^al  researchers  tend  to  confuse  t^^e  5  i^^i-f  ^^^^"^^^ 

1 
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01  a  proble:^  codic  wlch  the  research  probleri  itself;  or  frequently  they 
confuse  th^  research  probleni  %'ith  thsir  objectives  or  the  steps  they 
intend  to  follow.    The  importance  of  being  able  to  define  researchabie 
problems  cannot  be  overrated  as  a  prerequisite  to  engineering  a  solution. 
By  analogy  to  a  hypothetical  aerospace  situation,  once  the  problem  is 
deflneJ  in  terms  of  ten  specific  questions  to  be  answered,  the  probjen  - 
can  be  solved  and  the  rocket  will  be  la-jnched,  or  the  failure  of  an 
operating  system  will  be  -  correct  ed  ,     In  education,  however,  researchers'' 
jre  unable-  to  specify  the  -ques^tions  to  be  answered  in  so  rigorous  a  manner 
iDartiy  because  there  are  so  r^any  unknojps  and  partly  becat-ise  educational 
researchers  are  rarely  '.;eil  trained  in  defining  research  problens  in 
relation  to  knowns  and  unknowns  in  the  field's  knowledge  and  technology 
oase. 

'6/   Social  and  Political  Vulnerability 

w'e  need  not  belabor  the  point  further.     The  nature  and  weakness  of  the 
field's  knowledge  and  technology  base  are  at  the  cruic  of  many  of  the  opera 
ting  problems  of  the  educational  R'Dc*I  system.     Equally  critical  in  ex-* 
Dlaining  many  of  the  system's  operating  problems  Is  the  field^s  social  and 
political  vulnerability  to  environmental  influence.     This  vulnerability  is 
^Ident^   for  instance,  in  how  subject  the  system  has  been  to  political  in- 
fluence       e.g.:   In  giving  In  to  pressures  for  progratns  oriented  to  lr:3::e- 
dlate  results  rather  than  long-term  planning  and  more  gradual  development 
of  solutrlDns;   in  focusing  resource  allocations  overwhelmingly  on  developin 
-Gnd  implerenting  programs  rather  than-^on  building  the  system's  resources  a 
capabilities;  and  in  creating  a  large  network  of  laboratories  and  centers 
icr^ss  th^  co'intrv  to  s^Ci^^fy  re^^ional  oolltical  Interests,   rathe*r  than 
c  r'^a t  ini^^nly  a  few  institutions  eou^l  in  number  to  the  e?:i5^ing  critical 
masses  of  talent  in-  tha  field;  etc-     Had  the  field  been  able  to  resist 
thes*;?  piflitical  influences  end  created  a  smaller  educational  R^D^I  system, 
staffed  by  taferte^i  manpower;  investin;^  a  considerable  portion  of  ^vailabl 
rcs.7'irces        c ^oahi  1  i t bui Idin^  activities,   long-term  planning,  and  lon^* 
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rapge  R^cD  work,  tnor^  significant  achie'^enents  night  havc  been  produced  at 
a  lower  cos:  in  zr^llars  and  in  the  syster^^'s  already  inadequate  reserve  of 
prestige,  ^ 

This  socia?  and  political  vulnerability  of  the  education  sector  is  especial- 
ly evident  in  user  systen  acquisition  decisionmaking,  where  we  see  the 
behavior  of  operating  system  personnel  in  seeking  out,  accepting,  or 
rejecting  externally  developed  innovations  influenced  as  much  by  external- 
ly deflritrd  needs  a'^.d  perceptions  of^^^-^cnnunity  sensitivities  as  by  the 
Inher^jnt  merits  o:  a  particular  product  or  program. 

The  syste^^'s  vulnerability  is  also  apparent  fron  the  l-^gitirr^cy  and  credl- 

bllity  oroblens  frequently  ^countered  by  educational  R'D'^I  ptrsonn^U 

Rather  than  seeing  educatior^al  researchers  or  R£icD  personnel  as  working  for 

their  benefit,  menbers  of  the  black  community,   for  instance^  have  cone  to 

be  suspicious  of  the  numerous  studies  and  projects^onducted  by  white 

researchers  in  the  black  cotnnunity^  presumably  for  the  benefit  of  the  black 
*- 

connunity,     T|^e  argurnent  has  been  nade  frequently  that  bl^ck  residents  ^ve 
generously  of  their  tiire  and  insights,  white  researchers  publish  their 
st'jdics  to  the  benefit  of  their  careers,  and  then  tHey  go  on  to  other  work, 
leaving  the  black  cor^nunity  in  no  better  position  than  before.     As  a 
consequence,  black  residents  or  leaders  in  some  cornnunLties  have  refused 
to  cocjperate  with  white  researchers,  or  have  demanded  to  be  paid  for  their 
ti-e  and  assistance  as^  a  precondition  for  participation,  ^ 

/ 

7,     L^cV        a  Strong' Constituency  of  P<r^erful  Agency  Advocate 

*- 

'.'.r  per'-^^r^s  tYi^  rro3t  serious  difficulty  resulting  from  the  s^teni's  prestige, 

",     . t i-^c / ,   ^n-J  cf  jCIr,ili:y  problers  is  its  ina'^ility       develop  a  *6ub- 
I 

st-,r'-:':l  constituency  of  its  own,  to  function  as  a  counterweight  to  those 

/; ro'^^^-n-'il   in:!\encj:^s  that  weaken  s/sten  effectiveness.     Neither  the 
-r-^f.;5rr-  ^ 'ir^-^ ; - 1 1 V  In  i^i'-r^ral  nor  the  educational  research  and  R^U^l  com- 
"^j^lty  i^^  rartic'jlar  has  '^een  vocil  or  activ-?  in  generating  support  for 
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e'Jucational  R'Dod  or  blunting  the  posLtLons  argu^sd  by  the  system's  detrac- 
tors and  oppoT^tr.ts.     Despite  AERA  discus^^ions  aro^ut  ^he  need^for  the  ^ 
field  to  gaLn  rore  l.-^fluenc^  over  jits  a^^enda  and  dir^sctions     ,  little 
has  be^n  do^.e  to  structure  the  field  in  a  manner  that  could  bring  about 
this  goal.    So  th^  field  reinains  buffeted  by  external  forces  agendas 
regain  deterriined  largely  by  Federal  agency  o£fi*cials  influenced  by  ad- 
visor?^  th^y  select,  and  by  social  anc^political  forces  too  pc5werful  to 
resist  or  dilute,    .\?.?Jk  has  in  the  past  couple  , of  years  tried  to  organize 
so^e  political  liaisdn  groups  of  ics  fnenbers " '^ho  volunte/r  essentially **to 
l:>:^by  on  behalf  of  the  interests  of  the  educational  reseUrcb  conriunity  as 

f-^^y  perceive  these  interests.     As  yet,  hove^'^er,  it  is  tooSyearly  to  note, 

^  '  V  "is  ^  . 

a r.v  d Lsct^rnL'^le  i nr^usncs  f ro::^  this  lobbvins - 


Richard  Dershimer,  in  his  history  o£  federal  involvement  in , educational 

16 

B.&L>  in  the  '60s  and  early  '70$,      has  argued  that  traditional  notions  of 
political  constituencies  as  po:^erful  influences  on  what  happens  in  Washing- 
ton are  nis";caken  when  one  looks  at  such  area*s  as  educational  R6<D.  Instead, 
he  argues,  relatively  sr:all  numbers  of  agency  but'eauctats  committed  to 
certain  programs  or  goals  are  generally  the  determining  influences  on 
yhat  policies  are  p^jt  into  effect  ^or  at  least  were  In  the  1950s)  even 
when  no  pol it ical ■ constituencies  "out  there"  express  an^  Interest  or 
exert  any  pressure.    That^ray  in  fact  be  a  -valid  picture  of  the  Washington 
reality.     But  if  so^*  it  simply  underscores  how  weak  the  leadership  from 
r^TE  has  been,  or  01  between  sa^l968  and  1972,  in  behalf  <Sf  the  interests 
of  the  educational  research  ajft]  RM)  communities-  *- 

In  addition  to  the  lack  of  a  strong  research ' R(SD  community  constituency 
or  pbwerf'jl  a;^ency  advocates  for  educational  R/D5tl,  school  personnel  have 
tended  tn  5r,ow  relatively  little  interest  in  nost  of.ltne  outp'^ts  of  exter- 
nal R^D^^T.     Consequently,  there  is  limited  demand-for  system  outputs, 
narketin'^  problems  ^r^  enormous,  and  the  political  clout  that  could  be 
nM3ter^>d  Sy  numerous  education  interest  groups  Is  not  exercised  in  behalf 
of  the     'D':^f  jrysttra.  .  '  ^     *  ^ 
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8 .     S  un^3  r  V 

In  all,  then,  enviVonrfienta  1  influe^ices  on  educational  R/D^I  are  enonnouSj 
aTld  must  be  taken  into  account  .as  serious  (JronsCraints  on  the  feasibility 
of  options  and  strategies  that  might  be  considered  for  ruanaging  and  en- 
hancing the  functioning  of  this  R/D6I  system.     Given  *the  low  prestige*^ 
legitimacy^  and  credibility  of  the  field,  the  general  lack  of  confidence 
in  its  ability  to  achieve*  anything  significant,  and  the  Uck  of  any  sub- 
stantial constituency  to  assert  the  system's  interests,  it  may  be  d^fficjjlt 
to  nust^r  significant  support  for  policy  options  or  mana^enent  strategies 
that  require  exaarided  r^^saurces,  or  that  significantly  shift  resource  al-  * 
locations  from  direct  program  and  product  de^^^pm^it^categories  to  sys- 
tem capability-building  activities* 

t 

Given 'the  vicious  circle  of  interrelationships  between  low  prestige  and 
limited  attractiveness  to  first-rate  minds,  personnel  problems  may  remain 
critical  barriers  to  significant  *%ttiievement  unless  specific  plans  for 
overcoming  this  ve^akness  are  included  in  wnatever  policies  or  management^ 
.strategies  are  developed* 

\ 

Given  the  extrene  vulnerability  of  tt^e  system  t</^oci^l  and  political  in- 
fluence,  thfi  feasibility  of  particular  K(P  or  KU  options  will  always  have 
to assessed  in  relation  to  social  and  political  forces,  thoseWikely  to 
^^ufiport  an<l4(|ho&e  likely  to  oppose  a  specific  pri^ptsed  action*     And  too^ 
stVaJ;e^es  involving  the  desi^  of  particular  innovations  and  the  mam|e^t  in 
whicy  the-/ are  disseminated  or  marketed  need  to  take  possible  sources  of 
opposition  or  difficulty  into  account  and  plan  accordingly* 

s  t ra tegy^developnent  must  cons  ider  such  environmental  inf  I'jences  '  aa  th^ 
natijrc  of  educational  innovations,  the  nature  of  the  cducati^al  knowledge 
ani  technolofjy  b^se,  the  current  underdeveloped  state  of  that  knowledge" 
^nd  t^chnol^ogy  base,  and  the  governance  structure  of  the  education  sector, 
Pc^Ln^  all  the  '^/ririons  kinds  of  problems  we  have  noted  throughout  this  chap 
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ter        the  difficulties  in  gaining  widespread  user  system  acceptance  and 
aidoption  and  in  acliLeving  eifectl^e  implementation  of  ediicational  innova" 
tions;  the  values,  ethics^  and  reliability  issues  inherent  in  socials- 
science  knowledge  bases;  the  large  number  of  unknots  in  the  educational 
R^D6cI  knowledge  and  technology  base,  and  tl^g^^pnroblems  this  poses  in 
defining  research  problems  and  in 'requiring  substantially  larger  research  ■ 
and  development  costs  ar\d  therefore  proportionally  less  per  dollar  payoff 
in  funds  invested  iil  etucational  R'D&I  activities:  etc. 

^  + 

.Effective  policy  formation  and  strategy  development  must  take  these  envi- 
ronmental  Constraints  into  account  so  as  to  tnlnimize  or  overcoine  their 
influe-nce.     But  beyond  this  ^  is  there  anything  s^tem  managers  can  do  to 
directly  influence  the  environnient  to  make  it  Ttiore  supportive  of  education- 
al R^D&I?    Clearly,  some  of  the  environmentail  factors  we  have  considered 
must  be  viewed  as  fixed  and^  for  all  practical  purposes,  unchangeable 
(e<g<:  the  nature  of  the  knowledge  base  of  the  fields  the  nature  of 
educational  innovations,  and  the  governance  structure  of  the  education 
sector).     But  other  environmental  factors  would  seem  to  be 'amenable  to 
various  type^  of  policy  interventions  that  migl^t  conceivably  improve  the 
environment  of  educational  R/D5tl>  to  make  it  more  favorable  to  system 
interests  and  needs.    We  conclude  our  analysis  6f  environmental  influences 
on  educational  by  tonsidering_ the  interrelated  wet  of  influences 

on  environment-system  boundary  transactions ^  the  degree  to  which  each 
influence jnust  be  considered  fixed  or  amenable  to  change^  possible  policy 
interventions  to  improve  the  system's  environment>  and  Vhat  more  we  need  to 
know  before  we  can  develop  these  policy  ideas  into  worka^ile  strategies  for 
improving  the  system*s  environment  and  therefore  the  flow  of  inputs  and  sup 
.ports  that  are  likely 'to  enhance  system  functiohing  or  at  least  minimize 
difficulties  in  systefn  functioning, 

s 
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III.  DESIGN  OF  POLICY  INTEaVECTIONS 
1.    Conceptual  Fratnewort  ^ 

Political  systeras  analysts  conceptualise  the  relationsliip  between  systems 

17 

and  their  environments  in  the  manner  shown' in  nFigure  I,    ■    in  political 
termSj  the  key  inputs  flowing  from  environment  to  system  are  demands  made 
on  tbe  system  and  supports  (positive  or  negative)  for  the  system;  outputs 
flowing  from  -the  system  (in  the  form  of  decisions>  policieSj  or  actions, 
or  in  the  case  ot  R'D6fI>  programs,  products,  strategies  and  the  like)  are 
a  irajor  factor  affecting  tho^se  demands  and  supports.    ^Jhi^n  a  systen  is 
functioning  in  relative  equilibrium  with  its  environment,  syst^bm  outputs  ' 
are  meeting  or  even  excee<3ing  environmental  d^mapds,  and  therefore  the 
system  is  accorded  legitime/  and  other  kinds  of  supports  .that  insure  an 
adequate  flow  of  inputs  to  meet  system  needs;  the  demands  remain  moderate 
in  number  and  intensity>  and  are  processed  without  undue  strain  on  the 
system.     However,  when  ^s  in  the  case  of  education>  system  outputs  are  not 
able  to  meet  or  keep  pace  with  environmental  demands  in  number  or  in 
quality>  and  for  this  reason  and  others  supports  for  the  system  are  low> 
the  flow  of  requisite  imputa  {e*g.:   funding,  manpower>  and  other  resourc^) 
is  likely  to  be  inadequate '  to  System  need^^  and  the  number  and  intensity 
,of  demands  are  likely  to  overwhelm,  the  system^s  capacities  ^for  ptocessing 
and  dealing  with  them. 

In  Figure  2;  we  have  expaiided  the  political  systems  model  to  include  all 
the  various  kinds  of  environmental  influences  we  have  considered  in  this 
chapter",  .  the ir  relationship  to  demands>  supports>  resource  inputs,  system 
functioning,  and  ^^utputSj  and  their  complex  interrelationships.  The 
sketch  is  designed  to  show  how  complex  the  interrelationships  are  In  this 
web  of  environmental  influences  and  system  features,  and  therefore  why  it 
is  so  difficult  to  locate  points  o£  leverage  around  which  to  design 
policy  intlerventiops  or  management  strategi^  that  provide  reasonable 
chances  of  improvingr  the  system's  environment. 
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FIGURS  1 
POLITICAL  SYSTEMS  MODEL 
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Several  points  depicted  in  the  sketch,  should  be  underscored  before  we 
attempt  to^  use  ^his  framewo'irk  to  determine  what  the  most  fruitful  points 
of  leverage  my  b^: 

\     fir  Deinands 

In  the  education  sector,  demands  on  the  system  are  likely  to  be 
high       because  of  the  nature  of  the  system  as  a  public  service 
agency,  supported  by  public,  funda*     It  is  a  systeii^  affecting  every 
taxpayer  and  especially  every  parent  with  school  age  children  at- 
tending  the  public  schools;  and  ^oo,  it  is  a  system  affecting  the 
business  and  industrial  comntunity  because  of  the  relationship  between 
schooling  and  labor  pool  qualifications. 

Demands  are  alsQ  likely  to  be  high  because  of  the  social  and  politi- 
cal vulnerability  of  the  system       due  to  the  system's  governance 
structure  >  the  value^laden  nature  of  the  system's  knowledge  base  etnd 
its  decisionmaking,  the* weakness  of  the  system*s  knowledge  base  and 
therefore  the  re latlvely -small  expertise  gap  between  system  personnel 
and  laymen,  the  high  level  of  toncern  about  system  functioning  felt 
by  relevant  publics >  and  especially  the  strong  faith  Americans  have 
placed  in  schooling  as  the  p/imary  vehicle  for  social  mobility  and 
social  reform. 

The  operating  system  has  developed  a  powerful  constituency  of  its  own 

and  a  vocal  body  of  interest  groups  tft  lobby  its  *case.    The  education- 

al  R^DS:l  system,  however^   lacks  a  significant  constituency  or  a  sub- 

stantial  lobbying  mechanisgiJ   Consequently >  while  many  demands  are 
/ 

made  on  the  R/D&I  system  by  external  foroes>  few  denands  are  articu- 
lated  on  behalf  of  the  system       either  to  assert  its  needs>  or  to 
serve  as  a  counterweight  to  external  forces  able  to  Intrude  their 
perceptions *and  interests  in  the  processes  that  affect  decisions  about 
R/DSI  system  inputs  and  functioning. 
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Supports  for  the  R/D6tl  system  are  generally  low^  and  this  Is  at- 
tr^ibutable  to  a  number  of  interrelated  factors.    First,  the  know- 
ledge  base  is  weak.     Consequently,  both  the  knowledge  base  and  the 
system  that  applies  it  are  low  in  prestige  in  the  various  research 
and  R^Dal  subcultures  that  could  potentially  be  drawn,  od  by  the  sys- 
tem<     Seco^nd,  with  some  notable  exceptions ,  'system  outputs  have  not 
been  outstanding  in  quality,  reinforcing  the  system's  low  prestige  in 
the  scholarly  and  broa<i  R'DSd  communities  and  contributi;ig  to  the 

.gen^irally  loy  esteem  in  vhich  external  RuD  is  held  by  operating  per- 
sonnel and  by  n^nbers  of  Congress  and  other^  who  critically  influence 
resource  allocation  decisions^    Third,  the  nature  of  educational  , 
R^D^I  oi^tputs  as  innovations  focused  primarily  oxt  "people  change'*  con-- 
tributes*  to  the  difficulties  they  face  gaining  aoceptarice  in  the 
operating  system  and  then  achieving  effective  a/plethentation- 

^Failure  to  achieve  widespread  adoption  *o£  R/D6tl  outputs^  significant 
changes  in  school  practices  and  programs,  or  substantial  impact  on 
student  achievement  (or  other  objectives  of  particular  outputs)  con- 
tribute to  the  low  prestige  of  educational  R/D6tl  and  the  relatively 
limited  denand  for  its  outputs,  ^ 

Goals>  Need^>  etc;  Inputs;  Functioning 

We  noted  earler  how  these  various  environmental  influences  affected 
the  definition  of  R/D&l  goals,  needs*  policies,  and  strategies;  how 
they  affected  the  flow  of  such  critical  inputs  as  funding  and  especial 
ly  talented  personnel  into*tbe  system;  and  'how  they  ^ffected  the  con- 
duct of  various  system  functions.    These  paths  t>f  influence  are  also 
noted  in  Figure  2. 

* 

D,     Interrelationships  - 

< 

Finally,  several  of  the  interrelationships  depicted  in  F^gt^re  2  have 


been  considered  previously.     For  instance,  the  weaknesses  of 'the 
system's  knowledge  base  contribute  to  its  lov  prestige,  both  of 
which  tnake^  it  difficult  for  the  system  to  attract  Che  TieedecJ  input 
of  first-rate  personnel^  vih^h  in  turn  reinforces  the  system's  low 
prestige>  all  of  which  combine  to  make  it  more  difficult  to  strengthen 
the  system's  knowledge  base  or  to  produce  outputs  of  c^standing 
quality^  i^rketability^  and  feasibility  for-  effective  implementation 
and  impressive  impact,    0;:  to  take  another  example^  the  nature  of 
education  as  an  institution^  its  governance  structure,   the  high  level 
of  concern  of  relevant  publics,  the  weakness  of  the  knowledge  base 
and  therefore  the  small  e>:pertise  gay  between  educational  persor.nel 
and  laymen  all  create  substantial  vulnerability  to  environmental 
influence.    This  is  reinforced  by  the  weakness  of  system  supports 
(due  to  all  the  factors  we  considered  above).    This  vulnerability  per- 
mits the  system  to  be  buffeted'  by  demands  articulated  by  groups  in 
the  system's  environment,  derived  from  perceptions  of  system  outputs 
as  inadequate  or  from  social  "and  political  forces  external  to  the 
system.     In  the  absence  of  any  countervailing  system  clout  (e.g.:  a 
substantial  constituency  and  influential  lobbying  force  of  its  own, 
prestigious  spokesmen  actively  arguing  its  case,  etc*)t  supports 
pemain  low^  demands  remain  high^  and  Inputs  remain  Inadequate, 

The  criss-crossing  of  two-way  arrows  so  prevalent  in  Figure  2  suggests 
that  key  variables  are  closely  ihter relat?«d  in  a  web  of  cause  and  ef- 
fect.   Given  the  complex  interrelationships,  where,  if  at  all,  are 
there  points  of  leverage  for  policy  interrelationship?    System  out- 
putSj  for  ins.tance,  ar^e  both  a  cause  of  the  existing  pattern  of 
demands  and  supports,  and  an  effect  of  those  demands  and  the  low  level 
of  system  supports  as  well  as  such  other  factors  as  the  level  and 
quality  of  funding  and  personnel,  the' natUre  and  weakness  of  the  know- 
ledge and  technology  base,  the  nature  of  educational  innovations, 
etc.    The  low  level  of  system  supports,  to  consider  another  example, 
is  a  cause  of  the  low  level  of  founding  and  ^the  poor  quality  of  person- 
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nel  inputs  flowing  to  the  sys^^en  and  the  resultant  poor  quality 
outputs,  and 'in  a  sense  a  cause  of.  the  high  le^el  of  demands  made 
on  the  System       if  the  system  had  more  prestige  it  vould  be  less 
subject  to  external  demands*     Indirtictly,  the  low  level  of  supports 
IS  also  a  cause  of  the  continuing  ^^ak  status  of  the  field's  know^ 
ledge,  and  technology  base       if  the  system  had  more  prestige,  it* 
vould  be  better  able  to  attract  the  first  rate  talent  that  might 
bring  about  significant  gains  in  , the  knowledge  and  technology  base* 
The  low  level  of  s\ipport  is  also  an  e  c  feet  ^-  of  the  poor  quality 
outputs,  the  nature  and  veakness  of  the  field's  knowledge  base,  the 
quajicy  of  the  personnel  poo>,  etc* 

Fixed  Factors  and  Factors  Amenable  to  Change 

Is  it  possible,  then,  to  intervene  in  this  interrelated  web  of 
influences?    Which  of  thesa  factors  must  be  accepted  as  fixed  for 
all  practical  purposes?    Which,  if  any,  might  be  amenable  to  change, 
in  some  fashion,  to  some  significant  degree?    And  which  of  these 
are  likely  to  have  the  greatest  short-term  and  long-term  impact  on 
system- environment  relations?  j 

The  list  of  fixed  influences  must  include:  the  nature  of  education  as 
an  institution,  its  goverViance  structure,  the  high  level  of  concern 
of  relevant  publics,  the  sociaT-science-based  nature  of  its  knowledge 
base,  and  the  nature  of  educational  innovations*    More  amenable  to 
change  might  be  such  factors  as;  the  level  of  system  supports,  the 
pattern  of  demands  made  on  the  system^  the  quality  of  the  system's 
manpover  pool,  the  veakness  of  the  system's  knowledge  base,  and  the 
quality  of  system  outputs.     In  the  remainder  of  this  chapter,  we  con- 
sider possible  policy  interventions  that  might  be  designed  around  each 
of  these'  points  of  leverage,  the  problems  inherent  in  .each  because 
of  the  interrelationship  of  factors  depicted  In  Figure  2,  and  what 
more  we  need  to  know  about  all  this-/ 


Points  or  Leverc^^o  tor  Policy  Intervenclon^-:. 
'A.    Quality  of  System  Wcpucs.. 

Since  Che  poor  quality  of  system\>utputs  is  at  the  root  of 
many  of  the  system's  probJ^ms  with  its  environment,  it  seems 
reasonable  to  begin  oui^anaiysis  with  this  critical  factor* 
Clearly,  however,  any  attempt  to  improve  the  quality  of 
system  outputs  is  complicated  by  the  interrelationship  of 
thi$  factor  with  others  in  the  model  —  the  weakness  of  the 
field's  knowledge  and  technology  base,  the  generally  unapec- 
tacular  quality  of  the  system's  personnel  pooj  and  the  low 
esteem  in  which  the  system  and  its  ^knowledge  base  are  held, 
making  it  more  difficult  to  at-tract  first-rate  talent* 

Despite  these  difficulties,  several  kind  of  palicy  initia-^ 
. tives  might  be  attempted  and  studied  for  their  effect^.  ^First 
and  foremost,  it  woulcT'seem  essential  to  increase  the  visible^ 
return  on  the  investTnent  that  has  been  mde  in  educational  R&D* 
What  would  seeTn  to  be  required  is  a  substantially  higher 
success  rate,  i,e»,*a  larger  proportion  of  funded  projects 
producing  \;isil^le  successes  and,  a  much  smaller  percentage 
producing  dismal  failures.    \^at  this  n^ight  requlre^is  a 
callous^innowing  of  research  in  progress  orgirograms  on  the 
drawing  boards,  so  that  the  overwhelming  bulk  of  funding  goes 
to  low-risk  research  and  R&D  programs,  defined  as  low^ri^k 
'not  necessarily  because  of  their  ^xtablished ,  conventional 
nature  biit  rather  because  there  is  already  a  substantial, 
high-quality  knowledge  and"  technology  base  accumulated  'to  sup- 
port such  work,  an  impressive  cratical  ma.ss  of  talent  working 
in  the  area,  a  significant  track  record  of  important  achieve- 
ments, and  strong  promise  that  major  accomplishments  are  with- 
in reach-  *  / 


I 
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A  strong  case  mishit  be  made  against  an  approach  of  tliis  kind. 


search  has  a  quality  of  deja-vu  about' it>   returning  us  to  the 
mid^'60s  mistaken  emphasis  on  quick  p'ay-off  pro3^cts  that  in 
fact  turned  out  to  be  poor  in  conceptiorv  and  execucion>  and 
poor:  in  the  resultant  quality  of  the  outputs  produced.  How- 
evtiPj  this  argument  tiA^construes  what  we  have  suggested,  for 
we  defined  the^e  research  an^i  R^O  programs  as  bein^;  Low  in 
risk  because  of  the  hi^h  qualify  St  their  knowledge  and  tech- 
nology base,   the  available  critical  masses  of  talen-t,  and  the 
strong  record  of  achievement  in  the  particular  research  area. 

There  is  Qore  validity  to  other  arguments  that  might  be  made 
against  this  proposal.     For  iastance>  it  cannot  be  denied  that 
such  a  policy  would  probably  cut  off  support  for  some  areas  of 
work  in  which  a  significant  investment  had  already  been  made; 
and  would  jeopardize  the  futures  of  infant  research  areas  and 
young  and  perhaps  talented  researchers.    And  too,  such  a  poli- 
cy would^once  again  introduce  an  elenfent  of  instability  into 
educational  R/D&I:    once  again  long-term  projects  would  have 
been  cut  off  before  they  could  bear  fruit.    Also,  it  cannot 

r 

be  denied  that  some  of  the  most  important  breakthroughs  that, 
historically,  have  changed  our  lives,  have  c6me  from  work  done 
in  what  were  once  new  research  areas,  while  the  work  being 
done  on  the  mainstream  was  only  ''more  of  the  same"  in  the  con- 
ventional mold,  eventually  to  be  made  obsolete  by  what  came 
out  of  the  one-:;  infant  research  areas.  * 


All  of  this  is  true'v.^^^^.^fll,  unless  R/Dil  managers  can  begin 
to  demonstrable  that  the  overwhelming  majority  of  funded  pro- 
grams are  producing  impressive  gains,   it  will  not  be  possible 


For  instance,  it  might  be  argued  that  ^  focus  on  luw-risk  re- 


to- iBp/ove  the  system's  prestige^  legitimacy,  credibility^  or 
level  or  support*    -Asid  without -sucb"  ah'  iniproved  support  cli- 
mate, it  se^ms  unlikely  that  tt^^  system  will'  be  able  to-  * 
attract  the  level  and  quality  of  funding  and  personnel'in- ' 
puts  needed  for  long-term  survival  and  .matuiration. 


/ 


1 

Tne  design  and  implementation  of  .such  a  policy  will  net^  be  *  , 
•easy.  'Mho  is  to  decide  which  programs  offer  the  greatest 
promise  of  inipressXve  achievement?    Ifno  ''is  to  decide  where  the 
field's  ^owledge  and  technology  bases  are  best  developed  and 
where  the  critical  masses  of  t^ilent  are  and  are  not  working? 
tv'ho  is  to  attempt  to  develop  consensus  in  thfe-  field  onAjhat 
constitutes    'impressi've  achievement"  (ignp^ressive  to  whom,  on  ^ 
what  ground^)?    And  who  is  to  develop  the  field's  acceptance, 
of  the  fact, that  it  may  be  important  to  the  field^s  long-term 
interests  to  sacri^fce  some  pre'sent  *suppoJ^t  fdt  work  in  areas 
that  night  prove  to  have  *f und'ameyata  1  significance  but  that 
have,  not  yet  developed  a  substantial  entough 'knowledge  and 
technology .  bas$.  and  personnel  pool  to  suggest  that  ^ign'ifi-  ' 
c^nt  .^a^lilevemefnt  is -vi thin  i^eac^i?    How  can  system  managers 
answer  the  *arg,u3ient  th^t  if  support  for  these  ar^as  is  sacri- 
fied  now  t^hey  will  never  be  able  to  develop  that- linowled^e  , 
and  technology  base -or  the  critical  mass        talent- viewed  as 
a  prerequisite  to  support^    Can  system  managers  find ^a  body 
of  eml^nent  advisers*  from  the  field,  who  are  reasonably  free 
of  l)ias^  (or  whose  unavoid^jljle'  biased  cancel  e^h  other  out)  , 
and  wSose  judgements  will  be  viewed  as  having  legi'^^^f^y,  -  * 
even  bv  tho^ie  individuals  and/6r  oTrg^nizations  wj^e  -  i^n  terests 
are  hurt?.;?l^at  role,  in  this^process^  if  any,  might  ^B'e  -played 
by  such 'professional  associations  as  the  AERA,  APA,  ASA,  AVSA^ 
etc.^  '  ^     ^  \  '  ^ 


\  j&econd  sort  of  initiative  ^J^^^Sh^  be  considered  that  takes" 

into  account  part'of  the  arguoient  made  against  what  we  have 

just  suggested.    There 'is  a  great  deal  of  validity  to  the 

argument  that  work  of  fundamental  long-term  significance  is 

likely  to  cotae  out  of  some  of  these  infant  research' areas  > 

and  that  if  support  for  this  research  is  cut  off  now  these 

research  areas  may  be  prevented  from  d|^eloping  the  requi*" 

site  knowledge  and  technology  bases  and  critical  masses  of 

talent*    Therefore>  a  portion  of  the  available  resources  ijight 

"^be  set  aside  to  support  work  these  areas.     Bu-t  if  this  is  done 

it  becomes  important  to  make  clear  to  laynien>  practitioners  > 

(^ngress>  and  other  potential  critics  just  what  such  funds  are 

and  are  not  expected  to  produce,  and  especially  make  clear/^ 

.    over  what  (long-term)  time  periods  pay-offs  of  any  kind  can  be 

even  hoped  for>  what  the  likelihood  of  pay-off  may  be>  and^why 

_ the  investment  is  considet^d  a  wise  one  despite  the  long  wait 

*^  ^ 
and  the  uncertainties  of  a  signiffcant  return. 

If  a  policy  of  this  kind  is  pursued*  it  will  require  (as  did 
the  first  initiative  we  considered)  involvement  of  eminent 
leaders  oj|  relevant  fiel^s^o  help  determine  vhich  research  " 
areas  (of  the  large  number  that  might  be  supported)  seem l to 
offer, the  strongest  possibilities  of  ultimately  producing  ' 
significant  achievement.    However*  if  recent  experience  is  any 
indication  of  what  might  be  expected  in  the  future*  committees 
of  eminent' scholir^  are  reluctant  to^  make  such  choices  among 
researcTT^area^  even  when  "specifically  asked  to  do  so*  leaving 
the  choice  toi^ttiers  (such  as  agency  staffers) 
who  are  probably  less  qualified  than  themselves  to  make  such 
r  choices* 

A  third  policy  initiative  ttj^t  might  be  considered  would  in- 
volve a  direct  campaign  to  us^  those  impressive  system  outputs 


*  / 


that  do  exist  (or  arc  produced  over  time)  to  imprwe  the 
image  and  therefore  the  level  of  supports-  for  t[t«  sVsten 
in  various  research  and  R^D  communities  inside  and  outside 
the  educational  R/D£^,T  systenij  anoug  operating  system  person- 
,nel*and  decisionmakers,  among  members  of  Congress  and  the 
federal  agencies  influenciaL  in  resource  allocation  decisions, 
t  and  among  laymen  in  general.  ^ Such  a  balatant  public  rela- 

tions campaign  probably  could  not  justifiably  use  public 
funds-    But  it  would  seem  appropriate  to  an  educational 
resBarch/R^8  interest  group  such  as  the  AERA,  especially 
if  it  were ' conceived  in  part  as  an  effort  to  educate  these 
^  various  constltutencies  in  the  complexities,  difficulties, 

and  protilws  In  educational  R/&I  and  the  efforts  being  made  ^ 
^  by  the  fieia  to  overcome  its  problems  and  improve  its 

performance  - 


A  campaign  of  this  kind  might  descrij^e  some  of  the  outstand- 
ing ach;ieveTnents  produced  by  the  system,  what  they  were,  what 
their  effects  have  been,  and  why  it  was  possible  to  produce 
them  —  how  much  money  it  took,  what  kinds  of  personnel, 
what  sorts  of  set"tings  and  organizational  arrangements,  what  . 
existing  knowledge  and  technology,  how  long  it  took  to 
produce  pre-existing  knowledge  and  technology  and^  the 
r/d&T  output  itself,  etc.;  how  this  compares  to  other  areas 
where  significant  a^ihievement  may  be  within  reach,  what 
these  future  outputs  might  look  like,  wh^t  kinds  of  effects 
they  might  have^S^nd  what  more  may  be  needed  to  bring  these 
to  fruition       hov  much  more  money  and  time,  what  kinds 
of  persc^nei  who  may  not  yet  exist  in  sufficient  numbers  or 
with  the  requisite  skills,  what  kinds  of  knowledge  and 
techncfllogy  that  ma^^^still  need  to  be  developed , etc . 
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Although  the  AERA  would  seem  to  be  the  post  appr-opriate  group 
to  conduct  Such  a  campaign,   there  seeTis  little  rtason  to  Relieve 
that  this  organizatlbn  would  have  much  enthusiasm  for  such  a 
program,    AjLthough  an  effort  has  been  made  to  describe  cite  organ 
nation  as  representing  both  educational  reseaj^*£hers  and  R^D 
personnelj'  It  clefirly  remains  oriented  primarily  toward  educa- 
tional research:    Xs  it  likely  that  the  AERA  woy^ld  Involve 
itself '  in  such  a  campaign?    Could  It  he  persuaded  to  conduct  ' 
such  ^campaign?    If  not  the  AERA>  who  mighr  carry  out  this 
kind  of  Initiative?    Would  any  of  the*prlvate  foundations 
support  such  an  e'ffort'and  pay  for  the  production  of*  descrip- 
tive materials?    If  such  printed  natter  did  become  available, 
would  a  group  such  as  AERA's  Governmental  Professional 
Liaison  grou^  take^  the  campaign  to  Congress  and  other  key 
decisionmakers?    Ciearly>  as  badly  needed  as  such  a  campaign 
may  be>  there  is  likely  to  be  sojne  resistance  (even  within  the' 
field)  to  It^  advisability  or  appropriateness. 

Weaknesses  of  tjie  System  s  Knowledge  and  TechnoX^^y  Base 

The  vicious  circle  of  influences  that  block  furfhe r  system 
Tnaturation  become  particularly  salient  when  one  considers 
the  need  to  strengthen  the  field's  knowledge/technology  base- 
As  long  as  the  knowledge  and  technology  base  of  the  system^ 
remains  weak  and  inadeq'u^te  to  the  needs  of  research  and 
development  activlties>  system  outputs-wilL  remain  poor  in 
quality*  and  all  the  attendant  problems  of  low  esteen  'and 
difficulty  in  attracting  first-rate  talent  will  continue. 
But  it  seems  unlikely  that  the  knowledge  abd  technology  base 
of  the'field  can  be  significantly  streng^thened  unless  some 
effort  is  mads  to  attract  a  larger  supply  of  first-rate  talent 
to  the  field.    And  as  long  as  the  fifcld  continues  to  be  held 
In  Such  low  est&er^»  the  possibilities  of  attracting  this 
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high  calibre  calent  in  si:zfe'<rblc  numbers  seem  renote. 
Equally  significant,  as  long  as  support  for  the  systt^m 
remains  low,  it  will  be  difficult  to  persuade  those  who 
control  resQurce  allocation  decisions  that  a  substantial 
proportion  of  aVailable  funds  should  be  concentrated  on 
knowledge-building  activities  that  provide  the  slirnmest  and 
most  long-term  prospects  for, a  tangible  return  on  R/D^I 
investme_p(t.     If  this  unhappy  situation  is  to  be  revefrsed^ 
talented  researchers  Vho  might  be  attracted  to  the  field 
apd  decisionmakers  who  control  resource  allocations,  will 
have  to  ba  persuaded  that  A  significant  strengthening  of  the 
field's  knowledge  and  techTfeiogy  base  is  poss|.ble  within  a 
reasonable  time  frane* 

In  preparation  for  a  concerted  effort  of  this  kind,  it  would 
seem  essential  to  bring  together  a  body  of  eminent,  respected 
scholars  and  R^^D  experts  to  map  the  knowl^ge  and  technology 
base  of  the  field  and  assess  the  state  of  development  of 
various  research  areas  within  that  base,     This^^T^fort  might 

be  even  more  useful  if  it  was  carried  out  in  relation  tcMt^ 

J- 

another  effort  oriented  toward  identifying  the  kinds  of 
outputs  that  are  most  badly  needed  by  t,Jie  field.     This  latter 
agenda  might  be  drawn  up  by  an  equally  prestigious  panel  of 
practitioners  and  agency  officials*    -The  two  groups,  fir^t 
studying  each  other's  findings  and  then  meeting  together, 
■  might  come  up-with  an  agenda  of  priority  work  —  research 
areas  that  should  be  given  priority  attention,  ei  tl^er  Jl'ecau'se 
of  their  importance  as  a  basis  for  developing  needed  outputs 

or  understandings,  or  bec^inse  worl^  in  the  area  is  moving  in 

/  *  \  .  ' 

the  direction  of  making  possible  outputs  or  ways  of  thinking 
"  about  education  that  could  be  of  fundamental  signf f icance , * 
or  both-     We  already  alluded  to  this  type  of  strategy  (and  its 


difficulties)  when  we  considered  options  to  raise  cho  quality 
of  syster  outputs-   .But  it  would  certainly  seem  to  be  worth  a 
try f  especially  if  the  priority  research  areas  selected  could 
be  analyzed  in  terms  of  an  agenda  of  researchable  proble::>s 
'needed  to  make  initial  progress  in  extending  the  existing 
knowledge/ technology  base  of  each  area  fron  where  it  is  m5w;, 
If  such  analyses  coold  be  conrjucted^  if  adequate  consensus  ' 
(jould  be  developed  in  the  field  on  the  elements  in  this 
'^research  agenda,  and  if  talented  researchers  inside*  and 
outside  the  educational  r/D&I  system  and  those  wfto  control 
reSujrce  alloation  decisions  could  be  persuaded  that  a  re- 
search agenda  so  structured  and  supported  nade  significant 
future  achievements  seem  highly  IiVely>^bhen  substantial 
progress  might  be  made  toward  strengthening  the  knowledge 
and  technology  base  and  enhancing  the  prestige  of  the  field- 
Or  a  simpler>  less  direct  strategy  might  be  t^ried  —  e-g-: 
simply  attracting  a  critical  n^ss  of  first-rate  talent  in  a 
given  area        the  knowledge  and  technology  base  i^i  need  of 
development,  providing  them  with  the  resources  they  requir.G, 
and  letting  them  determine^che  course  of  research  to  be  followed 
and  the  manner  in  which  this  more  basic  woVk  might  be  drawn  on 
to  develop  applications  for  schools  and  classrooms<  However, 
t-his  latter  strategy  is  easier  to  describe- in  the  abstr^ct,^ 
than  with  any  substantial  degree  of  specifi/ity,  and  it  is  no 
doubt  likely  , to  be  easier  to  specify  than^o  implement 
effectively,  ?s  we  shall  see  belo'-j- 

C,      Quality  of  the  System's  Person^^l  Foal 

The  failure  of  educational  r/D&I  to  attract'  a  sizeable  number 
of  eminent  researchers  has  been  one  of"  the  mo$t  frequently 
repeated  criticisms  of  the  system  since*  initial  disappointment 
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sec  In  only  a  few  years  after  it  waa  created.    But^  as  '^e  , 

note  at  seVer^ii  points  in  our  analysis^   from  the  very  outset 

environmental  influences  discouraged  whatever  serliDus  interest 

in  educational  research  and  R?D£*I  activities  first-rate  talpnt 

n^ght  have  had.    The  field  has  long  been  held  in  low  esteem 

by  the  various  research  and  Rf^D  subcultures  from  whicli  potential 

personnel  might  have  been  drawn,    And  tho  unstable,  <;ulnerable 

history  of  the  institutionalized  system,  and  its  limited  achieve- 

menDs^  have  only  reinforced  those  long-helS,  deepiy-rooted 

prejudices  in  the  socialization  patterns  experienced  by 

virtually  all  recruits  to^the  worlds  of  academia  and  industrial 

RiD.    As  long  as- the  firld.  continues  to  be  held  in  low  esteen^ 

it  is  difficult  for  it  to  attract  first-rate  talent^  and  as 
■     W>  ■ 

long  as  there  are  relatively  few  eminent  men  and  women  and  an 
inadequate  ^upply  of  high  calibre  personnel  in  the  field,-  its 
achievements  will  remain  severely  limited^  and  its  prestige  will 
continue  on  a  low  level.    How^  if  at  all^^^cari  we  intervene  in 
this  vicious  circle? 

Some  have  concluded  that  impressive  achievements  must  come  ^ 

19  ■  ^ 

first.        If  this  is  true,  then  perhaps  the  strategies  we 

discussed  above  for  producing  a  few  outstanding  achievements 

offer  the  best  long-term  possibilities  of  attracting  first" 

rate  talent  to  the  field*    System  managers  might  concentrate 

resources  where  critical  masses  of  talent  already  exist-  This 

might  increase  the  number  of  impressive  achievements  to  which 

the  fi-eld  could  poiftt  and  boost  its  success/ failure  ratio, 

0;er  time,  talented  students  and  established  researchers  frorri 

other  fields  might  begin  to  sfee  attractive  possibilities  for 

their  work  within  educational  r/d^I, 

But  are  more  rapid,  more  direct  approaches  possible?  Sone 
have  been  trLed.     For  InsC.inceT  one  substanti^il  funtiiog;  program 
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succeeded'  in  attra^rting  a  significant  nunbar  of  young 

20 

researchers  fro"^  zhe  disciplines.        But  it  is  not  clear  " 
at  this  ti-ne  just  how  many,   if  any^  of  these  researchers 
used  the  funds  to  conduct  studies  they  w<^ld  not  have  other- 
wise conducted  within  their  disciplines,  or  just  how  many 
of  t'hem  continued  working  on  problems  relevant  to  education 
after  these  grants  ran  out.     To  take  another  example,  HIE 
conducted  so-ne  invitational' conferences  to  have  errinent 
researchers  from  specific  disciplir.es  develop  research  agendas 
for  the  Institute,  and,  it  was  hop^d,   to  stimulate  their 

ir.cerest  ir-  applying  for  grants  ,to  concuct  pieces  of  the 

21 

research  agenda  they  helped  forrr^ulata.        However>'we  have 
seen  little  evidence  of  substantial  results  fron  this  approach 
either.  .  • 

Other  kinds  of  recruiting  s^traXegies  might  be  tried  on  a  more 
one-to-one ,  personal  but  organzized  basis .     For  instence  > 
proposals  might  be  solicited  fro::i  first-rate  researchers  and 
R/D6I  personnel  in  the  field>  with  NIE  offering  substantial 
five-year  research  grants  to  those  who  develop  the  best 
proposals  for:     (a)  developing  specific  outputs,  or  critical 
elements  of  the  knowledge  and  technology  base  ^of  particular 
priority  areas>  and  (b)  doing  this  by  .recruiting  and  working 
with  critical  masses  of  relevant  talent  from  other  fielA>  o^ 
even, better,  a  mixed  group  of  established  researchers  and  a 
number  of  their  young  students  or  colleagues. 

A  second  strategy  might  entiai  working  with  the  professional 
association*^  (e>g.:    AE^  divisions  or  units  working  with  y 
the  APA,  ASA,  APSAj  and  otherassociations  tied  to  the 
disciplines  or  applied  fields)  to  inprove  the  image  of  edu- 
cational research  and  R/D6I>   its  areas  of  past  accomplls^ents 
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and  the  possibilities  for  £ucure  achievenenc  in  ^ecific 
areas,  and  to  iacfease  t^ppor tuni ties  for  talented  researchers 
from  these  other  fields  to  get  interested  in  working  on  educa- 
tional research  and  R/D^I  problems*    Of  course,  unless  sub-  ^ 
stantial  progress  is  made  in  the  coming  yearSj  it  seems 
unlikely  that  any  of  these'  direct  types  of  recruiting  strategies 
will  have  much  success  in  offsetting  the  pervasive  nqtion  chat 
educational  R/D6I  is  a  ftopeless  enterprise,  a  field  with  too 
iriany  risks  and  too  few  reasonable  opportunities  for  significant 
achievement:^  -  to  be  seriously  considered  as  a  career  option  for 
a  researcher  with  real  talent- 

The  policy  options  need  to  be  considered  thoughtfuLlyj  for 

the  choices  seem  to  reflect  the  old  chicken-and-egg  dilemma- 

Which  rust  come  first?     Impressive  achievements  now  so  that  , 

capability  building- becomes  more  possible  in  the  future?  Or, 

capability  building  now  ^  that  impressive  achievements  become 

more  possible  in  the  future?    Or,  as  we  have  suggested  else- 
22 

where,      is  it  possible  to  structure  procurements  In  such  a 

way  that  both  objectives  can  be  achieved  at  the  same  time? 

23 

We  shall  return  to  this  point  in  other ^chapters.  ^ 

\ 

D,      Level  of  System  Supports 

The  level  of  supports  for  educational  r/D&I  might  conceivably 
be  raided  by  direct  or  by  indirect  intervention  strategies. 
Strategies  that  might  indirec tly  raise 'the  level  of  system 
supports  would  be  those  focused  not  so  much  on  supports 
thenselveri  as  on  sor.e  of  the  root  causes  of  the  low  estee^n 
in  which  the  system  is  held.    U^at  we  have  in  mind  here  are 
those  strategies  considered  above,  designed  to  produce  outputs 
of  Impressive  qu/ility,  '  to-  stren:;hen  the  field's  knowledge  and 
technolog^'  base,  and  to  attract  more  first-rate  research  and 
R/D&I  talent  to  the  field. 
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More  di roc^  su?:>ort-building  sTuategi^s  might  be'  tried  as 
well-     Tne  kind  o^'  publii:  felacions^  caiT'.paign  considt-^rt^d 
earlier  could  be  par"C  of  onQ  such  strategy,  especially  it  it 
is  carried  Out  through  an  approach  t'hat  con:n'jQicaces  not  only 
Che  Impressive  accomplish:nenCs  the  field  has  already  achieved 
but  also  Che  problems  faced  by  educational  K/D^I  and  the 
efforts  being  made  by  th^  field  to  overcome  these  difficulties 
and  improve  its  performance.     A  campaign  of  this  kind  might 
be  particularly  effective  in  b'-iilding  support  for  the  systeir, 
if  it  also  conveyed  messages  about'  potential  future  benefits 
that  mif^ht  accrue  to  eaci>  target  audieriile  frO|  the  improverer" 
of  system  functioning,  and  what  each  group  rfight  do  to  contribute 
to  that  goal.  ^  ^ 

But  sucli  future  benefits  ^to  be  conveyed  must  be  derived  from 
the  ijeaiities  of  group  interests  and  of  what  gains  can  legiti- 
mately be  expected  under  various  more  or  less  possible 
conditions.    Thereforei  designers  of  this  strategy  will  need 
much  more  specific  information  than  is  available*  now  about  the  ' 
perceptions,  expectat^ns,  and  desires  of  each  of  these  target 
audiences  (especially  groups  ^od  individuals  who  "have  not  thought 
of  theijr  interests  in  relation  to  educational  R/D£fT,  such  as 
researchers  and  R/d^I  personnel  from  other  disciplines  and 
sec  tors)  ►    Once  such  information  is  available  ?nd  is  used 
effectively  by  professionals  with  cons titu tency-building 
talents,  it  ma^be  possible  with  the  rigtit  mix  of  prestigious, 
researchers  and 'R/Diil  personnel  from  the  education  sector  and 
adequate  organizing  resources  to  develop 'a  direct  constituency- 
building  campaign  tragetted  at 'di\7ers€  audie^nces  who  can  be 
persuaded  that  their  interests  can  be  served  by,  .or  linked  to, 
a  strong,  effective  educational  R/D&T  system.    Varget  audiences 
might  include  researchers  and  R/D£rl  personnel  from  the 
.educntion^  sector  and  from  other  disciplines  and  sectors;  private 
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sector  fiTTis  who  inigt^t  eventually  produce*  market*  and/or 
distribute  the  outputs  of  educational  KP  octivities;  school 
personnel  and  decisionmakGrs;  membi^rs  of  Congress  and  other 
federal  agencies  who  affect  resource  allocation  decisions; 
parents  and  laynent  generally. 

How  might. such  ^  direct  constituency-building  campaign  be 
conducted?    By  who^nS..,^^ Using  what  resources?    How  much  voluntarism 
could  be  relied  on?    How  mych  of- "the  work  and  coordination  would 
have  to  be  carried  out  by  full-time*  paid  professionals?  What 
roles  might  t>e  piayed  by  the  professional 'associations?  l^at 
iegitimate  arguments  would  be  most  persuasive  for  building 
support  in  each  segment  of  ^the, potential  cons t'ituency?  Assuming 
the  constituency-building  effort  is  successful^  how  and  for  what 
purposes  might  each  segnient  of  the  poteiitial  constituency  be 
called  on  in  the  future  to  meet  thp  system's  needs  for  lobbying 
its  case,  for  locating  and  recruiting  particular  kinds  of 
exper tise,  information ,  etc . ?    If  resources  are  to  be  invested 
in  such  an  effort,  tentative  answers  to  all  these  questions 
must  be  fomulated,  bafeed  for  the  most  par't,  we  would  hope,  on 
research  data  and  on  the  judgments  cf  professionals  skilled  in 
such  camj?aigns.  '  ,  /  - 

E,  Pattern  of  Demands  jfade  on  the  System 
 ' — '  ^  ~ 

Given  the  various  enviif^nmental  influences,  which  create  ej^treme 

system  vulnerability  to  social  and  political  demands,   it  seems 
"unlikely  that  the  system  coulls  ever  become^  iihmune  to  ext€l^nal^^  ^ 

prcssLires.  even  if  this  were  dessiroble.    As,  long  as  system  . 

supports 'rtjrraln  weak,  and  as  long  as  the  system  continues  to 
^be  held  in  low  esteem  (because  of  the  Weaknesses  of  it^  outputs, 

its  knowledge  and  technology,  base,  and  its  personnel  pool), 
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external  demands  made  ori  the  s:j5scem  will  remnin  high  ^nd  perhaps 
do-nin^nt  in  ;l^?terninin>?  svste*^  direcc'ions  and  patterns  o£ 
functioning,    However>  somt;  policy  initiatives  might  be 
effective  in  reducing  the  number  and  intensity  of  such  demands> 
and  in  achieving  greater  balance  between  decnands  for  system- 
generated  needs >  on  the  one  hand>  and  environment-  generated 
needSj  on  the  other. 

Although  demands  and  supports  can  be  somewhat  independent 
variables  it  seems  reasonab^le  to  assume  that  the  higher  the 
level  of^supports  for  a  system  and  the  greater  the  legitimacy 
and  prestige  it  is  accorded>  the  less  intrusive  external  forces 
are  likely  to  be  in  attempting  to  influence  the  directions  o: 
System  functioning  a^-t+tevfypes  of  system  outputs  to  be 
prodpced,    ThereEore>  all  the  various  strategies  we  have  consi- 
dered to  directly  or  indirectly  affect  the  level  of  system 
j^upports  are  fikely  to  have  some  indirect  effect  on  the  pattern 
of  'demands  n?5lde  on  the  system  as  well,  * 

Direct;  strategies  to  affect  the  demand  pattern  also  'seem  possible. 
For  insCcrtice^  the  constituency-building  activities  directed 
at  particular  audiences  might  include  all  those  sources  of 
major  deinands  made  on  the  system.    Particular. strategies  might^ 
be  designed  to  persudade  feach  target  group  not  only  of  its  stake 
in  the  developmen-t  of  an  effective  educational  R/D£rl  system j 
but  also  which  of  its  demands  are  reasonable  or  unreasonable 
given  the  existing  state  of  development  of  system  capabilities. 
If  these  groups  could  be  persuaded  that  demands  beyond  the 

i 

system^P  capabilities  now  might  be  met  in  the  futur^  if  the 
system  had  more  resources>  or  if  the  system  were  permitted  to 
pursue  particular  capability-building  programs  in  the  areas  of 
personnel  development  or  more  basic  research  (i,e,  j  filling  in- 
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some  of  the  gaps  in  the  field's  knowledge  and  technology  base) > 
then  greater  balance  might  be  achieved  between  environment- 
generated  and  system-generated  demands^  to  the  ultimate  benefit 
of  both  the  system  ^nd  its  constituency, 

IV.      NEXT  STEPS 

1^      Where  Ue  Are  Now  '  ^  - 

The  field  and  its  leadership  seem  to  have  a  reasonably  good  under- 
standin^  of  the  dilemmas  posed  by  the  unsupportive  environment  in 
which  the  educational  RAD^I  system  functions.    Although  there  is  little 
that  cou^  be  categorized  as  a  literature  specifically  focused  on  en- 
vironmental influenc^j  there  is  a  considerable  amount  of  commentary 
on  these  influences;  generally  as  part  of  discussions,  of  other  matters. 

The  difficulty  is  not  lack  of  understanding  of  the  nature  of  the  prob- 
lemSj  but  rather>  what  to  do  about  them>  and  perhaps  too^  a  sense  that 
*there  is  probably  very  little^^tha^  can  be  done  about  them  directly, 

it  may  be  that  nothing  should  be  done  about  these  problems  , directly. 

-The  survival  crisis  may  be    ov^r>  and  these  .'who  were  bitterly  attack- 
ing educational  KStV  and  calling  for  a  zero  budget  for  NIE  in  1974  may 
simply  be  ignoring  educational  R?D£(I  as<oo  insignificant  a  matter 
and  too  small  a  federal  budget  item  to  warrant  their  continued  concern- 
Certainl);>   the  climate  in  Congress  is  far  less  antagonistic  than  it 
was  only  a  few  years  ago.    And  potential  critics  may  limply  ignore  the 
enterprise  long  enough  to  permit  the  system  to  develop  and  mature  over 

*  time  and^roduce  a  more  impressive  record  of  achievements- 
Stilly  even  if  the  political  climate  is  less  antagonistic  than  it  once 
was >  this  gain  is  not  likely  to  improve  the  esteem  in  which  the  field 
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is  held  by  talencad  researchers  in  other  fields.    And  clcarly>  attract- 
ing more  talenc  CD^che  field >  and  strenghtening  the  field's  knowledge 
ajid  technology  base>  muse  still  be  viewed  as  concerns  warranting  pri^ 
ority  attention. 

2-    Needed  Research  and  Analysis  * 
 / 

Various  kinds  of  data-gathering  and  analytical  work  might  be  carried 
out  as  the  basis  for  designing  the  kinds  of  direct  cacapaigns  we  have 
suggested  here.     If  it  was  decided  co  limit  such  campaigns"  to  lonly 
iQproving  ■  Che  view  of  the  field  held  by  reseorchers>  only  parts  of 
what  we  >re  proposing  might  be  undertaken.    Or,  if  a  broader  series 
of  camp^fefe  were  considered*  targetted  also  at  practitioners,  at 
Congress,  ac  federal  agencies*  etc.,  more  of  the  suggested  data- 
gathering  might  be  included.  ,  ^ 

For  instance*  one  possible  line  of  inguiry  might  entail,  empirical 
surveys  of  members  of  the  research  and  r/d^I  communities  (in  the  ed- 
ucation  sector  and  in:  other  disciplines  and  sectors),  school  personneli 
members  of  Congress  and  federal  agencies  that  control  resource  allo- 
cation decisions,  etc.   to  determine  for  each  group: 

-just  how  high  or:^  low  in  esteem  they  hold  educational  R/D&I,  and 
the  re^^ive  importance  of  various  factors  we  have  considered  in 
explaining  different  levels  of  support;  ■ 
-what  indicators  of  Improved  system  functioning*  or  potential  for 
improved  functioning*  would  persuade  them  that  educational  r/D^I 
is  becomiag  more  effective  and  should.be  viewed  more  favorably; 
-what  potential  ^utute  gains- they^  conceive'uiight  be  derived  from 
improved  system  functioning  that  could  be  of  particular  benefit 
to  their  interests  or  to  goals  thay  feel  committed  to  achieving 
or  to  seeing  others  achieve; 
-what  roleCs),  if  any,  each  group  perceives  it  could  conceivably 
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plav  in  ccmtribiTting  f-o  achievertient  of  these  goa^ls;-*"  '  ' 
-receptivenestit  co  different  arguments  about  ,      -  ■ 

-  -  impregisiye  achievements  educational  r/d&I- has  made  in  the 
,  pas  t,    .  ■ , 

/*its  potential  for  future  improveftient  through  focusing  re^ 
'source  ^locations  on  feyer  outputs  where  significant 
achievement^  is  judged  by  eminent  leaders  of  the  field  to 
be  within  reach, 

v*ita  potential  for  future  improvement  through  focused  re^-- 

search  on  critical  gaps  in  the  field's  knowledge  and  tech^ 

nology  base,  and 
1 

* -its  potential  for  future  iiiiprove;nent  through  attracting 
first-rate  personnel  from  other  fields-  ^ 
A  second  line  of  inquiry  might  entail  empirical  surveys  of  members  of 
the  educational  research  and  r/d&I  communities  to  determine: 

-the  extent  to  which  the  field  accepts  the  fact  that  long-term 
system  survival  and^ maturation  may  be  dependent  on  increasing 
the  number  and  Visibility  of  impressive  achievements; 
-how^members  of  the  field  think  this  can  be  accomplished  most 
ef f eciently; 

-the  extent  to  which  the  field  accepts  the  positioh  that  for  a 
time  the  overwhelming  bu     of  resources  should  be  allocated  to 
low-risk  research  and  R&D  programs, .where >there  Is  already  a 
substantial,  high-quality  knowledge  and  technology  base  accum- 
ulated, where  there  is  already  a  critical  mass  j^lE  talent  working, 
where  there  is  already  a  significant  track  irecord  of  achievement, 
and  where  there  appears  to  be  considerable  promise  that  major 
accomplishments  are  within  reach;  •  ' 

-what  allocation  formula  might  be  most  reasonable  for  apportion- 
ing resources  between  low-risk  work  in  areas  of  fundamental  sig" 
nificance  whf^re  breakthroughs  will  take  longer  and  are  less  cer- 
tain but  may  be  of  long  range*  import^ince; 
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-which  eminent  tae[?xiers  of  the  field  trhey  would  no'minate  as  most 
capable  of  judging  t^'hich  areas  of  research  and  R/D^I  activity 
offer  the  greatest  prorai^  of  *  impressive  achievement,  wher-et,  the 
knowledge  and  technology  ba§e  is  best  developed^  ajid  where  crit-^'^ 

"^iTTal^^sses  of  talent  are  already  working; 

-what  past  and  present  system  accomplishments  they^would  rate  as 
impressive  achievenents  that  should  be  made  more  visible  to  po- 
tential  constituencies; 

-what  areas  of  the  knowledge  and  techttology  base  they  believe  are 
best  developed  and  of  f ^  ^the  strongest  base  for  producing  im- 

^pressive  achievements  that 'ar<i  within  reach; 

■-w^t  areas  of  the  knowledge  and  technology  base  that  are  not  yet 
veil  developed  they  believe  to  ,be  in  need  of  d.e^lopment  to  in- 
creasy  the  .likelihood  of  future  breakthrough's  of  fundamental 
significance  (and  where  there  are  already  first-rate  researchers 
or  r/D^I  personnel  working  in  these  areas); 

-for  each  area  of  th^  knowledge  and  technology  base  the  respon- 
<lent*  described  as  a)  in  need  of  short-term  of  long-term  strength- 

r 

f 

t^ing,  and  as  b)  an  area  with  which  he  has  some  familiarity,  what 
eminent  researchers  or  R/D&I  petsonnel  he  would  nominate  as  best 
ablfe  to  develop  an  agenda  of  researchable  problems  that,  once 
solved,  could  increase  the  possibility  of^uture  achievements  of 
siguif  icanc'e; 

-which  areas  of  research  and  R/D^I  activity  they  believe  already 
have  critical  masses  of  talent  at  work,  and  who  they  would  in- 
clude in  this  "critical  mass*'  designation  in  each  area  of  a(ibi" 
vity  in  which  they  have  some  expertise  or  familiarity;  and 

-what  roles  they  believe  should  be  played  by  the  professional 
associations  in -making  these  choices  and  plans.  * 


A  third  line  of  potentially  'useful*inqOiry  might  involve  analyses  of 
the  key  sources  *f  external  demands  made  on  the  educational  r/D6I 


\ 
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Si'Stem  in  the  past  three  years,  and  the  syste|fl^  kapjsbill't?'ies  for 
meeting  each  set' of  demands  given  existing  re^bujrc^s  and^-papabllities, 
especially  th^  state  of  development  of  r  elevaAt ,  sagcj^r>t^df  the  field's 
knowledge  ancf' technology  base  and  personnel 


In  a  second  stage  of  the  data-gathering  and  analysis  effort,  eminent 

members  of  the  educatiqpal  research  and  R/D^I  communities  nominated  ^ 

f 

by  their  colleagues  in  the  previous  surveys  would  be  contacted  to  ^ 
determine  their  willingness  to  participate  in  the  planned  program, 
Thoye  ^0  agreed ^to  participate  would  then  be  surveyed  for  their  ^ 
judgnients  of  tjxe  varices  items  enur^erated  earlier  (e<g<:  which  areas 
of  research  and  R/D^L  activity  off^r  the  greatest  promise  of  impressive 
achievements  that  are  within  reach,  where  the  knowledge  and  technology 

r 

base  is  best  developed,  where  critical  masses  of  talent  are  already 
-TSopkingj  what  past  accomplishments  are  most  impressive,  what  alloca- ^ 
tion  formula  should  be  used  to  apportion  funding  between  low-risk 
programs  where  major  accomplishments  are  v/ithin  reach  and  higher- 
risk-  programs  of  fundamental  significance  where  breakthroughs  will 
take  longer  and  be  less  certain,  etc.)--  They  would  also  be  asRed  to  ^ 
identify  those  researchers  and  R/t)£fI  personnel  they  would  include 
in  the  "critical  mass"  designation  ip  each  area  of  activity  they 
selected  as  (a)  providing  promise  of  impressive  achievements  within 
i^eachj  or^  as  Cb)  in  need  of  long-term  capability-building  deveJLopment 
of  the  personnel  pool  and  relevant  knowledge  and  technology  base  if 
breakthroughs  of  fundamental  significance  are  ^to  be  achieved  in  the 
future.       '  * 

3.    ^ StratGRV  Design  and  Monitoring  ,  ^ 
Base<t  on  the  assembled  information  and  3ucUme^\ts>  it  might  be 


pOE?sible  to  design  several  specific  kinds^fc  strategies,  such  ay 


icUme 


^    '  ,         •  ■  .V. 
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a)      campaigns  targetted  a^t  potential  const! tuences  to 
-^publlcize  mpressive  system  outputs; 


-  educate  these  varloua^constltuenc^s *ln  the 

'  complexities  and  difficulties  in  educational 

,R/D6iI,  and  the  efforts  being  made  by  the  field 
to  overcome  these  problems  and  improve  its 
perfornance;  ' 

-  flevelop  under} tandiVig  of  what  ,norfc  Is  needed 
befoXe  specific  future  systen\  future  system 
!>reakthroughs  of  significance  ape  likely>  to  be 
produced;  and  ^  ■ 

-  generate  support  in  eacrt  constltuenc^^nd^uilling-- 
ness  to  help  the  system  get  what  it  .needs  jCO  bring 

,  about  these  future  breakthroughs? 

b)  *    funding  programs  to  support  the  staged  agendas  of  researchable 

programs  developed  by  the  Institute'^  panel  of  eminent  re-  . 
.  searchers  in  each  segment  of  the  knowledge  and  technology 
J  base  determined"  to  be  a  high  priority  area  of  development, 
to  speed  the  achievement  of 'significant  breakthroughs  that 
are  uithin'reach  and  others  that  are  of  fundamental  signifi- 
cance but  are  riskier  and  will  require  longer-term  commit^, 
ments?  and 

c)  funding  programs  to  attract  critical'nasses  of  talent  irJ  given 
areas  of  the.  knovledge  and  technology  base  in  need  oE 
development. 


r 
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To  determine  how  effective  such.  str<Ktgies  harf  been^  it  would  seem 
itnporcant  to  be  able  c^j^nitor  infract,  if  even  in  th<;  roughest  of 
ways,  e»g.:  in  teriftg  of  B(f3gnents  ^of  knowlcdgeables  about  what 
effects  eaoh  strategyithas  had  on/a  number  of  dinensions: 

^  J 

"  quality  of  system  output/s,  and  their  imp^c  on  the  operating 
system,  and  especially  pn  students; 

/ 

-  speed  with  which  they  ire  produced  /  relative  to  rates  o£, 
development  of  comparable  outputs  in\the  past; 

knowledge  and  tecl^nology  base  in 


-  gains  m  tho  system  s 
particular  areas;  \^ 


-  gains  in  the  attraction  Vnd  development  of  a  high  calibre 
personnel  pool  in  given  ar^as  of  research  and  R/D&I  activity; 

-  effects  on  the  level  of  supports  accorded  the, system  by  each 
potential  constituency;  ^ 

-  effects  on  the  pattern  of  demands  made  on  the  systems 

-  effects  on  funding  levels;  and 

-  effects  on  the  conduct  of  various  R/U&l  system  functions  and 
such  other  comparative  system  features  as  institutional 
conf igurationj  information  flowT^pnd  research  on  the  R/D£tl  - 
system, 

i 

There  is,  of  course,  no  precise  way  to  neasure  such  dlmensloas,    Norj  in 
the  absence  of' me^if^ureme^it  or  baseline  information  or  controls,  is  there 
any  way  to  attribvfte  judged^  gains  on  one  or  another  of  these  dimensions 
,    to  a  pp.rticular  strategy  that  might  have  been  implemented.    Still,  if 
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we  could  get  even  these  rough  judgments  from  knowledgeable  obst-rvers, 
we  would  prob^blv  be  in  a  significantly  stronger  position  than  ve 
'  are  now  to  improve  envirunnencal  influences  on  the  educational  R/D£.I  ' 
sy  s  t  em . 

V.  CONCLUSIONS' 

— "  '  ~~ —  * 

We  have  focused  in  this  chapter  on  how  the  environment  of  the  educational 
r/DS1  system  acts  as  a  constraining  influence,  impairing  syste-T 
functioning  directly,  arid  also  Indirectly  by  making  it  more  difficult 
to  ac<^uire  the  quantity  and  quality  of  funding  and  personnel  Inputs 
needed  for  high  level  system  functioning. 

To  improve  ,the?"  system's  e^ironment*  it  seems  rtecessary  to  improve  the 
system^s  image .     But  such  image  building  seems  offensive  to  many  (even 
many  who  could  gain  from  it),     It  may  seera  offensive  because  public 
relations  campaigns  tend  to  be  viewed  as  self-serving  lying  (or  at 
the  very  lea5t>  exaggeration)-    Or,  It  may  b?  that  researchers  and 
R&fti'personnel^  feel  that  their  time  should  be  devoted  to  their  work> 
and  that  If 'their  work  Is  of  sufficient  quality  the  "public  relations" 
will  take  care  of  itself,  ^ 

Regardless>  the  options  are  either  to:     (a) 'do -no  thing>  and  hope  that 

over  time  the  quality  of  Outputs^wlll  improve  sufficiently  so  that 

the  public  relations  will  take  -are  of  itself;"  or  (b)  invest  heavily 

in  capacity-building  work  and  in  the  projects  likely  to  produce 

V 

quality  outputs  In  the  near  term  (so  that  in^ time  the  public  rela- 
tions will  take  care  of  itself);  or  (c)  to  try  to  intervene  directly 
in  inprovlr,^  the  systerr-'s  environment>  so  that  it  will  be  easier 
to  attract  the  needed  qJ^ntity  and  .quality  of  inputs^to  raise  the 
quality  of  outputs  (so  that  in  time  the  public  relations  will  take 
care  of  itself);  or  Cd)  some  Combination  of  these  possibilities. 
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Ac  the  very  leas;,  it  would  seem  Lmporcanc  £or  some  consideration 
of  those  options  ^ind  sone  clear  thinkLng  on  which  of  the^e  courstis 
is  to  be  followed,  so  chat  *oas  way  or  the  other  In  the  future,  the* 
system's  environ^^ent  will  be  less  powerful  a  constraint  on  educational 
R/DSI  functioning*  ^ 
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One  critij^al  feature  for  analyzing  any  R/D6cI  system  is  the  set  of  goals 
that  describe  what  the  system  is  intended  to  achieve  and  ^Ae  policies 
and  strategies  developed  to^achieve  these  goals/   In  the  case  of  educ^- * 
tional  R/DSI,  the  analysis  of^goals,  policies,  and  strategies  is  a 
difficult  (some  might  say,  icapossible)  task.    There  are  at  least  two 
reasons  for  this.  ^ 

One,  IS  ch^ic  education  by  its 'very  nature  is  a  field  with  somewhat 
amorphous  goals  that  lack  the  clafity  and  ease  of  ot>erationalization 
of  many  other  fields,^    Educational  R/D6cI  tends  to  share  this  problem 


with  the  whole  broader  field  of  education. 

Second,  the  educational  R/D£^I  system  in  the  United  States  \s  not  an 
easily  boundable  entity  made  up  of  clearly  ident if  iable  ^its  estab- 
lished and/or  i^naged  by  a  central  goal-setting,  policy  making  body 
(or  even  a  coordinated  interrelating  set  of  goal-setting,  policy 
making  bodies)-    There  is  some' disagreement  in  the  field  as  to  whether 
it  is  reasonable  to  even  think  of  educational  R/D^^I  in  this  country  as 
a  "systenit"    An  alternative  conceptualization  proposed  by  Cuba  Aid 
Clark  is  that  of  a  ''configuration'^  of  co-equal  institutions  who  ^ire 
independent  of  one  another,  have  no  cotnmon  conception  of  R/D6cI  goals,* 
operafe  with  little  relationship  to  one  another,  and  (for  most  of  the 

institutions  in  the  configuration)  view  R/D5tl  projects  as  suboriinate 

2 

in  importance  to  other,  mtfre  primary  activities*      If  the  conf igurational 
perspective  is  accepted,  then  there  is  no  "system"  whose  goals,  policies, 
etCt    can  be  analyzed  and  therefore  little  point  in-trying  to  abstract 
from  the  functioning  of  the  different  R/D6cI  institutions  the  goals, 
strategies,   etc*     of  a  ''system'^  that  is  in  reality  only  a  fiction. 

The  other  side  o£  this  debate  is  that  there  aiza  subtitantial  potential  p 
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benefits  to  be  derived  from  thinking  of  the  ^dwcationaL  R/D&I  coiifigura 
tion  in  syscem  terms  and  treating  at  least  certaj^n  aspects  of  tli«  con" 
'figuration  as  though  there  was  in.  fact  a  syst^^.    This  is  the  position 
we  have  generally  taken  in  other  analyses  ttTat  we  have  produced.^  We 
will  suggest  ^ome  of  the  benefits  we  see  in  that  approach  her^  in  this 
chapter* 

4 

We  consider  policy  and  strategy  questions  throughout  the  analyses  in 
this  volume:    Other  chapters  deal  with  policy  and  strategy  issues 
specific  to  individual  R/D&I  functions  (research^  de\jrtltepment:,  etc.) 
or  sy^^m''?^tures  (the  institutional  base,  personnel  oase ^  funding, 
information'  flow,  etc.)-    In  this  chapter,  we  examine  masters  of  pQlicy 
and  st^y^egy  on  a  macro  level. 

Our  concern  in^this  chapter  is  with  some  overriding  issues  to  be  con- 
sidered in  thinking  about  macro  level  goals^  pcrlicies,  and  strategies. 
After  taking  note  of  the  literature  we  have  been  able  to  locate  on 
(or  relevant  to)  these  *«^ttersj  we  presen^a  number  of  key  issues  and 
explore  arguments  that  might  be^made  for  and  against  various  options* 
We  then  take'^  broad  overview  of  the  history  of  educational  R/D&I  in 
this  country  over  the  pasf  two  decades  or  so  and  examine  wha*t  has  ^ 
^appened  in  relation  to  each  of  these  issues  and  options*    In  the  . 
eour^3  of  this  overview  we  note  some  of  the  political  and  other  en- 
vironmental  forces  that  imping  on  the  processes  of  goal-setting  and 
policy  formation  for  educational  R/D&I,  ^  We  next  identify  the  issues 
t^at  sed(ti  to  us  to  define  the  current  ;lebate  on  system  goals  a^d 
strategies*    We  turn' then  ^to  the  kia^-  c*^  data  that  may  be  ne'feded  tcf  ' 
support  priority  determination,  strategy  development^  and  planning*  We 
conclude  by  sugg^estlng  the  n«ed  for  consensus  building  mechanisms  to* 
lessen  the  sharp  discontinuities  that  have  marked  the  history  of 
edqf  ational '"R/D^il  over  the  past  two  decades* 


I.       OVERVIEW  OF  THE  LITERATURE 

We  have  been  able  to  locate  only  a  handful  o£  discussions  in  either  the 
publi'shed  or  ESyCC-accessed  literature  relevant  to  ^  consideration  o£ 
macro-*Level  educational  R/D6fl  goals,  policies-,  and  strategies* 

There  are  some  analyses  o£  mission  development  or  goal-setting  and 

policy  development  at  the  level  o£  individual  Institutions,  agencies, 

or  other  R/D6cI  sponsors.^  (particularly  use£ul  here  is  the  analysis  o£ 

policy  laanagetnent  contained  in  che  1969  status  report.  Educational 

*     5)  ' 

'Research  and  Development  in  the  United  States. 


And  too,  thexe  are  a  few  £ascinating  atialyses  of  the  political  and  other 
forces  that  were  Involved  in  policy  formation  for  educational  R/D6cI  in 
the  '60s        one  piece  on  the  Jo|^son  administration's  strategies  for  cir- 
cumventing the  federal  bureaucracy,  Congress,  and  education  interest 
groups  in  developing  education  policy^;^'Balley  and  Masher's  classic 
study  of  the  policy  proce^^^  surrounding  the  early  history  of  the 
Elementary  and  Second'ary  Education  Act;    and  Dershimer's  very  important 
history  of  j^he  development  of  federal  R5D  policy  for  education  in  the 
'66s,    ■  A  more  recent  analysis  by  Roald  Campbell  and  a  panel  of  con- 
sultants cotnmssioned  by  NIE  describes  some  of  the  elements  in  the  con- 
text in  which  NIE  must  make  policy  —  organized  interest  groups," 

Congress,  NIE  staff,   the  National  Council  on  Educational  Research,  and 

9 

other,  partis  of  the  executive  branch-      A  careful  reading-of  these 
sources  raises  questions  about  the  relative  importance  in^the  policy 
development  proces*  of  executive  branch  bureaucrats.  White  House 
staffers,  mecabers  oE  Congress  and  their  aides,  education  interest 
groups,  key  /'inf  luentials      etc,    Reading  between  the  lines  in  these 
historical  discussions  can  also  be  %ug^e3tive  about  some  of  the  over- 
riding macro,  level  issues' policy  make'ss  were  confronting. 


J 


it  best,  though,  these  sources  can  be  assessed  as  dealing  with  matters 
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at  the  fringes  of  the  matters  of  central  interest  to  us  here. 

The  literature  that  deals  more  directly^with  these  issues  is  of  four 
types;  ' 

1,  assessments  of  the  inadequacy  of  macro  level  goal 
definition  and  strategy  development; 

2,  presentations  of  frameworks  for  educational  R/D6tl 
goal-setting  and  policy/strategy  development^which 
pinpoint  (impli^iitly  or  explicitly)  a  number  of  key 
issues ; 

3,  historical  overviews  suggestive  pf  the  different  balances 
that  have  existed  on  several  of  these  issues  (by  intent  or 
by  default)'at  different  times  over  the  past  two  decades; 
and  * 

4,  analyses  that  present  somewhat  different  goals  and/or ^ 

f 

strategies  for  educational  R/D6tl^  based  on  judgments  that 
what  has  occurred  up  to  that  point  has  perhaps  been  mis- 
guided, based  on  faulty  conceptions  of  the  way  educational 
R/D6tl  or  improvement  OlC  practice  take    place  now  or  could 
take  place  some  tim$  in  the  'futur^*^ 

At 

1.      Assessments  of  Vtie  Inadequacy  of  Macro  Level  Goal  Definition  and 
Strategy  D^j^^lopment 

-<  ^ 

Almost  from  the  very  beginning  of  federal  policy  intervention  to 
establish  an  educational  R/D6tl  system,  the  evaluative  literature  has  . 
identified  one  major  area  of  weakness  as  inadequate  goal  definition 
and  strategy  development,  poor  communication  of  goals  and^strategies, 
and  minimal  (if  any)  effort  towa^rtl  achieving  some  ccJrisensus  on^goals 
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and  strategies.    This  was  suggested  most  strongly,  for  instarfce,  in  one 
early  critlqua  by  Stephen  Bailey,  who  (among  other  important  roles)  Jiad 
spent  a  year  studying  the  operations  of  the  Office  o£  Education  and 
also  served  as  Chairman  of  the  National  Advisory  Conuaittee  on  Educa- 
tional Laboratories  * 

Vary  little  coherent  thinking  of  a  strategic  and  tactical  kina 
has  emerged  from  the  Federal  Government  about  educational  RM) 
priorities,  about  adequate  and  durable  funding  levels/  about 
effective  instrumecvts  for  evaluatiorr^  dissemination ^  utiliza- 
tion, ana  coordination  of  results*    This  lack  has  been  explained 
on  the  triple  grounds  of  mandated  speed  in  disbursing  funds^ 
lack  of  adequate  staff,  arid  the  hoary  notion  that  the  Federal 
Government  should  leave  the  direction  of  education  to  the  mercies 
of  pluralistic  and  often-contentious   centers  of  decentralized 
authority:    state,  local  and  univers i ty . 

The  point  vas  made  ^fJarticularly  well  in  the  documents  produced  as  part 
of  the  1969  OECD  review  of  educational  R6tD  in  the  United  States  (under- 
taken by  the  Organisation  for  Economic  Cooperation  and  Development  as 
one  component  of  a  -broader  assessment  of  educational  RM)'' systems  in  a 
number  of  nations).    One  of  the  key  conclusions  of  the  OECD  examiners 
was  that  inadequate  definition  of  goals  and  objectives  at  the  federal 
level  vas  a  central  problem  for  educational  R^tD  in  this  oountr^y.  They 
took  note  of  the  decentralized  nature  of  educational  de'cision  making 
in  this  country,  burc  even  so  they  asked,  "How  does  one  detertnirte  how 
to  allocate  resources  without  a  specific  statement  of  objectives  and 
goals?"^^ 


The  critique  was  toade  in  even  stronger /terms  by  the  Program  Planning 

* 

and  Evaluation  staff  of  OE  s  Center  for  Educational  Research  and 
Development  in  their  1969  status  report  prepared' for  the  OECD  review, 
in  their  condluding  chapter,  for  instance,  they  summarized  one  body  of 
evidenf^e  as  ^follows: 

/■ 


T 

230 


Probably  the  most  all-embracing  conclusion  that  can  be  draw^i  " 
from  the  daca  is  ::hat  no  Qverall  strategy  currencly  governs 
che  support  and  growth  of  educational  research  and  develop- 
meac  in  the  United  States-    Strategy  as  used  here  rexers  to 
an  overall  des^iga,  mapped  out  in  advance  with  a  set  of 
consistent  ^ad  "well-dfifined  goals  and  objectives^  and  a 
ma^tching  set  of  procedures  and  methods  ^ther  ideatified  or 
capable  of  be^ag  identified  to  attain  those  ends  This 
conclusion  does  not  refer  to  ^individual  prograas  or  agencies 
which  might  be  examined         which  have^  within    the  para- 
meters of  their  particular  responsibilities,  very  carefully 
mapped  out  strategies  and- are  syscernatically  pursuing  them* 
All  that  Is  being  said  here  -  but  It  is  cxiticaliy  important  - 
is  that  no  overall  strategy  exists  which  links,  or  provides 
for  the  linkage^  of  the  many  different  kinds  of  ^yfidividua  1 
efforts  which  are  Currently  b^ing  supported  in  the  field  of  ^ 
educational  research  and  development.  ^ 


The  following  year^  in  an<?ther  piece, Hendrik  Gideonse^  the  then  head 

of  the  OE  unit  which  prepared  this  documentj  described  the  OECD 

review  ^s  having  ''firmly  documented  the  absence  of  any  d^  jure  ^ 

13 

na?;lonal  research  policy  for  education/' 

f  ^ 
Five  year^  later,  in  1975,  expert  observers  were  still  pointing  to  the 
same- problem.     In  the  Campbell/Report  mentioned  earlier,  we  are  pro- 
vided with  the  findings  of  a  commissioned  review  of  NIE's  RM)  funding 
policies  b^  a  panel  of  prestigious  consultants*    It  is  clear  from  this 
document  that  the  panel  took  seriously  the  premise  that  NIE  was  established 
to  be  the  lead  agency  for  educational  R6tD,    The  group  examined  the 
agency's  strategic^ thinking  and  program  planning  and  design  processes 
in  terms  of  the  lead  agency  conception*    Some  positive  points  along 
these  lines  were  noted       for  instance:     ^'Serious  strategic  thinking 
(was)  done  in  preparing  the  Fiscal  1976  budget,  with  hard  choices 
made  and  priorities  set.*'    However^  as  the  lead  agency  for  educational 
K&Dy  NIE  was  called  to  task  for  failing  to  play  a  leadership  role  and 
falling  to  do  enough  hard  thinking  about  "the  more  searching  questions 
that  might  be  asked**'    They  noted,  for  instance,  that  "Each  of  the 
system's  insticution?    has  its  own  sense  of  function  and  interests, 
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and  with  few  exceptions,  inqiiiry  into  mission  priorities  is  not 
one  of  then  Their  call  was  for  riore  creative  leadershi;!^ of 

the  system!       coordinating,  dorng  strategic  thinking,  bMiLding 
consensus,  and  using  systera-level  monitoring  data  collection  and 
analysis  as  a  basis  for  strategic  thinking  and  decision  making. 

In  an  addendum  to  the  Campbell  Report,  Sam  Sieber  presented  a 
summary  analysis  of  design  retirements  or  underlying  dimensions 
essential  for  anything  one  might  call  an  educational  R6tD  system. 
One  set  of  systemic  requirements  he  dealt  with  is  in  the  area  of 
goal-setting:    **A  national         system  must  be  able  to  formjjlate  and 
gain  concensus  on  a  set  of  clear-cut  objectives  regarding  output,^' 
His  overall  assessment  of  §oal-setting  as  it  was  to  be  observed  in 
1975  ^-  ^JrTly  three  years  ago       was  that  the  conceptualization  of 
R6D  system  goals  and  the  developnent  of  consensus  on  priorities  was 
a  task  vhich  had  "barely  begun, 

ClearTy,  then,  a  consistent  theme  in  all  ^o£  this  literature  is  the 
inadequacy  of  macro  level  goal  definition  and  strategy  development. 

2*      Presentations  of  fragieworks  for  Educational  r/d&I  Goal-Setting 
and  Policy/Strategy  Development 

We  have  located  five  items  in  the  lit^erature  which  present  frameworks 
useful  for  thinking  about  educational  R/d^I  goal-Setting  and  policy/ 
strategy  development,    Hendrik  Gideonse  was  the  central  figure  in  the 
preparation  of  three  of  these  pieces        two  sections  in  the  1969.  OE 
Educational  Research  and  Developn^ent  in  the  United  States  prepared 

1 6 

by  Gideonse- and  his  staff  for  the  OSiCD  review  (as  discussed  earlier); 

the  third,  an  article  by  Gideonse  which  appeared  the  following  year 

in  "Science.        The  fourth  piece  we  include  in  this ''betegory  is  Sam 

Sieber's  analysis  of  the.  design  requirements  for  a  national  RM)  system 
18 

for  education.        The  fifth;  a  policy  analysfs  we  prepared  for  NIE 
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iQ  1976j  relates  syscem-baildicig  purpol^es  co  other  aspects  of  NIE's 

mission  as  the  le^d  ageacy  for  educs^tlonal  R/D^X  ?nci  suggests  some 

implications  for  planning,  policy  d<;ve lopirtent ,  and  allocation  of 
19 

resources.       Ue  consider  each  of  these  pieces  in  turn. 

Wh^t  sort    of  issues  and  data  aeed  to  be  considered  in  the  various 
stages  of  the  process  of  goal-secting,  policy  devel^opcnent ,  and  policy 
management?    The  DE  status  report  presented  a  conception  of  policy 
management  for  educational  R6D  which  included  the  following  steps 
and  activities; 

Identifying  the  overall  goal  and  clarifying  basic  assumptions 
Identifying  the  priorities 

-  "  Xdentifyicig  R£tD  goals 

Identifying  specific  objectives 

-  Choosing  among  aHernative  project  and  program  activities 

in  terns  of  service  to  goals  and  objectives 

Xmpleoenting  and  monitoring  specific  projects  a,nd  programs 

-  Developing  and  sustaining  communication  networks  to  insure 

appropriate  and  adequate  inforsiation  flows  for  planning 
purposes 

-  Developing  appropriate  data  input  mechanisms  for  planning 

and  'feedback  mechanisms  for  program  evaluation 

Provi<^ing,  identifying,  and  recruiting  supplies  of 
appropriately  trained  manpower 

"    Evaluating  the  impact  of  R£i>^itL  terms  of  the  overall  goal  of 
the  program. 
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la  a  later  seccioa,  che  OE  status  report  presents  three  differeac 
perspeccives^.^hich  raise  che  kinds  of  issues  Gideoase  and  his  staff 
viewed  as  central  to  the  developmeat  of  a  compreheasive  strategy  for 
educational  R&D*  *  ^ 

The  K&D  policy  strategy:    Of  particular  importance  here 
^re  conceptions  of  "the  lon*g-term  goal  for  the  relation* 
ship  of         to  education"  (e.g.,    assuming  that  research 
may  or  research  can  improve  Education) j  wich  different 
implicacions  for  R^cD  policies  on  funding  and  building 
personnel  and  institutional  capabilities. 
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2.      Educational  policy  strategy:    How  does  one  bring  together 
the  sc  ient  if ic/ technical  and  professional  education 
communities  for  the  establishment  of  RixD  priorities  and 
for  decision  caaking  on  K&D  programs? 

3-      Change  process  strategy:     In  what  ways  can  scientific 
knowledge  affect  educational  practice?    How  can  educa- 
tional technology  or  ^'engineep^g"  develop  useful 
applications  of  new  knowledge  for  improvement  of  educa- 
tional practice?    How  does  one  diffuse  educational 
innovations?    What  change  processes  are  likely  to  be 
nost  effective  in  bringing  about  che  improvement  of 
educational  practice? 

We  shall  explore  these  issues  more  fully  later  in  this  chapter.  ^ 

Many  ot         ideas  suggested  in  the  OE  volume  were  systematized  and 
elaboraclro  by  Gideonse  in  his  subsegjJent^yfecience  article.    He  pre- 
sented ^  seven-part  analytical  structure  comprised  of  five  primary 
ej^iments  ^(cpntests,  goals,  models,  manpower  and  its  location,  and 
decision  structures)  and  two  seconddry  elements  (priorities  snd 
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objectives,  on  the  otie  hand,  atid  strategies  atid  tactics,  oa  the 

other).    The  secondary  elements  are  produced  by  interactions  among 

20 

the  prtmary  elements.    Abstracting  from  th^  presentat ion,  the 
scheme  can  be  sucimarized  in  outline  form  as  follows;  ^ 


1.  Contexts  in  which  policy  issues  in  edyjcational  operate 

1 ,      soc  ial,  political,  economic ,  and  phi  iosophical 
contexts :     understend Ing  the  present  (its 
achievetnents  and  problems),  aLteraatives  open  to  ^ 
us  in  the  future,  philosophies  which  guide  the 
nation's  view  of  education  and  it#understanding 
oi  children  both  as  learners  and  as  present  and 
future  c itizens  ^ 

ii  *      educational  policy  issues:     short-term,  middle-  ^ 
range,  and  long-range  goals  of  the  educational 
system 

'iii-      educational  system,  both  core  and'per  ipheral :  in 
order  to  improve  educational  functions,  it  is 
essential  to  understand  the  established  educa- 
tional structures^  h^  they  operate,  what  their 
traditions  are,  and  how  they  view  themselves 

iv,      science  policy;    understanding  resources  avai  lable 
for  RfitD  in  education  as  part  of  the  available 
national  resources  for  scientific  research 

2.  Goals :    the  ultimate  purpose  of  educational  (e,g,, 

Is  pursuit  of  knowledge  the.  goal  since  it  miRbt 
in  some  way  or  other  impro\#e  education?    Or,  is 
brinaioR  about  improvemeat Fof  education  the  goal 
with  creation  of  knowledge  only  a  means  to  that 
end?) 

3.  I^esearch  Definitions,  Models,  and  Descriptors:  what 

educational  R&D  is  an^TS^^not,  how  it  "works'* 
or  why  It  doesn't;  definit  ions  of  Rf^D  functions 
and  how  they  relate  to  one  another  (especially  how 
KP  and  KU  are  related);  models  used  to  understand 
the  system^  ask  questions  about  it,  and  manage  it; 
understanding  of  the  disciplines  and  technologies 
of  educationcll  R6D  and  how  educational  R6tD  differs 
from  other  branches  of  science 


J 


I 
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4,      ^Unpc^wer  and  Its  tlocatlon:    how  manpower  roles  and  require- 
ir^ents  are  deiined  and  whars  those  kinds  ox  manpower 
can  be  xourid.    How  we  define  manppwer  in  the  field 
(researchers?    professional  faculties  of  education? 
pract it ioners?    parents?     learners? )  affects  ans'^ers 
to  questions  about  avaiiabtlity  of  manpower,  its  location, 
and  what  might  be  requl«d  financially^  administrative- 
ly>  or  po*ti*£ically  to  make  use  of  it"  effectively^ 

t_ 

5,  Dec  is  ion  structures :    what  kinds  of  decisions  have  to  be 

made,  how  they  are  made^  and  who  matdes  them.    How  R^D 
'  is  defined  affects  the  nature  of  the  decision  process 
and  who  is  involved  in  it*    So  will  the  analysis  of 

^  con^textual  issues.    Depending  on  the  emphasis  given 

to  the  role  of  the  science  policy  context  as  con- 
trasted to  the  educatignal  policy  or  educational 
system  context^  differences  will  emerge  in  structure 
and  in  the  personnel  involved*    If  educational  research 

t  is  seen  as*a  social  and  political  enterprise  as  much 

.as  a  scientific  one  ^  thsA  the  decision  structiAres  will 
reflect  that  * 

6,  Priorities  and  ebjectives,  developed  after  consideration  of: 

the  congruence  between  what  society  needs  from  its 
schools  (in  the  short-^  middle-^  and  long-term  period) 
and  what  it  is  getting;  the  state  of  knowledge  and  of 

technology;  the  availability  of  manpower?:;  costs; 
benefits ;  scale ;  political  acceptability;  etc  * 

7,  Strategies  and  tactics,  reflecting  what  needs  to  be  supported, 

who  is  to  play  a  role^  decision  structures,  modeLs  or 
cfonceptions  of  education  R6Dj  conceptions  of  the  kinds 
of  manpower,  needed  to  play  different  kinds  of  roles  and 
wher«  such  manpower  might  be  found  or  rniSht  be  expected 
to  work. 

■)  ^ 

The  Gideonse  policy  framework  is  impressive  in  scope  and  extremely 
useful  for  thinking  about  policy  planning  mechanisms  and  especially 
data  bases  to  be  developed*    We  shall  return  to  this  point  latei?*  A 
somfewhac  different  but  also  highly  useful,  broad-ranging  approach  to 
thinking  about  the  development  of  educational  R/D6tl  policy  is  Sam 
Sieber's  analysis  of  systemic  requirements  to  be  borne  in  mind  by  policy 
makers  if  they  are  at  all  serious  about  creating  a  ''national  R&D  system" 
in  education*  -  --^n. 
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Sieber's  fraciavork  iavolves  eight  r.equiremeats; 

1.  Functional  specializatioa 

2.  Balaace  among; 

a .  Functions 

b .  Performers 
c*  Setting^ 

d.    Decision  onakers  and  iafluentials 
_  e.    Supply  (R6D  resources)  and  demand  (for  these  resources) 

3.  '  Integr^tioa  (or  interrelatioa)  of; 

a.  Functioas 

b.  Settings 

c .  Performers 

d.  Decision  malcers  aad  iafluentials 
Supply  and  demand  . 

4.  Continuity  in;  ^/ 

a*  Policies 

b.    Tasks  and  substantive  areas 

c  *  Persoanel 

d*  Organizatioas 

5.  Adaptability  o£ ; 

a.  Policies 

b .  Functions 

c*    Personael  (or  criteria  of  selection) 
6*      Excellence  or  quaj/ity-coatrol 

7.      Goal-setting  (se'tting  of  iatertnediate  objectives  that  can 

be  operationalized  and  assessed) 
3,      Recognitioa  of  environmental  constraiats  and  poteatial 

constltueacies  (to  gain  realisfi  and  legitimacy) 

As  lead  agency,  NIE  might  use  a  scheme  built  on  these  elements  in  plaaning  and 
desigalag  programs  and  in  makiag  decisions  among  alternatives* *  The 
effect  might  be  to  increase  the  possibility  that  agency  actions  woul*d 
contribute  to  achieving  NIE'^  legislative  mandate  to  "build  an  effective 
R&D  syscem. " 

The  lead  agency  premise  was  central  to  one  other  piece  of  literature  as 
well.     In  the  policy  analysis  we  prepared  for  NIE  on  agency-field 
relationships, ^e  argued  that;     (a)  NIE  is  both  a  mission-oriented  R&D 
agency  and  the  lead  agency  for  federal  activity  in  educational  R6Dj 
and  that  therefore  (b)  NlE's  policies  should  be  developed  with  an 
understanding  o£  how  its  purposes  impact  on  the  total  educational 


I 

R/d^sI  system,         grouped  the  system  dimensions  of  NIE's  various  goals 
into  three  categories; 

producing  substantive  outputs  (knowledge^  products^  etc*) 
-    building  system  capacity  (institutiops ^  linkages^  personnelj 

etcO     ,  ,   ^ 

affecting  the  system's  environment  (support>  prestige^ 
legicimacy>  etc*) 

We  argued  that  procurements  tend  to  be  thought  of  primarily  fn  terms 
of  the  first  of  th^se  categories^  i.e.,  the  direct  purchase  of  R/D6tl 
acti\^ties  to  generate  kaowledge j  produce  products,  etc.    What  tends 
to  be  overlooked  is  the  extent  to  which  these  manifestly  single- 
purpose  pr9curements  tend  to  have  multi-purpose  implications.  '  In 
almost  every  procurement  (or  other  action) j  more  than  one  purpose  will 
be  involved,  whether  implicitly  or  explicitly,  and  whether  latent  or 
manifest.    Thus,  awarding  a  project  to  one  institution  (or  type  o£ 
institution)  rather  than  to  another  may  also  have  an  impact  on  the 
location  of  future  institutional  capacity  to  carry  out  certain  kinds 
of  R/Dal .    Both  within  single  procurements  and  across  an  agency's 
"portfolio"  of  procurements  J  we  noted>  there  may  be  various  kinds  of 
interaction  effects  among  multi-purposes.    The  effects  may  reinforce 
each  other  (synergistic  effects).    Or  they  may  ffe  incongrue^nt  and 
counteract  each  other  in  the  manner  of  *'anti-purposes (The  use  of 
RFPs  to  procure  certain  kinds  of  research,  for  instance,  might  have 
anti-purpose  effects  if  the  result  is  to  "turn  of£'^  the  best  research 
talent,  suggesting  to  them  that  research  funding  in  the  field  of  edu" 
cation  is^unlikely  to  be  forthcoming  v^ithout  untenable  constraints.) 
Such  effects  may  be  immediate  in  their  interaction  or  observable  only  : 
lagged    or  in  second-    or  third-order  manifestations. 

The  analysis  suggested  that  what  was  needed  were  deliberate  strategies 
to  capitalize  on  the  multiplicity  of  consequences  from  specific  actions 
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to  tnaxitnlze  possible  gains  and  minimize  possible  costs  from  potential 
multiple  anc!  Inttiracnion  ttffeccs.    The  argument  was  premised  on 

"'  thinking  of  educational  R/D&I  in  system  terms  and  noting  icey  features 
of  educational  R/D£il  that  made  the  assumption  of  a  system  leadership 
role  essential       e^g^t    the  size,  variabilltyj  and  immaturity  of  the 
s>stem  and  its  lack  of  self-controlling  and  self-organizing  capabili- 
ties.   If  the 'sysfen-buildlng  goal  of  NIE  is  accepted^  it  becomes  a 

*  key  criterion  in  policy  and  strategy  development j  planning^  and 
decision  roaklng.    We  shall  return  to  this  argument  later, 

3^      His ::or leal  Overviews 

We  have  identified  four  pieces  in  the  literature  which  take  note  of 
changing  emphases  on  some  of  these  key  Issues  over  the  past  two 
decades.    Generally^  thesfe  historical  perspectives  are  provided  to 
buttress  one  or  another  argument  about  what  is  needed  for  the  future^ 
based  on  perceptions  that  what  has  happened  so  far  has  been  problematic* 

In  arguing  for  greater  balance  as  one  of  several  design  requisites  for 
a  national  educational  R6tD  system>  Sam  Sieber  took  note  of  various 
imbalances  over  the  past  fifty  years  amo^  r/D£«I  functions^  performers, 
settingSj  and  participants  in  decision  making. 

Field  service  and  testing  were  supreme  fot  decades;  then  field- 
initiated  research  had  a  few  halcyon  years  under  the  Coopera- 
tive Research  Act;  then  product  development  was  tremendously 
inflated;  and  now  it  appears  that  dissemination  is  being 
pushed  to  the  fore.     (In  view  of  the  new  emphasis  on  dissemi- 
nationj  'care  should  be  taken  to  insure  that  we  do  not  return^^ 
to  the  days  of  field  service  in  a  vicious  historical  cycle.) 

Sieber  made  a  similar  point  in  an  earlier  piece  in  which  he  made 
mention  of  the  particular  institutions  and  personnel  who  b<jnef itt<i!d 
from  each  change  in  p^rogram  emphasis. 


239 


With  respect  to  balance,  the  USOE  seems  to  have  been  victimized 
by  the  pulling  aac  hauling  of  ^our  contending  forces  or  insti- 
utional  douiainsL    the  disciplines,  the  schools  of  educatiort,  the 
mission-oriented  programs  of  the  Office  itself  (and  their 
respective  lobbyists,  administrative  spokesmen ,  and  congressional 
supporters),  and  S£A*LEA  practitioners.    From  a  surfeit  of 
project  suf)port  during  the  early  years  ofvCRP  (Cooperative 
Research  Program) (applauded  by  the  disciplines),  the  Office 
moved  into  an  era  of  institution-building -and  developmental 
effort  (encouraged  by  the  managerial  elite  in  schools  of 
education  and  the  exemplars  of  DOD-incJustrial  work)  and  more 
recently  has  sought  legitimacy  frocn  practitioners  and  Congress 
by  promising  delivery,   impact,  and  c loser  "federal-state 
collaboration.    As  each  new  phase  was  entered,  older  programs 
were  emasculated.    What  emerged  was  a  medley  of  missions  and 
^  programs  that  lacked  any  seablance  of  balanc^i.^" 

< 

Shifts  in  organisational  and  macro  level  management  strategies  are 

23 

identified  in  two  other  *pi-^c^s        one  by  David  Clark,      the  other  by 
Ronald  Corwin, 


i 


Clark's  article  *traced  changed  emphases  in  OE  policy  from  that  of  a 
relatively  passive  bystander  collecting  statistics  and  disseminating 
information  (froa/^TPf?  when  OE  was  esta/^lished  until  the  passage  of 
the  Cooperative  Research  Act  in  1954),'^to  active  support  of  research, 
then  expanding  into  development  and  ('$ince  the  passage  of  ESEA  in 

r 

1965)  foi>rlng  on  creating  new  organizations  and  institutions  outside 
the  old  structures,    Withiiwt  using  the  term  ''balance/'  it  is  essen- 
tially greater  balance  he  too  was  calling  for  in  pointing  to  the ^eed 
for  constituency  building,  for  building  coalitions  including  diverse 
interests  and  emphases  (six  of  the  eight  groups  he  mentioned  as 
illustrative  are  from  the  older  domain  of  the  professional  educators 
rather  than  RctD),  and  reconceptionaliEing  RM)  in  a  way  that  allows  for 
and  even  encourages  the  active,  involvement  of  practice-bas^d  and  practice- 
related  settings  in  RiJ)  activities  and  decision  making. 

Corwin's  pl^e  focused  on  educational  research  and  examined  several 
shifts  in  emphasis  which  have  been  transforming  the  field: 


■^t  /    I)     '  from  scnall-scAie  f iel4-init ia ted  research,  to  large-scale, 
targtirced  R6tD  directed  by  funding  agencies;  ^ 

2)^  ^  from  research  carried  out  by  individual  researchers 

^(working  in  isolation)  to  large-scale  research  centers; 
and 


3Ji     from  a  laissez-faire  model  of  research  manag^^raent  (with 
»       ini^ti^^tive  apd  control  largely  in  the  hands  of  the 

individual  researcher)  to  a  more  bureaucratic  node  ' 
(where  initiative  and  control  are  generally  on  bureau- 
cratic  levels  higher  than  the  research'er 'co^ucting  the 
work,  often*  in  the  hands  of-federal  agencies  whose  staff 
design  the  research  to  be  performed).  \^ 

The  thrust  of  Corwin's  Argument, is  that  both  the  bureaucratic  mode  of 
research  management  and  the  funding  of  research  through  R^j)  centers 
^nore  the  realities  of  the  organization  (or  disorganization)  of 
research  in  this  dountry,  and  haye  ''accentuated  many  of  the  problems 
they  wer^designed  to  alleviate/'    E54>ecially,  they  ignore  the  distri 
buted  location  of  research*  talent^-arid  the  exis temi^^^of  'Rudimentary 
natural  research  communities"  wWich  need  to  be  sferenitthened >  Com- 
petitive research  procurement  and  funding  of'- r&searttr^h rough  R6cD 
centers  tied  to  specifi#c  Ip^tions  tend  to  undercut  the  development 
of  such  [research  communtt^^fcN.hich  cros^  instijtutional  "and  geographic 
boundaries.    Corwtn  atfflgS^fe  her^  the  organization  of  coalitions  of 
^researchers  functioning  mlgiven  research  areas  who-  comprise  sucV^ 
rudimentary  researcK  commimities.  .^"Such  coalition^  "would  provide  an 
imtefiendent  force  with  a  bargaining 'power  c^parable  to  that  ot  the 
^f^i^rdl  agencies  and  the^  universities /*    Eventually  such  networks 
might  expand  to  include  individuals  and  organizations  across  the 
institutional  spectrum  engaged  in  work  relevant  to  givgn  research 

areas.    3uch  research  networks  tqiglit  be  given  subccJnt rac t ing  responsi 

"ft 
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biLitles  for  desLgn^^  research  and  preparing  RPPs .    And  research 
might  be  funded  through  such  collaborative  networks  if  administrative 
procedures  and  researct^^  majaagem^nt  approaches  can  be  designed  that 
''cement  collaboration  on  a  larger  scale  than  we  have  heretofore  thought 
possible       Clearly,  the  argument  has  significant  implications  £gv 
goal-setting  and  policy  and  strategy  development  for  educational 
R/D&I.    We  shall  return  to  thel^latet. 

4-      Analyses  Premised       Differing  Conceptions  of  the  Nature  of 
^     *    Educational  r/DSeI 

Different  models  or  conceptions  x>f  the  nature  of  educational  R/d&'x, 
its  relationship  to  the  operating  system  and  to  improving  educational 
practiqe,  the  degree  to  which  it  can  or  should  be  thought  of  in 
'System-like  terms,  etc*         all  have  differing  implications  for 
answering  questions  about  macro  level  goals,  policies,  and  strategies. 
'Five  such^^analyses  in  particular  seem      to  us  to  be  particularly  ^ 
helpful-  4 


Three  of  these  suggest      the  need  for  more  attention  to  t-he  operating 

system,  its  needs  as  identified-^  by  practitioners,   its  capacity  to 

function  as  a  viable  settiag  for  El/D6tl  and  other  modes  of  self-renewal 

activity,  and  the  craft-lik&  nature  ofi  educational  practice  which  may 

explain  why  external  R£cD  has  so  little  observable  impact  on  schools  . 

and  classrooEtts-    We  refer  here  to  the  "market  model"  described  by 
25 

Hendrik  Gideonse,      the  .MIE  analysis  (prepared  by  Marc  Tucker  and 
other  key  members  pf  the  Institute's  staff)  on  "building  (KPU)  capaci-ty 

for*  renew^  and  reform,'*      and  DJ|vid  Cohen's  view  of  educational 

*  ^  27 

practice  as  a  cra£t-like  ELeld. 

+  * 
Two  other  analyses  focus  on  the  issue  of  whether  educational  R/D&I 

can  most  usefully  be  thought  of  as  a  "configuration"  or  a  "system," 

each  suggesting ^different  approaches  to  macro  level  policy  and 
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Strategy  development.  We  have  taken  noce  of  they^;  pieces  ^ef ore ,  and 
will  ^consid^r  the:?,  again  here  Cuba  and  Clark's  £ormulacion  of  ''the 
coaf iguraciop.al  perspective^'  and  our  policy  analysis  for  on  the 
program  planning  and  decision  making  implications  o£  conceiving  of 
educational  R/D&I  as  a  system  and-acOing  on  KI-E '  s  mandate  to  functi^an 
as  Che  lead  agency  for  federal  activity  in  educat tonal ^li&D . ^ 


A  sjimmary  o^*'t;^e  relevant  arguments  made  in  each  O'f  th^se  pieces  would  ^ 
seem  to  be  injo^^er. 

in  his  diS'^ssion  of  a  "market  i^TOdel"  for  educatioaal  RSlB,  Gldeo^se  ^ 
argued  that  the  dominant  ''science"  or  model. was  based  on  farilty 

conceptions  of  how  improvement  is  likely  to  come  about  in  a  field 
like  education.    As  described  by  GiaeoaSe,  the  science  model  assumes 
that  'education  will  be  improved  as  a  result  of  ingenious  in^^ntion 
based  on  sound  research*    the  market,  if  it  is  thought  of  at  all,^ 
is  conceived  as  ^passive  target  user,  and  i^^is  simply  assumed  that 
J        the  fruits  of  external  R6lD  will  be  adopted,  aW  used,  because  of  their 
power  J  logic ,  qua  lit y ,  ef fectlvaness j  etc .    The  driving  force  deter^ 
mining  what  is  to  be  produced,  in  this  "science  model"  is  "the  theoretical 
or  technical  possibilities  emergent  from,Jt£tD,"  and  the  focus  of  atten^  , 
t^orv  is  on  the  state  of  the  relevant  knowledge  and  technology  bases 
and  the  capacities  of  R&D  performer  institutions  and  personnel.  ^ 

Instead,  Gideonse  argued,  the  focus  c^f  attention  should  be  on  "market  ^ 
requirements  and  possibilities"       what  ^he  conditions  of 'that  market 
are  and  how  change  in  that  market  occurs  (if  it  occurs  at  all),  what 
potential  clierfts  define  as  needed  and^ desired,  what  they  are  (and 
arc  not)  likeLy;to  use,  how  the  aeeds  they  identify  aad  their  adop- 
tion/implementation  choices^re  affectedly  ^alue  choices,  etc*  As 
*       we  shall  see  shortly,  this  market  model  has  major  implications  for 
almost  every  issue  of  macro  level  goals,  policies,  and  strategies 
we  might  consider.  ^        ,        ^  ^ 
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the  market  ^Orient^tiorr  is  cleanly  borne  in  (ai«d  in  '^Building  Capacity 
toi}  RerTtewsl' ;4nc!:  Reform/'  a.  key.UlS  ^^9^"^^^  ^         planning  do'curn^t^ 
prepared  earty  in^T^^'s  history  by  *>iarc  Tubker' ai>d  other  Hey  kxe 
staf£  members*    Iti  this  important  agehcy  df^cdm^nt,  Tucker  and  his 


colleagues,  noted  th«  various  policy  cti5xces  Which  had  b^n  made  in 

ih^  previous  decade  that'^'^r^ted.a '^.y^'te^j  Of  new  institutions, 

exijernal  to  the"  operating  sysi;em  and  "to  the  establiehed  units  in 

univef^srrtt^  which  ha^I  tra^it ionallV  comjucted  research  on  education 

and  ^jrovided  s€)&viee's  for  .school  jjy^tecis*  tin  partipular,  they  noted 

the  decisions  (a)  qoi^  to  support  deVeJrapment  of  local^chool  systeaV^ 

capacity,  , and'  Xh)  to  target  R£(D '  toward  prcbleais  identified  on  9 

the  national  rather  than  uhe  L'ocal  level.    They  called  for  a  re- 

thinkiag  of  the  doitiirtant  linear  paradigm  of  R^tQ  thinkit^  and  a  restota 

%^ 

tion  of  greater  balance  betweeri  support  for  external  R6cD*ahd  opsra-  ' 
ting  system  self -renewal *    Among  the  kintls  of  programs  described  as 
lieeded  were  programs  aimed  at  building  operating  system,  capac  icies 
for  R&£)  as  well  as  other  approaches  to  locally  defined  and  imple- 
mented self- improvement  * 

In  a  manuscript  currently  being  drafted,  David  Cohen  argues  that 
various  K&D  and  educational  reform  projects  ran  into  trouble  because 
"they  fundamentally  misconceived  the  nature  of  practice."    He  faults 
the  "science  view"  which  he  describes  as  assuming  chat  practice  can 
be  improved  through  improvements  developed  in  settings  external  to 
schools  and  classrooms  --  through  improvements  in  the  knowledge  base 
of  the  ti^d  J  or  the  materialsj  technologies,  or  strategies  used-  by 
educators  1  or  other  approaches  to  remaking  practice  from  outside  the 
practice  system  by  specialists  who  are  not  themselves  practitioners* 

Cohen  proposes  as  an  alternative  c'once ptuaH^^^rrfon  a  view  of  educa- 
tional practice  as  a  craft*    As  suchj  its  improvement  is  c^ependent 
on  experlental  knowledge j  trained  judgmentj  and  skill,  which  require 
developing  resources  within  the  work  setting  of  practitioners 


providing  the;  kinds  of  supports  that  allow  such  kciovledge  to  be 
gecieratedj  actU'nulaCtidj  acid  comuciicaced  ^mocig  practitioners.  As 
in  the  case  of  Gideonse*    market  ocKielj  this  craft-like  view  of 
educational  practice  has  major  implications  for  probably  every 
issue  of  macro  level  goalSj  policies^  and  strategies  we  might  con- 
sider.   We  shall  .e^ftp lore  some  of  these  implications  shortly. 


Finallyj  we  conclude  this  section  by  alluding  again. to  the  debate  ^ 
between  adherents  bf  Cuba  and  Clark's  "configurational  perspective" 
and  of  the  more  ^^systesi"  perspective  we  {and  others)  have  found 
useful.    We  have  referred  to  thiis  debate  earlier  in  thli^chapter  and 
examine  it  in  so:ne  detail  in  our  chapter  on  the  insti^tlonal  base 
of  edu<^ational  R/D^I*    At  this  pointy  it  should  be  noted  that  both 
perspectives  assume  that  earlier  conceptualizations  were  faulty  and 
created  problems  which  impaired  r/D^I  functioning* 

Guba  and  Clark  a^rgued  that  the  ''unified  system  approach:**     (a)  was 
based'  on  '*untenable  assumptions  about  how  things  ought  to  be*'  rather 
Chan  the  empirical  realities  of  the  world  of  educational  KPU; 
(b)  created  unrealistic  expectations  for  educational  R/D6I  performance; 
and  (c)  Ignored  the  legitimate  interests  of  various  institutions j 
agencieSj  and  individuals  who  are  essential  parts  of  the  educational 
KPU  community.    The  result,  as  they  described  itj  has  been  to  - 
provoke  **breakdowns j  hostilities,  and  failures"  which  have  function^ 
as  barriers  preventing  t\\e  emergence  of  a  needed  educational  KPU 
constituency.    **Such  a  constituency  can  emerge  and  flourish  only 
to  the  extent  to  which  there  exists  a  conception  of  educational  KPU 
to  which  all  can  subscribe*" 

On  behalf  of  the  '*system*'  vtew,  Ue  have  ^frgued  as  follows;  There 
are  several  distinct  macro-level  policy/strategy  advantages  in 
treating  the  educational  El/Dfid  configuration  as  though  it  were  a 
system*    This  view  permits  the  analyst  to  consider  policies  in  terms 
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of  their  iateraccioas  and  s^de-effects  as  they  may  impact  the  whole 
domain  of  educational  R/D£|E.    Th^  view  orients  the  policy  and  strategy 
pl^iaaer  toward  th^systetn-fbuildiag  requirements  of  an  immature  coa- 
figuration  such  as  exist^Va  educational  R/D6tl        for  instance, 
y^toward  the  systeHi-capacity-<lfeveloping  aspects  of  other  R/D6tl  acti- 
vities,   ^ftid  the  view  emphasizes  such  key  system  design  requisites 
as  the  needs  for  balance  and  integration,  which  might  not  receive 
adequate  attention  from  ^ote  atomistic  conceptions  of  educational 

R/Dil.        ,  \  '  , 

/ 

-  \ 

Clearly,  then,  these  conceptions  are  of  considerable  significance 
for  the  way  one  resolves  fundamental  issues  about  macro-level  goals, 
policies,  and  strategies  for  educational  R/D6tl.    We  turn  now  to 
consideration  of  some  of  these  issues. 


ERIC 


2i6 


II.      CENTRAL  ISSUES 


I. 


In  a  recent  art:icle>  David  Clark  called  for  the  development  of  a  broad 
coalition  of  diverse  interests  and  the  creation  of  a  national  confer- 
ence boaard  typ^of  mechanise  to  permit  this  coalition  to  engage  con- 

ticiaally  in  debate  and  formulation  of  policy  placforms  for  educa- 
30 

tioaal,,R/D6I.        In  illustrating  :;hy  he  thought  this  necessary^  he 
cited  a  description  of  the  public  policy  process  provided  by  Stephen 
Bailey  acid  his  associates  in  their  study  of  school  politics  in  the 
Northeast.  ^ 

t  ^ 

Sonie  people  want  something  froD  governn^ent  and  build  a 
coalition  of  influence  co  gee  it;  -other  people  want  some- 
thing different  and  build  a  coalition  of  influence  ft? 
block  crc-tnodify  the  designs  of*  the  first  group;  strategic 
*      and 'tactical 'campaigns  are  fought  j  constitutional  wielders 
of  power  determine  winners  and  losers  by  laws  passed  and 
executive  and  judicial  actions  taken.    The  process  is 
never-ending.    As  soon  as  a  governmental  decision  is  made 
a  new  dialectic  begins. 

Our  reading  of  the  educational  K/Dt^l  literature  and  our  observations 
on  the  history  of  the.  past  two  decades  suggests  that  the  dialectic 
over  e^iucatiocial  R/DSd  in  this  country  has  revolved  around  variants 
of  six* interrelated  issues: 


1,  Can  systematic  inquiry  increas,e  our  understanding  of 
education?    And  even  if  it  can  increase  our  understandicrgj 
can  systematic  research  and/or  systematic  R6J)  lead  to 
improvement  of  educational  practice? 

2.  What  IS  the  proper  role  of  che  federal  government  in 
relation  to  systematic  inquiry?     to  the  improvement  of 
education?    to  RfiJ)  for  the  improvement  of  education? 


Who  shall  define  the  goals^  priorities^  etc.^  for  educa^ 
tior.al  R/Dc;I?    Should  some  effort  b€i  ziade  to  balance 
social  deniands  against  R/D£tl  f ield/corxiunity/systen 
requirementsfT'Tnd  if  so^  how?    What  is  the  proper  role 
here  of  federal  agencies^  Congress^  the  research  and 
R/D£tl  corrraunities  and  their  organised  Interest  groups, 
professional  educators  and  their  organised  interest 
groups  J  the  public  and  their  organized  interest  groups? 

What  is  the  proper  ^relationship  between  the  R/D£tlf  system 
and  the  operating  syscen?    HOv^^  U  i:nproVc"L^;:it  of  edaca- 
ticnal  practice  most  effectively  brought  about?    What  is 
the  proper  balance  betceen  external  and  internal  change 
strategies?  ^ 

What  is  the  proper  balance  in  allocation  of  resources  to: 

a)      fundamental  research 
t>)      applied  research, 

c)  ■     R6D/deve  lopfTient 

d)  dissenination^  implesnentation/utilization  support 
and  other  linkage  strategies 

e)  developing  internal  operatirvg  system, capacity 
for  inprovement  of  educational  practice 

£)      irnniediate  problem  solution,  in  the  "field  service'^ 
tradition? 

What  IS  the  proper  balance  in  allocation  of  resources  to 
support  of  r/D6(I  activities  oriented  toward: 


a)  producing  outputs  for  the  operating  system 

b)  building  capacities  to  increase  the  effectiveness 
of  the  R/D6I  system  (i.e.,  "syston-bu i Iding 
"resource -bu lid  1 ng /'  "capac it y^bui Iding") ? 
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Are  there  ways  in  which  both  systen-building  and  output 
objectives  can  be  met  ai;  the'sar.e  time  in  Che  sar^e  pro* 
grams  or  activities? 

We  shall  consider  each  of  these  issues  in  turn. 


I.     Cari  Systematic  Incuiry  Increase  Our  Understanding  oi  Educatior^^ 
Can  Systematic  Research  y  R6D  Lead  to  Improvement  of  Educational 
Practice?         .  \* 


There  are  act:ua\ly  three  i^irerrel a  ted-^  issues  here       whether  suppor^: 

for  systematic  reseajcch  is  likely  to  lead  to  the  accuniulatioa  of  a 

useful  knowledge  base;  whether  support,  for  research  or  R&D  is  likely 

to  Improve  pract ice ;  and   ;vhat  relative  emphases  should  be  given  to 

pursuit  of  knowledge  as  an  end  in  itself  vs.  pursuit  of  knowledge  as  a 

32 

means  to'^rd  the  end  of  improving  education. 

A.      Pursuit  of  Knowledge  as  a  Goal:     (fan  Research  Increase 
'  Our  Understanding;? 

In  favor  of  support  for  research  on  (or  relevant  to)  education, 
one  might  argue  that:     (a)  a  sound  scientific  basis  for  under- 
standing such  vital  aspects  of  modern  L^e  as  learning  and 
schooling  should  be  considered  a  desirable  goal  in  and  of  itself; 

(b)  despite  the  accumulation  of  a  significant  amount  of  knowledge 

about  learning,  we  still  have  relatively  little  understanding 

33 

of  the  process  and  the  critical  factors  that  affect  it;  and 

(c)  significant  bodies  of  research  relevant  to  education  have 

succeeded  in  increasing  our  understanding,  fundamentally 

altering  our  conceptions  of  the  learning  process  and  the  factors 
34 

that  affect  it. 

However,  o^the  oth^r  side  of  that  debate  is  the  viewpoint  ofcen 
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voiced  by  practicioners  (e.g* ,  in  surveys  of  practition- 
ers) and  by  Coiigress  ional  critics  skeptical  of  the  value 
of  much  research  supported  v;ith  federal  funds.    The  key  point 
made  here  is  that  much  (perhaps  most)  educational  research 
(or  fundamental  research  that  is  supported  for  its  potential 
significance  for  education)  is  seen  as  irrelevant  to  problems 
of  significance  in  need  of  understandingfJ^the  topics  aro  often 
trivial  or  so  abstruse  in  nature  tRat  they  could  not  be  of 

wide-jifiteres t  or  likely  to  increase  the  understanding  of  more 

-J-  ' 

than  a  handful  of  specialists*     Given  The  limited  availability 
of  funds  and  The  crying  r.eed  for  immediately  needed  services 
and  for  solutions  to  operating  systera  problems  (that'  could 
perhaps  best  be  solved  by  practitioners  if  only  they  could  ,  ; 
receive  adequate  supplies  of  funds) ,  support  for  the  research 
enterprise  is  seen  as  of  benefit  only  to  researchers  and  their 
institutions,  and,  from  the  viewpoint  of  ''national  needs''  or 
"operating  system  needs"  (defined  by  some  as  one  and  the  same 
thing),  a  waste  of  money  and  (even  worse)  a  drain  on  badly 
needed  resources  that  are  in  short  supply* 

The  rejoinder  from  researchers  is  that  fu/f^amental  research  is 
driven  by  questions  d|rived  from  the  intellectual  pr'trblems  that 
define  a  ^field  of  inquiry  at  a  particular*  stage  of  its  develop- 
ment; that  outside  of  the  logical  structure  of  an  inquiry  field 
a  research  question  might  appear  to  be  trivial  that  in  fact  is 
central  to  the.  paradigms  being  explored  at  that  time,  having 
irnplications  of  potentially  vast  significance;  that  the  un- 
certain nature  of  the  research  (particularly  basic  rese^irch) 
enterprise  naktiS  unclear  'v-'here  the  next  breakthroughs  of  major 
importance  are  likely  to  be  and  that  seerningly  trivial  questions 
nay  in  fact  be  of  enormous  significance  under  certain  conditions; 
and  so  on.    Another  tack  in  the  researchers*  rejoinder  might  be 
to  acknowledge  that,  yes,  indeed  some  poor  quality  and  trivial 
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research  has  been  supporced        trivial  from  the  viewpoint  of 
:he  ince I lecLual  paradigm  of  the  disciplines  as  well  as  from 
the  social  definition  of  needs        but  that  such  funded  research 
simply  reflected  poor  decision  oaking  by  federal  agencies  and 
other  research  sponsors,  perhaps  lack  of  proper  guidance  from 
the  field  (or  the  ''right  people'*  in  the  field) ,  etc, 

B>      Improven^ent  of  Educational  Practice  as  ^  Goal:     Can  Research 
or  RctD  Lead  to  Inprovecent  of  Practice? 

This  is  a  cor.slderably  nore  coniplex  kind  of  is^ue.     Even  if  one 
is  willing  to  answer  the  previous  question  in  the  affirmative 
and  assume  that  systematic  research  can  increase  our  understanding 
of  education,  assuntptions  about  Che  extent  to  which  research  or 
R^D  can  lead  to  inprovement  of  educational  practice  involve  ^ 
judgments  on  several  different  points.     Involved  here  are  judg- 
ments on  not  only  the  quality  and> potential  relevance  or  utility 
of  research  or  R^D  outputs  but  also  ho-^  educational  improvemertt 
co-ues  aiiout       i.e.,  what  is  and  is  not  likely  to  affect  what 

practitioners  do  and  how  they  do  ic,  ' 

s 

I 

In  favor  of  support  for  research  and  R&D,  one  might  make  the 
following  argazients; 

1 

(a)  The  more  knowledgeable  practitioners  are  about  their 

students,  the  learning  process,  the  impact  of  various 

forces  on  learning,  etc.,  the  more  effective  they 
35 

are  likely  to  be,  ^  .  ' 

(b)  Several  significant  bodies  of  fundamental  research 
have  led  to  substantial  improvements  in  major  areas 
of  educational  practice        both  in  the  practitioners' 
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concep  tLions\(e  ,g, •  of  the  learner,  the  learning'  . 
process,  and  therefore  the  kinds  of  Instructional 
strategics  likely  to  be  effective)  and  in  the 
procedures  and  strategies  he  uses  (e.g.,  I*Q, 
testing,  use  of  standardized  achievement  testSj 
etc. ) ' 

(c)  Ineffective  teaching  has  been  traceable  in  part  to 

I    the  poo^^uality  of  many  of  the  materials  ^  Instruc- 
tional strategies  J  etc  /    used.    Therefore  ^  one 
clear  roufe  to  educational  irr-provement  would  seem 
to  be  use  of  systeriatically  developed  materials, 
ba^ed  on  sound  research^  pacl:aged  in  the  ^ost  jjseful 
forms  and  adequately  evaluated  and  refined  to  insure 
their  effectiveness 

(d)  There  are  a*number  of  R£tD  products  that  ^have  been 
widely  adopted  and  use<3  and  are  viewed  as  substantial 
improvements  over  the  materials ^  approaches,  etc. 
they  replaced.  ^ 

Kowever^  there  are  at  least  three  arguments  that  might  be  made 
agaiast  these  contentions: 


(a)  There  may  be  some  research  or  R£iD  that  have  Improved 

practice.     However^  there  are  se^/eral  bodies  ok  data 

whic  n  suggest  that  in  genera^^duca tional  practice 

has  been  little  affected  b>  the  outputs  of  _either 
39  %         ^  ' 

rec^^ircn  or  Rc^D. 

(b)  Most  of  what  \-ff$  know  about  schools  as  organizations 

AO ' 

and  teaching  as  a  profession  (or  semi-profession) 
suggests  that  the  outputs  of  exiernal  RM)  are  not  likely 


to  be  adopted  arid  used  by  teachers^  exteraaUy 
psck35^:id*     If  e:^tsrri3lly  developed  materials  and 
gppfroaches  are  used  ac  all  they  are  goiag  co  be 
substacitLially  adapted  and  modified  byjjie  user, 
*  undercuttirig  the  gains' one  might  expect  from 
heavy  investmerit  ir>  design  and  testing  of 
''teacher-proof"  materials. 

(c)    Educational  practice  is  a  craft-like  field,  dependent 
for  ics  inprovement  pr imari ly  on  the  development  of 
exper-lantial  >.nowledge,  trained  judgment^  and  skill 
of  praccicioners  within  school  settings*  Research 
findings  or  R^D  outputs  developed  external  co  the 
work  setting  are  ^ot  likely  to  affect  practice  in 
significant  ways,  or  at  least  are  not  likely  to  do 
so  until  the  capabilities  of  personnel  in  the  work 
setting  are  developed  to  the  point  where  they  can 
efficiently' or  effectively  absorb  these  and  make 
them  a  part  of  their  primarily  experiential  knowledge 
base  and  repertoire  of  skills* 

r 

C:      Relative  Emphases  i     Pursuit  of  Knowledge  vs*  Improvement 
of  Practice 


There  are  signif icant^ly  different  implications  in  support  of 

research  that  is  premised  on  the  assumption  that  research  mi^ht 

improve  education  and  support  premised  on  the  assumption  that 

ic  will  bring  abflout  such  improvement.     In  one  instance,  pursuit 

of  kno^^ledge  Is  an  end  In  itself;  In  the  other  Instance^  it  is 

A3 

only  a  means  toward  the  end  of  improving  education,        In  one 
case,  you  might  simply  ask  that  research  t^ll  you  something 
new  that  is  interesting  and  hopefully  not  trivial*     In  the 
othec  case,  however,  it  becomes  reasonable  to  demand  relevance, 
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V 

app  Licati ons  J  evidence  o£  \;ays  in  which  a  contribuCion  is  made 

to  educational  practice,  etc.    The  distinction  is  likely  to 

affect:     funding  choices  about  research  copies  to  be  investigated;' 

criteria  used  in  judging  the  significance  of  completed  research; 

decisions  about  what  liapp^ans  to  research  findings  once  chey  are 

arrived  at        the  forms  in  which  findirfgs  are  presented,  the 

target  audiences  to  whom  they  are  disseminated,  and  perhaos  most 

itp.porcant,  the  next  round  of  funding  choices  about  which  research 

t 

areas  are  to  be  pursued. 

D.      Relationship  to  Other  Issues 


One's  position  on  this  first  set  of  issues  is  likely  to  affect 
one's  posltionion  all  of  the  other  key  issues  we  consider  here. 
Skepticism  about  the  extent  to  which  anything  of  value  is  to  be 
learned  frOTi  supporting  research  essentially  ends  the  debate  on 
us^  of  resources  to  support  research  or  R^D  activity  and  makes 
it  unr,ecessary  to  consider  these  other  issues.     Positive  assess- 
ments of  the  extent  to  which  we  can  gain  understanding  from 
research  but  less  encouraging  views  of  the  lifcely  ef^fect  on 
practice'  suggest  support  inclined  primarily  toward  fundamental 
research  rather  than  the  more  applied  functions.    An  inclination 
toward  improvement  of  practice  as  the  key  criterion  against 
which  all  choices  are  to  be  judged  suggests  still  other  patterns 
of  chorees  and  has  other  implications  too,  e.g.,     for  who  should 
def Lr^^/priorities.    And  assun^ptions  about  liow  practice  is  iikely 
to  be  improved  shape  one's  orientations  toward  R/Ditl  policies 
and  strategies  most  likely  to  be  effective.    These  complex  inter- 
re l.a t ionshi.p3  should  beco-ne  clearer  as  we  explore  each  of  these 
other  issues  in  n^ore  detail-  ^ 

The  Proper  Role  of  the  Federal  GovernTient  * 


It  It  IS  agreed  that  research  and/ or  Ri^D  can  potentially  increase  ouwf 
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uaderstaadi ng  of  educatioa  aad  perhaps  lead  to  the  improvemeat  of 
educatJ^al  practice  as  well,  aad  if  it  is  also^  accepted  that  public 
fuads  should  therefor^  be  u^'sed  to  support  research  or 'R£tD, /thea  a 
aumber  of  other  issues^aeed  to, be  raise.d  about  the  proi>er  staace  of  ' 
the  goveramei^p  in  rela:ioa  to  the^  rSBtearch  aad  R£tD  comnuaities, 
pra^itioae^rs  J  aad- other  iatei^ost^^ff^^^^^^-' 

A,  Thg  Laissez-Faire  Mode  ^  .  ^^P^ 

,  Should  federal  agencies  furuztiofi  ^nply  -as  fundiag  chaaaels,  with 
initiative  and  ^^oatrol  over  what  gets  fandtid  and. how  ic  Is  carried 
out  largely  ia  the  haads  of -those  conducting  the<* research,  R5cD, 
de[ftoaacration  or  other  programs In  this  kind  of  L^isse?-f aire 
mode  of  tnanageaient,      field-initiated  proposals  would  likely  be 
the  maitf^souTce  of  ideas  for  projects  to  be  funded;  decisions 
among  proposals  r^lght^also  be  made  on  the  advice  of  ithe  field, 
as  represented  on  advisory  panels;  research  designs  and  procedures^ 
would  be  largely  under  the  control  of  those  in  the  field  carrying 

't)ut  the  work;  and 'the  main  audience  for  the  work  and  the  most 
significant  sources  of  review,  evaluation,  and  critique  for 
sponsored  work  would  also^ be  rhe  field,  *  r 

B,  The  Bur^eaucratic  Mode      .  „  . 

s 

Or,  should  federal  aget\pies  take  a  more  a^^tive  rol^in  defining 
the  areas  in  which  work  rs  to  be  supported-  an*,the  types  of 
studies  a;?d  projects  to  be  carried  out?    This  bureaucratic  mode 
'Of  managen^ent,      characterized  Sy  the  u$e  of  RFPs  (requests,  for^ 
'^lliXAposals)  prepared  by  agency  staff  member*,  has  become  the  ^ 
4*ininant  approach  to  educational  Rt^D&I  funding, and  is  the 
focus  of  considerable  debate"  it^  educational  research  and^  R5cD 
circle,^^  '         ^  **  li  ^ 
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Although  thei'e  are  many  variants,  the  caricature  this  approach 
in  izs  niost  extreme  form  can  be  summarized  as  follows: 

t 

^  (q)  .  Agency  decis'ions '  about  "priority  areas"  reflect  the 
thinking  of  agency  staff  (whose  judgments  may  or  may 
not  be  informed  by  the  thinking  of  the  research  or 
R5(D  or  practitioner  communities  on  such  matters). 
Generally,  ^uch  choices  are  oriented  primarily  toward 
agency  iaterpreta^ions  of  social  needs  (i,e,,  educa- 
tional problems)  rather  than  state-of-the-art  considera 
tions, 

(b)    RfPs  are  often  highly  specific  about  the  work  to  be 
carried  out,  p§j"haps  even  the  questions  to  be 
^  explored  and  the  designs  and  procedures  to  be  used. 

Such  RFPs  are  often  prepared  by  agency  staff,  with 
or  often  without  the  a^gLstance  of  consultants  from 
the  field .  *  * 


(c)  Decisions  among  proposals  are  made  by  the  agency, 
with  or  often  without  the  involvement  of  ccttsultancs 
from  the  field  functioning  as  field  readers'or  as 
members-  of  advisory  panels, 

(d)  Although  the  field  may  be  an  important  par.t  of  the 

audience  tor  some  presentations*of  findings^  etc.; 

and  be . significant ly  involved  in  the  ultimate 

^  assessment  of  the  value  of  the  work  produced^  the 

( 

primary  (and  often  the  only)  audience  ^ind  locus 

of  review,  evaluation,  ancf  critique  £qr  much  of  this 

federally  funded  work  is  the  sponsoring  agency. 


V 
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C,      Open  Conpetitlor^  vs,  Solic-ited  Work 

Should  federal  agencies  identify  the  work  to  be  funded  and  ^heg 

use  cotnpetit>i ve  mechanisms  to  determine  who  vlLl  be  awarded  the 

graat  or  contract  to  carry  ouc  a  specific  piece  of  vork?  Or 

should  federal  agencies  solic i t  vork  of  particular  types  from 

specific  individuals  or  Institutions  known  to  the  agency  an^ 

judged  to  be  most  capable  of  producing  the^  best  quality  work' 
47 

of  that  type? 


SvsterT^-BuLldln'^ 


S 

Should  ag^cy  procurement  decisions  be  based  only  on  project- 
by-projec4  considerations  (e.g.,    who  can  best  carry  out  this 
project  given  available  resources)  6r  also  on  system-building 
\  5?t^5i<^^^3tions  (e^g,,    how  is  awarding  this  extract  to  this 

or  that  institution  likely  to  affect  future  R/D&I  capacity,  ^ 

*  48 
its  quantity,  quality,  aad  distribution)? 


Educational  Improvement  Strategies 


Should  federal  funding  decisions  reflect  a,  choice  among  alternative 
educational  improvement  strategies,  con^^nt\«ting  resources  on  what 
is  judged  to  be  the  "one  best"  approach  (e.g.",    R&D)?    Or  should 
federal  decision  makers  suspend, judgment  on  the  "one  best" 
alternative  and  take  a  more  mixed  approach,  disbursing  funds 
somewhat  aci^ss 'approaches  and  permitting  future  decisions  among 
alternatives  to*be  made  (i^  made 'at  all)  on  the  basis  of  accumu- 
la  ted  experieace  and^  d/ta  on  -ef  fee  tiveness  and^  impact? 

F.     .Choices  Amon^  Options  and  RolatioOship  to  Other  Issues 

'    * '      f  ■ ,  -     ■      *  * 

How  active  a  stancf  should  the  federal  tgovernment  take  iJ^  sfjaping 


... 
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educational  R/D^I?    The  various  options  ue  have  suggested  involve 
irtcressingly  activ^^oscures        £rom  th^  Laissez-faire  mode  in 
which  initiative  and  control  are  largely  in  the  hands  of  the 
fi^ld;  CO  Che  bureaucratic  mode,  where  the  Locus  o£  Initiative 
and  control  shifts  to  federal  agencies;   to  solicited  contracts 
and  grants  (removing  the  broad  field  from  open  competition  ^or 
particular  pieces  of  work);  to  system-building,  introducing 
additional  considerations  such  as  agency    (or  perhaps  "agency/ 
field'')      visions  for  the  systemic  future  from  an  overall  macro 
level  perspective,     (If  R^D  is  selected  as  the  ''one  best*'  route 
to  oducational,  improvenent,  this  too  must  be  viewed  as  a  highly 
active  posture.)    The  arguments  that  might  be  made  for  or  against 
each  option  are  closely  intertwined  with  one's  perspective  on 
eac^  of  the  remaining  issues  to  be  considered.    We  therefore 
turn  to  these  other  issues. 

J 

Who  ShairOefine  Goals,  Priorities,  etc.?  7 


Who  shoulji  have  preponderant^nf luence  in  determining  goals,  priorities 
policies  and  strategies  for  edacatibnal  R/D^I?    Should  initiative  and 
control  rest  with  researchers  and  R^D  personnel  \iho  are  most  attuned 
to  the  state  of  the  knowledge  and  technology  base  of  the^fleld  and 
therefore  presumably  what  the  system  ts  most  capable  of  achieving  and 
^   what  pQfi^icies  are  most  Zlkely  to  bear  fruit?    Or,  should  ^^r^onderaut 
Influence  be  in  theTiands  of  federal  O'fficial^  and  staff  whosejudg^ 
ments  are  most  likely  to  be  sensitive:  to  national  concet^  q^id  priori- 
ties abou^pressin^  problems  in  need  of  solution?   *(And  within  the  ^ 
federal  government,  who  should  define  chose  concerns  and  pfriorities  ^- 
Con^r-j^s ,  the  '^lute  tigu^e ,  federal  ^;;encii2S? )    Or  should^he  iocu5 
of  inLtiati\^  and  control  be  shifted  to  professional  <^ic^itor^yho' 
are  ii>ely  to  be  m6st  familiar  with  these  "problccis  and /the  kinds  of 
R/D^;t  sol  ucions  most  likely  to  ^f^e  implemented  and  used,  and  whose 
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commitment  to  institutionaLlzing  particular  solutions  will  detemine 
,  the  e£fecclv^p:'S3S  and  ir^pact  of  the  whole  R/D6I  enteyfprise?  Should 
some  effort  be  nade  co  balance  "social  denands'*^  (as  defined  by  ^ 
federal  govern:neat  units  or       practitioners)  against  r/D^I  corrL'r.unity/ 
system  requirements,  and  if  so,  how?    Uliac  mechanisms  are  likely  to 
be  most  effective  in  permitting  bargaining  and  development  of  consensus 
or)  questions  of  goals  and  priorities?    For  whom  do  organized  interest 
groups  Speak?    And  what  (if  anything)  can  be  doae  to  protect  t^e  inte- 
rests of  chs  unorganized       s.g.,     the  public,  researchers  or  R/Dcd" 
persona<;l  not  ^^ive  in  professional  associationSj  etc.? 

There  has  beea  relatively  Uttie  discussion  in  the  literature  about 
consensus-generating  nechanisms,^^  and  even  less  attention  to 
mechanisms  for  determining  the  iaterests  of  the  unorganised  as  they 
perceive  ^nd  define  these  interests, There  has  beea  considerably 
more  atteati^n  to  differeat  modes  Qf  goal-setting  and  program  develop- 
mentj  aad  the  most  fundamental  of  choices  seem  .to  be  amorp  four  alter- 
aative  modes  as  depicted  below.    They  differ  along  -two  dimeasions: 
(a)  whether  the  key  rnschaaisms  that  determiae  goals,  priibrities, 
etc.     are  central ized  or  decentralized;  aad  (b)  whether  the  main 
actors    in  g9al-setting,  etc.     are  from  within  the  research-R/D6l 
comrnuQlty  or  external  tq  it. 

GOAL-SETTI^^c  .^echa:;isms 


Ceatrilized 

Decentral ized 

Exteraal  to 

A 

D 

Research'R/D6cI 
Cujrununity 

^jreaucra  t  Ic^  Mode 

Market-Oriented  Mode 

C 

Within  Resear?:h- 
R/pSl  CorrjT^unity 

— ■?  ' 

National  Scieace 
Policy  Mode 

 ^  

Field-Initiated/ 
L^issez-Faire  Mode 

2S9 


We  digress  briefly  Co  describe  chese  fojur  nodes  before"  returning  to 
the  issufe  of  .cjic^siag  one  of  th^;se  uiodes  or  divising  some  new  nix 
of  elemeVits  th^s^c  flight  provide  s'oine  new  alCernative(ij)  , 


^The  Bureaucratic  Mode 

We  noted  earlier  the  main  elements  in  che  bureaucratic  mode  of 
macro  level  R/DSsI  management.    What  is  important  to  underscore 
here  is  that  the  main  coricern  in  decision  making  about  the  kinds 
of  R/D5(I  activities  to  be  supported  is  national-level  problem 
areas  a$  they  are  de  fined  by  federal  of  f icia  Is  ( i  ,  e ,  ,  agency 
bureaucrats,  taking  che  lead  from,  andVor  on  occasion  taking  the 
initiative  to  influence   Congressional  and  Adcninistration  influ- 
entials)*    In  this  mode,  the  bulk  of  R/D61X  funding  is  generally 
targetted  at  'major  problem  areas  identified  and  defined  by  these 
federal  officials  who  (in-  the  fi^ld  of  education)  are  generally 
identified  as  external  ta  the  research-R/DStl  community.  In 
several  other  fields,  there  is  considerably  iiJore  overlap  between 
the  relevant  ^research  cOMunitie^  and  key  funding  agencies,  e*g,, 
^IH,  with  leaders  of  the  rield  orten  taking  key  agency  positions 
for  several  years  and  s  considerable  flow  of  talent  moving  back 
and  forth  between  agency  and  fieldi.    However^  this  pattern 
appears  to  be  relatively  rare  in  eliucation. 

Where  che  bureaucratic  mode  pre vax  Is  >  che  research -R/D6I  community 
exercises  liccle  if  any  influence  as  a  comunicy.  Individual 
^     re«;earchers  or  RifD  specialises  or  practitioners  may  exert  some 
influence'as  advisers  to  funding  agencies";  however,  even-here, 
chose      le;. L yto  serve-tas  advisers  tend  to  be  identif  led/and 
^         chosen  by  agenc^  personnel,  often  without  the  involvement  of 
the  research-R/Dcfl  co-nmunity- 

To  the  extent  chat  cons  ide rat  ions  c<^re source -development  or 
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syscera-building  encer  into  decision  making  at  ill  in  this  bureau- 
cratic  :zode ,  the  focjs  tends  to  be  on  nat iona L  Resources  rather 
than  geogra::>hic  dispersion  of  resources  across  regions  or 
localit  les  X 

The  National  Science  Policy  Mode  ^ 

Were  this  approach  ever  to  become  operative  in  educacionj  ofie 
might  envision  some  centralized  body  which  represented  (or  was 
directly  influenced  by*)  the  leadership*  ot  the  re search-R/D5tI 
community  d^terr.imag  the  directions  of  federal  funding  for 
educational  R/DocI,    While  this  group  might  no^necessarily  be 
insens it iv^cJ  to  or  uninterested  in  the  kinds  of  national  problems 
given  so  jnuch  attention  in  the  bureaucratic  mode,  decision  niakir.g 
in  the  science  pcrticy  mode  would  tend  to  ^  more  oriented  tow^d 
s ta te-<afethe -art  concerns        furthering  the  development  of  the 
f ie Id  * s/knowledge/technology  base^;  focusing  on  the  research 
questions  at  the  frontiers  of  the  most  active  research  areas; 
choo/ing  among  alternatives  in  terrr^  of  where  research  talent 
exists^  what  kinds  of  research  tajent,  methocjologies  >  and  other 
macro  level  capacities  need  to  be  developed,  where  fruitful 
findings  are  accumulating^  etc*    Excellence  would  cLearly  be  a 
central  criterion,  and  therefore  system  bu i Idin^^oncerns  would 
orient  them  toward  developing  the  highest:  quality  nationa  1 
resources  rather  than  geographic  dispersion  of  resources  across 
regions  or  localities.    Unlike  the  bureaucratic  mode ^  however, 
systern-building/resoorce-developing  concerns  would  5iore  likely 
be  central  to  decision  making  in  this  mode  dominated  by  the  leader 
ship  of  the  re^earch-R/D£iI  cornmunicy^ 

Federal  agency  ^offic ials  might  function  m  a  nuiabej:  of  w<ivs  in 
such  a  systen.    They  might  serve  largely  as  passive  conduits  ' 
for  funds  tb  the  activities  ^elected  la,rgely  by  the  leadership 
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of  the  researGh-R/0^lI  community.     Or,  they  Qight  operate  more 
actively,  either  interaccing  with  (aegotiacing,  bargairting, 
influencing  and  being  influenced  by)  the  research  elii^e  and/or 
being  part  of  that  research  elite  antJ  therefore  accorded  legitimacy 
for  defining  directions  and  atte[?,pting  tp  develop  consensus  in 
support  of  these  field-shaping  agency  decisions,  or  NSF 

might  be  models  of  how  federal  agencies  mi^ht  function  in  this 
node , 

As  to  who  might  be  defined  as  the  research-R/Do(I  coamunity 

leadership  in  che  educetion  sec^ior^  the  kViJ^  is  the  o^ly  single 

body  currently  in  existence  which  might  assume  such  3  role. 

However,  we  have  seen  only  occasional  evidence  of  forceful  AERA 

leadership  in  this  direction. There  are  other  hypothetical 

possibilities        for  instance,  Corwin^s  corlceptioa  of  aetworks 

54 

of  CO Uabor^tivje  '^research  comunitie^. Clearly,  though,  the 
educational  research-R/D6l  community  is  too  immature  and  dls- 
organrised  at  this  point  for  this  approach  to  seem  like  a  realistic 
near-term  possibility. 

C.      The  Field-Initiated/Laissez-Faire  Mode 

Although  the  bureaucratic  and  national  science  policy  modes  differ 
in  who  defines  goals,  priorities,  etc.        (vh^iher  the  locus  of 
initiative  and  control  is  to  be  found  in  federal  agencies  or  the 
research*R/DaI  corrrnunity),  they  are  similar  in  that  in  either  case 
this  initiative  and  control  are  centralized.    In  both  cases,  some 
central  national-level -group(s)  have  a  virtual  monopoly  on  defi- 
nition  of  goals,  priorities,  etc.^  made  fro."  their  pers,pective 
of  what  is  needed       either  co  solve  pressing  ruational  problems 
blocking  further  social  progress  or  key  intellectual  problems 
to  be  solved  to  push  further  the  frontiers  of  knowledge  and 
technology*     in  this  respect,  bgth  the  bureaucratic  and  national^ 
scienCQ.  policy  modes  differ  frOQ  the  f  le  Id-ini  t  iated  and  market* 
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orienced  :n:>des.    In  boch  of  the  lacCer  approa:;hab,  che  locus  of 
laiclzcl.ve 'and  concrol  is  highly  decenCral  ized ,  dispersed  geo- 
graphically across  che  country^  permitting  more  pluralistic 
definition  o£  goals,  priorities^  strategies,  etc,,  and  a  con- 
siderably larger  number  of  participants  in  the  process. 

In  the  field-initiated  or  laisses-faire  node ,  initiative  is  y 
largely  in  the  hands  of  the  members  'of  che  research-R/D£jI 
conniunicy.     Fie  Id- initiated  proposals  are  actively  encouraged 
and  presumably  supported  on  a  level  sufficient  to  stimulate  the 
continued  flo'.;  of  proposals-     Federal  agencies  act  as  rt^latively 
passive  cortduics  of  funds  to  che  field,  naking  funding  choices 
fro:n  ainong  che  proposals  submLCted,  generally  ciaking  us^i  of 
hand-picked  advisers  iron  the  field.    Funding  is  generally  done 
on  a  project-by-projecc  basis  wich  lictle  if  any  consi'deratLon 
to  system-building  issues.    Relevance  to  social  problems  may" 
enter  decision  making,  but  even  more  certain  to  be  given  weight 
are  scandatds  of  judgment  internal  to  functioning  of  the  field  -- 
methodological  ri^or,  contribution  to  the  field's  Rno'^ledge  base, 
etc . 

D.      Harket'Oriented  Mode 

In  this  mode,  too>  initiative  is  likely  to  be  dispersed^eograph- 
icaLly  across  che  country.    Hofwever ,  here  the  key  actors  defining 
goals,  priorities,  ecc-    are  not  members  of  the  resear ch-R/D&I- 
corrniunity  but  raCher  education  professionals  --  i*e,,  the 
practitioners  whp  st»ff  the  operating  system.    This  mode  differs 
fr:^n  all  others  in  the  key  role  of  practitioners  and  their  con- 
cerns, largely  absent  from  the  science  policy  and  field-initiated 
modes,  and  present  in  the  bureaucratic  mode  only  as  perceived 

rif  perceived  atr^U)  by  the  bureaucrats  (or^pec  ia  lis  t  "techno- 

5  3  J  ' 
crats"      who  staff  federal  agencies. 
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As  noted  earlier,  in  the  niarkec-orienced  model  described  by 
Gidcoasofj      Lrtc  rocai  concerns  in  aecislon  mailing  are  operating 
system  needs  as  4efincid  by  practitioners       what  practitioners 
define  as  needed,  what  chey  identify  as  desired^  and  what  they 
are  wilXi^^g  to  adopt,  install,  and  use.     In  this  TOde>  attention 
\s  shifted  froa  the  national  level  to  the  local  level  i^e,^ 
to  S£As,  LEASj  individual  schools^  and  individual  practitioners. 
Locally  def ined 'needs  are  the  focus  of  selection  decisions  about 
R/Di(I  activities  to  be  funded.    System-building  consifderations 
sre  of  interest  and  are  defined  here  as  developrnent  of  local 
c-p^tcities  for  problert  sol  zing.    ExceUence  as  this  pight  be 
defined  in  the  national  science  policy  mode  is  not  considered 
as  icr,portant  as  dispersing  r/Dc*!  resources  so  they  are  to  be 
found  in  all  localitie's^  available  to  all  operating  system  sit^s 
to  solve  perceived  problezis  as  they  arise'.     If  conceived  in' 
R/DcsI  terms  >  though>  the  ziarket-oriented  mode  should  not  be 
confused  with  the  old  field  service  tradition  in  which  prac t it ioner- 
-^iefined  probleris  were  net  on  an  individual  basis  by  researchers 
and  others  in  the  field  who  provided  services  to  schools  without 
concern  for  capac  ity-bu  ilding  ^  generalizability  of  solut  ions  > 
diffusion  to  other  sites>  and  other  hallciarks  of  the  R/D£tl  or 
renewal  approaches 

Choices  A::^ong_  Options  ^  New  Alternatives,  and  Relaiionshi:> 
to  Other^  Issues 

These  four  modes  as  described  here  are  gross  siraplificatioas  of 
patterns  as  they  have  existed  or  might  exist*  Empirical  reality, 
is  not  likely  to  be  so  neatly  patterned.  Practitioner  concerns 
may  not  have  been  so  totally  absent  from  field- init iated  or 
even  the  science  policy  modes  as  suggested  here.  And  certainly 
many  of  those  agency  officials  who  carried  out  the  bureaucratic 
mode         have  been  oxcellfent  spokesmen  for  practitioner  concerns. 
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and/or  for  re^earch-R/D<£(I  comniurtity  concerns  as  w^ll.  Thert; 
are  nunT^rojs  instances  of  overlap  between  the  bureaucratic  and 
science  policy  cnodes.    And  there  have  been  several  points  in 
time  in  which  there  have  been  substantial  amounts  of  both 
tatgetced  (b-jrea^cratic  cnode)  and  field-initiated  funding  even' 
within  the  same^^agency .    However>  we  do  find  the'typology  use- 
ful for  chmki^ng  ^bout  differences  among  approaches  aa&^^lons 
that  are  available.  \^ 

Arguments  ;nade  in  favor  of  the  more  centralized  approaches  revolve 
arovrid  iinlced  rea^ources  and  the  ways  in  which  available  resources 
have  been  5:  it  tered  away  on  non-cumulative  >  non-directed>  field" 
initiated  (mode  C)  or  practitioner-dominated  (mode  D)  funding 
patterns  in  the  past.     In  favor  of  the  bureaucratic  mode>  a  case 
could  be  made  that;     (a)  the  research-R/D£(I  cocsnunity  is  not 
otherwise  likely  to  organize  activity  around  national  social 
prloritieSj  that  the  very  nature  of  knowledge  producing  fields' 
suggests  different  priorities  and  patterns;  (b)  in  the  case  of 
education,  the  lack  of  strong  leadership  within  the  research- 
R/D6i^  community  might  suggest  even  more  of  a  need  for  the  bureau^ 
cratic  node;  and  ,(c)  the  bureaucratic  mode  might  be  Che  best 
option  for  balancing  social  needs  (as  defined  by  national  priori- 
ties and  pract itioner^  concerns)  with         requirements  (state-of- 
Che-art  and  systecn-^building  concerns  as  defined  by  researchers 
,and  R6J)  personnel).  "  | 

On  the  other  side  of  the  debate>  though>  the  bureaucratic  approach 
can  be  criticized  on  several  grounds: 

(a;    -K^eral  bureaucrats  have  at  times  operated  from  the 
I  perspective  of  their  own  normative  conceptions  of 

how  things  should  be  rather  than  fi^Dtn  ^  soimd  footing 
in  empirical  reality.    Consequently,  they  hav€^eJ.ther 
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bainnced  such  diverse  interests  as  the;  practitioner 
*     vs.  researcher  vijewpoints^  nar  ncted  as  accurate 

s^^kes:r*en  of  either  the  practitioner  or  the^researcher 
perspective,  alienating  aLl  key  parties  in  the  process. 

(b)    The  bureaucratic  mode  has  not  been  properly  informed 
by  state  of  the  art  consideirations  or  an  adequate 
understanding  of  the  kn<>wledge  base  developments  j 
personnel  and  institutional  capacities  and  other 
prerequisites  essential  to  carry  out  the  desired 
work  co:T\petently.     (When  turned  around,  this  becomes 
the  crux  of  the  argument  for  the  science  policy  mode.) 


(c)    Age?.cy  bureaucrats  have  been  naive  about  the  nature 
of  the  operati/ig  system- and  the  ease  with  which  it 
could  be  changed,  especially  by  external  strategies. 
^  In  general  they  have  acted  in  a  vacuum  of  ignorance 
about  practitioners '  needs,  desires,  constraints, 
etc.     Crnen  turned  around,  this  becomes  an  important 
part  of  the  argumenf  for  the  market-oriented  mode.) 


Indirectly/ we  have  already  considered  the  case  for  and  against 
the  science  policy  mode.    Yes,  decisions  are  more  likely  to 
reflect  what  the  system  is  and  is  not  capable  of  achieving  given 
the  state  of  s^'/ailable  knowledge,  system  capacities^  etc.  And> 
yes,  needed  systen-'building  is, more  likely  to  be  given  the 
attention  it  warrants.    However^*  on  the  other  side  of  the  coin: 


4 


(^i)  The  jd.ic:^ional  research-R/D6(T^  corrmunity  is  irnnature 
and  relatively  tinorgenized,  fragmented  by  the  multi- 
diSv iplinarity  of  its  knowledge  and  technology  base 

^        and  i\irt''>er  hampered  by  differences  betwee^a 

mer.:      .-:nd  applied  researchers,  researchers  frc 
th'^  iiiv^pjines  and  educational  researchers. 
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researchers  and  developers,  etc.    There  is  therefore 
little  reason  to  believe  that  the  research-R/D^ScI 

4  * 

community  could  carry  out  its  role  in  a  science  ^  , 
policy  mode* 

(b)    Relatively  few,  high  quality  cumulative  knowledge 

bases  have  been  developed  by  the  field  of  education, 
leaving  open  to  question  the  existence  of  an  adequate 
supply  of  the  available  know-how  to  use  R/D^ScI  ^unds-to 
inaxitnum  efficiency  if  the  science  policy  mode  did 
preva JL  L  * 

,  {<a)    Educational  research  has  sho;/n  itself  to  be  relatively 
insensitive  to  practitioner  concerns  over  the  years^ 
suggesting  that  the  chances  of  ever  bringing  abqyt  edu- 
cational improvement  through  the  science  mode  in^  its 
pure  f orm^are^elatively  remote. 

In  favor  of  decentralized  approaches  are  arguments  suggesting 
that  important  new  sources  of  ideas  may  be  ch6ked  off  and  heavy 
investments  may  be  made  in  faulty  conceptiirfis  when  the  locus  of 
initiative  and^ control  is  highly  centralized*    In  support  of  the 
field-initiated  mode ^  one  might  argue:  ^ 

^^(5>s^ield-initiated  funding^  is  needed  ^s  a  counter-balance 
to  th$  bureaucratic  mode.    In  part,  this  is  needed  to 
permit  research  to  reflect  key  questions  needed  to  y 
further  the  development  of  the  knowledge  base  ^s  this 
is  understood  hy  the  fielii.     In  part^   it  is  needed  to 
keep  talented  researchers  attracted  to  educa t  ion  * 
The  argument  here  is  that  first-rate  researchers  are  , 
*   unlikely  to  respond  to  RFPs /  to.  carry  out  rjesearch 
designed  by  otherSj  cspeciall^y  if  they  perceive  the 


research  designs  called  for  in  agency-defined  RFPs  as 
T.ediocre  in  qualicy  or  misguided.    And  furthea',  whac 
chese  firsc-race  researchers  are  proposing  should  be 
judged  on  its  oim  terms.    Though  falling  outside  the 
agency-defined  areas  covered  by  RFPSj  these  proposals 
nay  ii^olve  importanc  new  areas  of  work  that  could 
over  the  long  run  have  more  far  reaching  significance 
for  the  field  th^n,  other  projects  that  currently  fall 
'   within  the  agency-defined  program.    Important  first- 
race  ideas  of  ttiis  kind  aKouJjl^e  stimulated  and 
encouraged  rather  than  closed  o^ff^and  the  field-  ' 
initiated  node  (or  variantsiof  it)  is  the  one  most 
likely  to  accomplish  this, 

+ 

(b)  Field-initiated  funding  , may  be  equally  necessary  as  a 
counter-balance  to  the  science  policy  ir^ode^    Ift ^he 
science  policy  mode,  a  small  elite  leadership  group^ 
in  the  field  are  likely  to  be  the  dominant  infliiences 
on  the  direction  funding  should  take.    But  scientific 
progress  has  often  come  about  from  ideas  initiating  from 
young  turks  in  a  field  who  start  off  as  a  small  ^ 
minority  battling  against  the  accepted  paradigms. 
Field-initiated  funding  mi^t  be  essential  to  insure 
their  support  while  chey  remain  young-  turks  outside 

\  the  established  leadership  structure  of  the  field. 

(c)  Some  would  argue  for  field-initiated  fundirtg  a;?  a 
valuable  approach  in  its  own  right,  most  actively 
attuned  to  the  disorganised  state  of  scientiific 
activity.    For  instance,  Corwin^s  call  for  a 
strengthening  of  natural  researcAxomntunities  and 
creating  networks  within  and  across  these  comrnunities 
TT^ight  potentially  fall  within  the  field-initiated 
mode  or  the  ^science  policy  mode  ^ 
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^  ^    *  On  Lh^  other  side  of  this,  debate  ,  though,  one  might 'poiiit  to  the 

t       ^  *  60 

,  ^    -   I'lniced  gair.3  zo  date  £rob  fie  Id- initiated  funding.        However  j- 

it  is  not,  enLirely  clear  that  thl's'^s*^  valid  argument  since  it 

would  seem  necessary  first  to  determine  how  much  of  the  si^i- 

ficant  research'  that  has  been  carried  out  (as  wellK^  as  *how  much  . 

of  the  trivial  output)  has  in  fact  been  of  t^e  ileld-initiated 

^^       ,  variety.  -  '      ^        -  ■ 

^         Finally,  we  coraf  to  t he' marke  t-or iented  mode*    -Tffe  key  arguments 
$      <^     in  support  of  this  pattern  would  seem  to'be  th^ £ol lowing : 


*  ^       ^    (a)    Relatively  little  of  the  research  or  5^  activity  that  , 


1 


'  has  originated  outside  the  operating  swsten^  (or  with 


way  into  schools  or  affected  ^acttce  .  ^ 


^  ^  V    .    ■  out  the  involvement  of  p.racti^oaars-)  has  found  its 


^        -jj*    '  *     ^(b)*  There  i.s  a  significant  need  for  improvement  of  educa- 
/f  ^        ^  tlonal  practice  but  the  strategies'  developed  until 

, recently  have  been  misguided"  beca^Jse  they  were  R&D  J^'^^S 
^  oriented  or  problem-oriented  without  being  market- 

■T  '    ^       »  ■  .     .  61  *  >  ' 

oriented .  , 

■  '  -  .  ■  y 

(c)    R/D^I  resources  *eed  to  be  dispersed  acrcJ^s  the  count-ry 

■J  <  '  r  ■  y 

in  the  s^me  way  t**^  the  operating^^ystem  is  dispersexl 
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/  across^  the  co^Jntry.     Improvement  can  come  about  if 

^  **  practitioners  work  with  the  a^^istance  of  others  to  - 

meet  their  needs ,  and  tjiey  are  likely  to  do  .this  only 

*     .  if  the  resources  are  nearby  and  readily, available  and  ^  ■ 

^  ,  accessible  to  them,  able  to  aftect  and  become  a  part 

♦  ^       ^  ■  ■  • 

*  ,     ^         "     ^  of  the  -work  setting  In  which  they  function. 

•^        Among  the  drawbacks  ojE  the  market^oriented  model,  tho^h  arc^  t*ie 
fallovr.ng:  '    *     ■  \ 

%» '         ■    •  ■  > 


(a') 
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There  are  clea|^ris^  o&  the  market-oriented  pattetri  ^ 
b^coning  a  return        simple  delivery  of  flold  services^ 
^    ^  with  none  of  the  generalizabtlity  or  diffusion  of^ 

solutions  and  none  of  the  cap^bj.liCy  development  of 
K/d&:1  and  consequently  limited  long-term  return  oa 
the  investment  *  .  '  "  ' 

i 

(b)    Gijen  the  size  of  the  operating  system  and  therefore 
the  Scale  across  which  resources  might  have  Jto  tie 
^  dispersed^  questions  of  likely  quality  of  outputs  and 

level  of  Inipact  will  inevitably  aris^^^^lL  sites 
across         country  funded  in  the  naarket-oriented  mode 
,be  able  to  produce  systematically  tested  outcomes  of 
^      high  quality  (as  might  be  expected  from  a  small 
^       *  _  number  of  irtatitutions  funded  at  a  substantial  level)? 

(Of  cojjrse^  given  the  history  of  the  regional  labora- 
tories ^  the  outputs  they  produced^t  and  s^me  of  the  ,  ^ 
recent  questioning  of  the  payoff  from  high  development 
^  expenditures  of  *  nationally  oriented  laboratories ^  the 

potential  payoff  frotn^he  market  oriented  mode  might 
not  seeta  unattractive*)  ^  ' 

One's  position  o!^  these  various  questions  is  lively  to  be  ^ 
cAsely  intertwined  with  one^s  views  on  the  issues  of  internal 
vs external  ImprcSvement  strategies^  functional  balancef^and 
systecn-building*    We  therefore  tuj:n  to, these  other  issues. 

)      • .  ^-  ^     •  ■ 

4,      Inprovetngnt  Strategies:     £xti|^rn5l  vs.  Internal  Chang.e  Processes 
A./     Extern^].  Ch^ae^e  Strategies  ' 


Several  kinds  of  external  change  strategies  h^ve  been  proposed. 
Therti  have,  of  course,  been  various  kinds  of  political  reform 


270 


scVaCe^ies  —  clcizen  parcicipaciorij  decencralizat ion,  cornmunicy 

c:tnti:oL,  ecc,    '^^k  ta'ke  note  of  these  strategies  but  discussiuci 

6  3 

of  th'em  is^  outside  the  framework  of"  this  analysis.      It  S'hould 
be  understood  for  the  retiainder  of  this , analysis  that  when  we 
use  the  tera  **external  change  str^egy''  here  our  concern  is  with 
only  one  kiad  of  external  approach       RSD  or  R/D&I. 


) 


The  external  change  strategies  we  consider  here  have  been  p^^*e^\ised 
on  a  n\i:t  of  assumptions  about  the  nature  pf  schools  as  institutions  > 
'th^  nature  of^rganizat  ional  change,  and  the  outputs  likely  to  ^ 
brii  produced  through  use  of  Rii)  approaches. 


(a) 


Schools  are  described  ir>  terms  of  their  change- 
resisting  properties,    Since;schools  are  publi'c    ^  ^ 
monopolies^  a^ured  of  stu<fents  and  funding^ 
operating  as  publi*  bureaucracies  with  relatively  " 
little  public  Accountability^  there  are-few  incen- 
tives to  cha'tige^^nd  ^  many,  incent  i^es  to  resist  . 
^change  .    Educational^nnc5^ations  tend  to  be  "piople- ► 
change"  innovations        they 'requir-e  .unlearning'old 
ways>as  well  as  learning  new  ways j  and  they      e  j 
often  incon^^ent  with  eSt&blisHed  norms  and 
strongly  held  values  about  the  role^  of  the  prac- 
titionej;  in  relation  to  studants,  p*T^nts  >  etc. 
Teaching 'is  described  as  a  semlt-^afession,  thereby^ 
characterized  by  status  anxieties  that  make  it 
difficult  for  educators  to  relate  openly  to*  external 
sources  of  expertise-    The  general  absence  of  change- 
agents  in  school  as  instituti^ons  is  noted>  along  with 
the  at^ence  of  resource  allocations  to  change'func- 
tions       whether  in  terms  of  the  time  available  to. 
.practitioners >  administrators,  etc.j  or  the  hiring  of 


specialized  personnel  with  change-oriented  roles  and 


reSDonaibiiit ies .    And  s6  on. 


The  thrust  of  a| 


a6 


-  ' .  / 
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these  assur;:^pt:ioas  is-that  geaerally  change  is  ualikely- 

to  come  abo^Jt  in  school*'syste::is  unless  the  initiaf-ivs; 

pressures'^  design  of  the  ihaovatioas^  etc.  .come  froin 
the  outsidti.  " 

■  V  S    ■  ■■  ■ 

reiatively^s^ffple  change  ^bcess  was  assumed.  A 
key  Darrier  to  improvement  has  been  assumed  to  be 
prac^itio^net^s-*  o£'sLi£ficient  high  qu^ity  materials 

and  up-to-date  inf orriatio^from  research,  the  experience 
o£  oth^r  practitioners  J  etc.    Consequently,  external 
change  strategies  focus  resources  on: 

1,      development  work,  producing  high  quality, 
systematically  tested*,  effective  materials, 
devel<5ped  by  curriculuni  and  subject  matter 
^  experts ,  testers ,  packagers ,  etc* ;  and 

■    1  ■  • 

'  2*  disseminationV^nd  other  linkage  approaches, 
to  deliver  the  niateriais  information ,  etc. 
t/  "users.  " 

'  In  recognition  pf  some  of  the*  difficulties  encour^ered 
in  implementing  sone  of  these ^externally  developed  * 
materials  in  school  syscems^^arious  kinds  of  technical 
assistance  and  other  inpiemenca^^n  supports  arc  a  key 
part  of  more  current  conceptions  of  'linkage."  Cut 
unquestioned  ,was  th^  operatj^fi^  assumption  (if  not  the 
theoretical  assumption)  that  the  identification  of  what 
was  Co-be  cli^nged,  ^cs  design  ajid  developrrent  ^  were  all 
to  be  carried  tutitby  specialists  (rather  thfln  practi- 
tioners) functioning  in  vorl:  settings  outside  the  operat- 
ing system.  . 


V 


(c)    The  o'Jtp'jts  expected  froni  RciD  '-^ere  to  be  high  quality 
yr .;d jc 1 5  ^ind  programs y  c lear ly  superior  to  conventional 
proJjCTs  and  programs^  possibly  "teacher-proof* 
i*e.tj  designed  to  be  imple::iented  as  developed  and 
Expected  to  produce  the  sarrie  effects  in  the  o:)erating 
systea  ^s  in  the  developers'  field  tests> 


(d)    jJeve'lopinent  costs  would  no  doubt  be  high  since  the  best 
,  ^taler.t  would  be  used^  along  with  systcr^atic  develop:nent 
prOw^^jjjg^  ^  extensive  successive  cycles  o£  evaluation 
a-^  J  reimer^^ent ,  c  f  f  ec:  iv%  pac-'.^ging  ( ^fej^-^P^  '*--h 
needed  tr.plcnientation  supports)  ^  arid  speci3ll^ed 
dissemifiatioa  resources.    However^  over  the  long  run 
the  per  unit  costs  for  such  quality  materials  would 
be  low  oace  they  were  disseninated  widely  and  used  in 
large  nun^bers  of  schools  across  the  country.    The  re- 
turjj  on  investment  would  be  greater  than  Trying  to 
,   distribute  an  equivalent  amount  of  funds  across  the 
country  to  support  local  development  in  t;housauds  of 
^        '  School  districts.    The  amount  available  to  each  district 

(or  even  t6  a  large  number  of  selected  dist^^cts)  would 
probably  be  too  sfnall  tq  support  much  if  any  development 
activity  and  ^the  outputs  produce^?, would  probably  be  of 
i   caediocre  quality  or^  even  tf  of  apparent  good  quality^ 
•  ^ndt  widely  tested  or*  validated  or  packaged  in  a  way 
that  could  permit  th^ir  use  by  others.    Thi  money 
might  then^  in  e'ffect^  be  frittered*  away  on  immediat(\ 
'  .uses  lacking  generalizabiliry  or  long^ter^i  continued 

payoff. 

The  argument  in  support  of  e>;ternal  change  strategies  ^  ^thcn, 
was  that;     change  was  not  likely  to  co::ie  otherwise;  th^t  the 


product;,  of  external  R6D  would  be,  cleatly^^iperiar  and  ther^ore 

i 


willingly  and  easi  ly  %nplementad  (If  not  e^Uy,  chen  with  sone 
cechnical  assfstance);  chac  ovsr^^^^e  loftg  run  che  RotD  approach 
would  be  more  economical,  providing  the  greatest  possible  payoff 
^^^^^  i^npact^  per  dollar  spent;  and  that  all  thac^was  needed  was  to  .  ^ 
put  Into  place  specialized  development  institutions  and  a  pipeline 
for  de  liver Ira^^oducts  to  user?,    This  d^y  be  an  oversirnplifica- 
ticn  of  the  argLir^snt.     Some  recognized  the  neea  for  adaptation 
of  externaHy  developed  outD^2ts>  the  dffficulties  of  the  ''tea;:her- 
proof''  r.otioriy  the  proble^is  likely  to  be  encountered  at  .the  Ir^pl^- 
nenta^iion  sta^e  as  'jell  as  earlier.     In  sorrie  discusslons>  more 
active  roles  for,  practltio:^er3  were  clearly  called  for  at  virtually 
every  step  along  the  va^>  from  need  Identification  through  various 
design  and  ''fine  tuning''  stageSj  evaluatlonj  packaging,  etc.  But 
regardless  of  the  variants  >' descriiDt lorts^  of  external  change 
strategies  did  se^ri  to  seeT^the  operating  systen^  largely  in  terms 
of  being  the  'Vser^^  at  the  end  of  the  pipeline,  a  rather  different 
conception  from  that  held  by  proponents  of  various  internal  change 
strategists ,  '  f 

B\      Int^rqal  Cbanger^Strate^ies 

A  ' 

Proporten^ts  ofj^intemal  change  strategies  have  had  more  active  con- 
-cept  ion^  .of  ^>ie  role^  of  operating  systdm  personnel  in  the  change 
^'  process.     The  case  for  internal  approaches  has  been  rij^de  on  several 
grounds:  .  . 


(a;t    iher^ii  has  not  been  a  sufficient  return  on  the  large 
invest:nen^  that  has  been  made\in  external  change 
strategists.     Most  of  the  products  d^^veloped  have  been 
of  inff_'rtor  quaUty  m  comparison  to  existitfg  materials 


Ilk 

J- 


developed  by  convent  iona I  (rtort-RM))  r^earts  ,  And 
r^jlatively  le;;  have  beert  :;ideLy  adopted  and +used 
in  sgItooI  syscenis.    In  pare  this  is  due  to  their 
poor  quality.     But  also  of  importance  here;  is  the 
fact  thac  operating^ysten  needs,  constraints,  and    ^  ^ 
dynamics  have  not  besn  adequate  l>9  taf;;;n  into  account 
in  th<iir  developmei^t  and  inadequate  attention  has 
been  given  to  the  difficulties  of  ir.plsruentiag  ^ 
/externally  developed  i^nnovacions  * 

(b}%.  It  niay       that  soT.e  factors        S'jch  as  ch:S  nature  of 
schools  as  institutions  oi%  the  nature;  educational 
;>ractice  as  craft-like  in  its  riorms,  values,  and 
dynaciics       make  external  change  strategies^-enwise 
and  suggest  the  greater  wisdom  of  internal  change 
strategies.    If  there  are:  enormous  barriers  to 
itaplenientin|  externally  developed  products,  prograjis, 
approaches etc .  J*  if  practitioners  ne^d  ^to  be  able  to 
d'evelop  their  o'^n  sj?lutions  to  problems  to  be  able 
to  absorb  the  changes  into  their  experiential  knowledge  j' 
ba^e  ^nd  their  repertoire  of  skills  and  approaches^ 
then  the  developments  ox*  internal  operating  system 

/        capacities  for -problen-sjolution  and  -  change  would  seem 

■^^       to  be  a  more  effective  strategy.    Those  who  contend 

*  ^    '  at- 

that  money  would  be  "frittered  away'^in^ne  old 

^    '  >^   .  *  '  ^ 

,  field' Service  t'radifcion  fail  to  sea  that  the  funding 

focue  wouid'be  on  Seveloping  practiti^oners^  capabili ties 

(vihich  hsrs  long-E^^rm  ^irmpli^catipas)  raVher  thanfrsimply 

^  developing -in  the  course 

of  truildiDg  thoss  jcapa^>e,Litiejs  fwhich  .mi       or  iT^ght 

s  pot  have  roti^-term^c:i4)^yi)(T  And  a^ter  all,  given* 

"*tfhe  expert erttie^l  ^tuy^  ,b^^  ^ducati«fial  practice  as  a 

^       cra^t- 1-4^6  fie^ld,^<3eCelopi'^^^  prjcf  IjLio^er  ^apabi  liti^ 

in^y  hp  Cbe  JOtj^T  souck^  r^^iite. 'ttf  fuDd^ridntal  changes. 
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100I5  Vn-here  pxact ic i one 
ing  ar.d  Iti^h  cJuVlity  pros 


(c)    There  ate  innovacive  schools 
J        develcp  lh>;ir  own  ei-cciciag  ar.d  Ifi^h  cJuVlity  prbgrarns 
and  oiaterials  and  ^^here  principals  or  others  function 
as  educational  leaders  and  change  a^eats  (not  simply 
as  administrators).     lastead  of  premising  change  ' 
scrategieSs^iJXjjassualDtions  about  the  barriers  to  change 
as  they  appear  to  be  "operative  in  "the  great  majority  ' 
of  schools  J  it  might  be  wiser  to  focus  oa  the  condi- 
tions  that'  suppom  innovation  m  the  more  exemplary 
settings  and„try  to  develop  similar  conditions  or 
supports  in  oth^r '^schools  and  school  districts. 

Choice  Between  Potions  and  Relatloashlo  to  Other  Issues 


p^'here  resources  are  unlirrolted ^  botjj,  external  and  ianernal  change 
strategies  can  be  suppcfTted^,    Hovever  ^  in  a'  liaited  Resource 
slTuanion^  choices  have  to  be  made  j  i£  not  between  one  approach 
or  the  oth^r  than  still  c^tainly  in  terms  of  how  mujZ^  of  the 
total  available  supply  of  ^resources^'should  be  allotted  to  each 
approach.  / 


In  making  such  dec  isions , '|one  is  likely  to  be  swayed  Howard  one 
cnt  the  other  approach  to  differing  degrees  depending  on  one*s 
position  on  se^^r^l  issues  we  have  considered.    Once,  having 
decided  that  resources  should  be  allocated  to  the  goal  of  /* 
improving  t*ducational  pract^e  then:  ^  ^ 

•\  * 
*(a)    Who  Ls  in  the  best  position  to  determine  ho^^  these 
roi^arc^^s  nignt  besc  be  sp*ent        the  ros^arch-R/Dctl 

f 

cenruniny ' (who  are  .part icular Ly  sensitlve^to  the  stato 
of  the  art  and  chp  capacities  that  do  or  do  not  oust 
'  *      to  produce  certain  kinds  of  development  outputs)  or 
le  pracc  it  lone  r/,co^unL t^y*  J^'-^'ho  are  part  icu  !a]?ly 
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sensiCive  Co  Che  operacing  %^^#^^'s  perceived  needs 
and  CP  wnat  is  likely  co  be  impl,emeaced  by  pracci- 
cioners  in  schoois)? 

(b)  Should  resources  be  concencrac^d  in  a  fev  qualicy 
cencers,  established  co  syscemacically  develop  for 
disse:r.inacion  co  schools  the  besc  qualicy  products 
and  prograais  chac  can  be  developed  (given  che  stace  ' 
of  the  arc)  with  che  mosc  first-rate  R6J)  taleint  y 
available?    Or  should  available  funds  be  distributed 
to  scr.ool  ^ysteTis  to  enable  thcin  to  funa  accivitics 
of  their  own  personne  1,  who  may  noc  have  specialized 
R6tD  expertise  but  who  are  gifted  practitioners 
capable  of  developing  highly  useful  programs  and 
materials  which  they  (and  probably  their  colleagues) 
are  likely  to  use  in  one  form  or  another? 

(c)  What  kinds  of  R/Dal  activities  are  most  likely  to 
have  che  best  payoff  for  school  improvement 
fundamental  research,  applied  research-  developnentj 
iinkagej  developing  internal  operating  systeni  capa- 

^    citieSj  or  providing  services  to  meet  immediate 
practitioner  needs? 


We  have  fiready  considered  issues  (a)  and  (b) ,    We  turn  now  to 
(c;  above,,  th&  issue  of  balance  across  functional  areas, 

5.      Balance  Across  Tunctional  Areas 

Debates  about  the  relative  merrts  tyf  supporting  basic  vs.  applied 
research  or  research  vs,  development  seem  to  be  e/idenic  t>>  virtually 
a  1 1  rK^P^ysCcms .     In  educaCion^  the  situation  is  even  more  compli*  f 
^Uh  arguments  voiced  about  the  relative  mer^s  of  increasing 
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resource  aHocatior.s  not  only  co  (a)   fundaneatal  reScarcJi  or 
(b)  apzi^i^c  research  or^  ''c)  d;^velopmeat ,  hue  also  (conpetia^  for 
atteaLioa  for  ever-larger  shartiS  of  the  total  pie),   (d)  di s^^naaat ion/ 
linkage  functions  or  (e)  ir.raraal  op^^ratiag  system  capab:.lity  develop- 
meat        (£)  lEnmed Late  probleri  solution  in  the  "fieLd  service*^  tradicior 
that  prevailed  prior  to  the  emergence  of  educational         ir.  Che  *60s* 

A .      Fundanenta  L  Research 


ihose  who  advocate  sirengrhening  fuadaiiental  research  -ake  the 
cas^?  ve  noted  earlier: 

(a)    hov  little        kno:/  at  presejit  about  phenoriena  central, 
to  understanding  ejjcatioa;  learning,  learnir.g 
,   disabilities,  h'j-^n  potential,  etc; 

(b/    the  impact  fundamental  research  has  had  on  botl^our 

.  conceptions  and  education*al  practice  {e*g*,   in  testing;; 

(c)  the  fact  that  iz  is  difficult  if  not  impossible  to 
predict  whe?%  the  next  ruajor  breakthrough  will  come 
that  r^.ight  significantly  change  the  character  of 
education,  school ing,  and  learning;  and 

(d)  a  point  not  alljded  to  earli^r>  the  argurtent  that  one 
cannot  have  a  viable  R/D6X  systen  without  a  healthy 
rundamentai  research  enterprise. 

♦ 


On  th^^  other  sid^  of  t'::-^  coin  is  th^;  ^rg-j'^.ejtt  of  fundar;entai 
r^^s^^'^rch  is  an^ex^pens i      I'jxury  for  a  problem-on enred ,  mul t i- 
d  1 5c  *p  1 1  nary  fie  Id  educat  ion,     ^pf  c  ial  ly  ^mcc  the 


uncerc^ainties  and  risks  are  so  high  and  the  assurarice  one  can 
have  of  pay-oif  r.ay  t>e  lower  thari  for  any  other  furiCtio:ial 
specTSir&^C^  This  is  especially  so  since  what  we  have  learned 
about  the  relationship  between  f urida:nerital  research  arid  appli- 
cation suggests  that:     (a)  there  is  a  considerable  time  lag  in 
such  application  if  it  cor.es  at  all,  that  (b)  the  linkages  to 
utilization  are  much  more  direct  for  applied  research  and  more 
direct  still  for  developr*ent ,  etc,  and  (c)  that  the  source  of 
ideas  for  mosi  applied  research  and  development  comes  not  from 
f^jndan^erital  research  but  from  other  applied  research  and 
dev-;  l-^p-^snt ,        In  turn,  then,  th:^  all  becomes  a  key  pert  of 
the  argur-ent  ror  support  oi  applied  r^ssearch  and  for  develop- 
ment as  we  1 1 , 


Develoi^ment 


The  case  for  support  of  development  work  carries  this  argument 
even  further*    Basically,  the  point  made  is  that  if  new  knowledge 
is  to  firid  application  in  operating  system  settings  it  must  be  # 
packaged  iri  a  form  that  makes  the  new  knowledge  immediable 
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applicable  to  solution  of  a  particular  problem  and  easily  usable. 
In  the  case  of  education,  the  argument  often  revolves  around  the 
poor  quality  of  ::^ch  of  the  existing  pool  of  materials  and  in- 
structional strategies  generally  available  to  educators,    if  only 
better  materials,  etc*    were  available^  practitioners  would  use 
them  <snd  be  able  to  overcome  many  of  the  difficulties  they  have 
had , 

4  -  * 

The  dt:ve iopTer^l  p;jSlC;on  held  svay  in  ^n^  late   '60sj  but  it  has 
lost^ons  iderab  le  ground  since  tben  as  otU©¥- iirgument  s  kave 
gained  more  pr6^an«nce  e-g-; 


Dty^elopm^mt  costs  ha^t?  been  v^ry  high        ,  with  some 

1^ 


§ 
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nocable  e?cceptions,  the  outputs  have  been  dis-^ 
appointing  in  quality, 


(b)  Many  development  outputs  have  been  poor  in  quality 
because'  the  existing  knowledge/technology  base  was 
not  adequately  refined  to  permit  sound  development. 

*More  research  is  needed  and  more  attention  to  the 
state  of  the  art  ^nd  refining  systecn  capacities^ 
Pre^iature  investcnttrf^  in  development  is  wasteful  and, 
even  worse,  pooi*  quality  outputs  that  are  produced 
decrease  the  legitimacy  of  the  ^ole  R£J)  enterprise  ^ 
making  it  ^uore'difficult  to  secure  R6D  resources  in 
the  future.  ^ 

(c)  More  and  more  products  are  being  produced  but^  available 
products  are  not  as  widely  used  as  <^e  would  have 
expected.    In  part,  this  is  because  inadequate  resources 
were  devoted  to  dLSsemination>  linkage^^and  imple- 
mentation,  support . 

Linkage 


Thus,  the  argument  on  behalf  of  resources  for  linkage  functions. 

But  at  least  tvo  arguments  can  be  made  against  heavy  in\^straent 

in  linkage  as  well:  ^ 

(a)    The  linkage  strategy  assumes  that  there  is  a  substan-  ^ 
tial  S'jpply  of  quality  products,  strategies,  Ac  i  to 
'cx5Ser:iin:iCt^G  and  installed  in  school  systems^  an  ^ 
a^surr^ption  tliat  r^any  critics  are  likely  to  challenge, 
and  ' 

{b)     M^ny  who  focts        the  crafts-like  nature  of  the  practice 
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setcLng,  and  other  technical  and  mocivational  barriers 
to  i'?.ple-:^enLing  th\:  outputs  of  exteraair  Ri^D,  Would 
probably  be  skept-ic^l  of  the  gains  to  be  derived  from 
invxiSting  in  linkages  betwtien  (1)  suppliers  o£  mate- 
rials packages  that  are  not  likely  to  be  used  as 
designed,  and  (2)  potej^ial  "users'*  who  a^^e  not  demanding 
Such  packages  and  tend  to  resist  their  use. 

Internal  Capacity.  Building 


T'^'-^  'y/o'jld  i^^3-j5tj  then,  the  need  to  -supporc  che  develop7i^*nt  of 
ir.cernal  operating  system  capabilities.  'We  [jave  already  con* 
5idered  the  arguments  for  and  against  this  option. 


F,      Providing  Services 

As  one  final  option,  an  argument  could  be  made  that  indirect 
approaches  to  improvement  rarely  have  the  long-term  effects 
expected  and  therefore  it  -is  such  long-term  approaches  that 

4 

in  fact  fritter  away  scarce  resources  and  fail  to  bring^real 
gains  rather  than  the  direct  short"tera  provision-c^f-servicres 
approaches.    The  services  argument  focuses  on  the  considerable 
needs  schools  have  and  the  budget  crunch  many  school  systems 
have  faced,  neccssitatingycutbacks  in  what  have  long  been  con" 
sidered  essential  parts        school  system  offerings.    How,  ask 
practitioners,  can  large'  sums  of  money  be  allocated  to  lavi^ti 
R6J)  programs  which  produce  materials  for  which  there  is  no 
market  whi  le  ^stJiool  systems  are  cutting  back  programs  in  art, 
masiCj  athletics,  counseling  servi^s  and  even  established 
coniponents  of  the  ^standard  subject  matter  curriculum? 

On  che  other  side  of  this  debate  are  all  the  argumeOts  we  have 
considered  in  support  of         long-mnge  gains  ^o  be  expected 
from  systematic  inquiry  and  the  various  internal  and  external 
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chants  aoproachtis  to  school  LmprovemenC . 

Clearly,  one's  position  on  such  questions  is'  likely  to  be  determined 
by  one's  perspective  on  who  should  define  goalSj  priorities,  and 
needs;  what  approaches  are  most  likely  to  produce  maximum  payoff 
from  per  doljar  investment and  especially  the  time  horizon  'J>f 
one's  goals.    Consideration  of  short-term  vs.  middle-range  vs. 
long-term  goals  brings  us  to  the  final  set  of  macro-level  *L«sues 
of  concern  to  l;s  herft        i.e.^  how  triuch  ethphasis  in  allocating 
re*sources  should  be  placed  on  direct  services  to  school  systems 
(shPrt-term)  vs.  producing  outputs  to  be"  used  by  schj)ol  systems" 
(mid<ile -range;  v>.  building  capabilities  (long-term) . 

6.      Balance  Between  Producing  Outputs  and  Euildina  Capacities 

What  is  the-^roper  balance  between  allocating  resources  to  (a)  producing 
outputs  for  use  by  the  operating  ^ystem^  and  (b)  building  capacities  so 
that  better  quality  Outputs  can  bg^roduced  more  efficiently  and  more 
effectively  in  taet  future?   '(As  noted  in  the  previous  section,*  prac- 
titioners would  likely  call  for  a  third  it^m  in  tfie  balance  as  well^ 
i.e.  J  considering  the  need  for  direct^  allocations  to  operating  system 
functioning  as  a  factor"  to  be  rockoneti  in  determ^ing  the  proper  size 
of  the,  slice  of  the  total  education  pie  to  be  givea  to  either  R/D^I 
outr^t-oriented  activities  or  R/D&I  capacity-building.)  . 


^Kbehji/f  of  resource  allocatjjCn  to  system-buildingj  several  ar^uc^ents 

70  '  *  ^ 

have  Been  cr.ade :  _ 

r  *  .  .  . 

(a)    Tht!  educational  r/Dol  system  is  ^currt-nt ly  imiature  2nd 
,   ^  underdeveloped  and  is  not  likely  to  be  able  to  operate 
at  a  high'  level  of  effectiveness  for  some  time  to  come 
unless  ^  sizeable  investment  is  made  in  developing/^ 
system  capacities. 
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(b)  It  may  be  ^wasteful  to  invest  heavily  in  r/D&I  activities 
before  needed  capacities  are  sufficiently  developed, 
especially  personnel  with  the  needed  skills  ^  .organizational 
arrangements  that  permit  the  necessary  resources  to  TSe 
mustered  and  managed,  linkages  required  to'perrait  smooth 
flows  and  ^interfaces  across  components  of  the  system,  etc* 

(c)  Procurements  to  output -oriented  activities  have  inevitable 
system -impac  t ,  whether  planne<l  or  unplanned  e*g., 
permitting  development  of  capacities    in  one  set  of  insti- 
utions  rather  than  another^  encouraging  or  "turning  off" 
one  set  of  R/D5tl  performers  or  another^  etc.     If  system- 
building  is  accepted  as  a  legitimate  objective,^and  if  in 
addition  to  direct  ^stem  building  allocations  (e.g.> 
training  programs)  some  relatively  small  sum  is  allocated 
to  developing  planning^and  coordinating  mec^J^nisms  to, 
maximize  the  positive  system-building  consequences  of  agency 
actions  J  then  the  long-range  gains  may  be  considerable". 

^  (^)    System-building  requirements  are  related  to  system  maturation 

states:    as  the  R/D&l  system  becomes  better  developed  and  more 

mature,  lower  levels  of  resource  allocation  to  system-building 
objectives  will  be 'required. 

Although  it*«eems  doubtful  that  argurtients  would  be  voiced  against  system 
building  objectives  in  the  abstract^  decisions  a6out  allocations  of 
resources  tend  generally  to  either  ignore  s^stem-btiilding  considerations 
or  to  decide  th^t  other  shorter-t,erm  nee^Js  are  more  pressing  or  more 
likely  to  provide  needed  shorter-term  payoff. 

"If  an  explicit  case; were  to  be  made  against  system-building  allocations 
or  for  other  op^iong  as "of  higher  priority,  the  case  would  probably 
include  some  or  all  of  the  following  elements:        ^  t 
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(a)    Other  needs  are  more  pressing. 


(b)  Once  ^ort-term^accomplishtnents  can  be  pointed  to  »^duca- 
Cional  RM)  wiLl^have  greater  legiti^macy  and  it  wilL  be 
easier  to  muster  poLiCical  support  some  time  in  the  future 
for  s  ysXem-building  al^l-ocat  icjns  , 

(c)  System-building  allocatvions  tend  to, support  researchers  and 
R6cD  institutions  without  having  substantial  ^impact  on  the 

•probabilities  o?  producing  educational  improvement. 
Resources  are  ofter\  diverted  to  sppporting  these  institu- 
tions  and  personnel  to  carry  out  activities  feey  might 
otherwisp  carry  out  that  are^ not  directly  relevant 
educational  itrtprovement  (i,e.>  the  definition  ^of  wttat 
capacities  need  to  be  developed,  and  how,  difjfer^  from 
the  critics  perception  of- what  is  needed),. 


(d)  'Or,  given  the  new  orientation  toward  capa^cnty  development 
in  the  operating  system,  resources  for  opacity  development 
in  SEAs  or  LEAs  may  be  diverted  to  suf^ort  operational  ^ 
activities  not 'directly  relevant  to/educational  improvement. 


(e)    Those  who  take  the  position  thatr  the  educational  research- 
R/D^cI  community  can  best  be  understood  as  a  configuration 
rather  than, a  system  might  bfe  leary  of  system-oriented 
or  capacity-developing  allocations  that  appear  to  smack 
too  heavily  of  system  maftagecient  or  cSordinationi  (They 
probably  would  not^  however,  object  to  allocations  oriented  ' 
simply  toward  develo/fing  the  resourcer^or  capacities  of 
f^idividual  InstitutAons  in  the  conf ig^uration  as  the  in- 
stitutions thems^ves  define  capacities  they  need  to  develop,) 


As  in  all  the.  other  iss> 


we  have^,consideredy  one's  position  on  these 
I 
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options  is  c  Lose  Ly  , intertwined  with  ocie's  perspective;  on  whac  is 
possibL'sj  what  approacht^s  are  most  Likely  to  be  effeccivej  and  what 
th&  R.roper  role  of  governmer^t  should  be. 

7>      Central  Issues :  SurLT^ary 

Over  the  past  two  decades>  there  has  been  a  continuing  dialectic 
between  propocients  and  critics  of  different  approaches  to  resolving  % 
six  hi^Ly  iciterrelated  issues  about  macro-level  goals^  policies, 
acid  strategies  for  educatLonal  R/D^I: 

\,      what  (if  any)  gaicis  caci  be  expected  frorr^  support  of 
systematic  research  or  R£tD; 

'  2-      the  proper  role  of  government  In  support  of  research  and 

3-      the  proper  balance  between  goals ^  priorities,  etc. 

favored  by  the  research-R/D£tI  cornmuni  ty^  prac  t  i t ioners  ^ 
and  federal  officials; 


4.      the  proper  balance  between  internal  and  external  chaijge 
strategies ; 


the  proper  balance  actors  functional  areas;  and 

/ 

the  proper  balance  between  producing  R/d^^I  outputs  and 
building  R/d&I  capacities. 


An  overview  of  key  federal  funding  initiatives  over  the  past  two  decades, 
and  the  various  pressures  exerted  for  change  in  one  or  another  emphasis^ 
shouLd  il'l^ustrate  well  the  kind  of  continuing  dialectic  Bailey 
described,'  \ 
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III.     HISTORICAL  OVERVIEW 

'1.     Stase  One:      lack  of  Federal  Role  (Pre-1954) 

Prior  to  the  passage  of  Che  Cooperative  Research  Program  In  1954>  Cho  ' 
federal  govermneat  was  not  activtily  involved  In    the  spor^sVrship  of 
educational  research  or  school  irnprovetnent  programs.     Education  was 
viewed  largely  as  a  fujoctioa  reserved  by  the  Constitution  for  che  States. 
The  Office  of  Educatlon>  established  In  1867,  functioned  for  87  years  ^ 
in  a  bystander  role,  gathering  statistics  and  disseminating  Information* 
There  was  little  if  any  debate  on  (or  even  consideration  of)  any  of 
the  macro-level  issues  ^e  have  considered;  none  of^chese  matters  were^ 
thought  of  as  within  the  purview  of  federal - po licy  concerns* 


Some  historical  overviews  of  educational  research  provide  some  sense  of 

,  72, 
;  the  kinds  of  activities  being  carried  out.     But  Information  about  sources 

of  funding,, as  best  we  can  surmise j f Is 'sketchy  or  impressionistic* 
The  sources  of  funding  may  have  been  largely  universities,  philanthropic, 
or  researcher  self-funding;  *the  scflle  of  research  activities  was  gej^^rally 
quite  small  and  expenses  minimal*    ^In  addition  to  i^search  activities, 
there  was  some  development  work    (e*g*,  in  the  area  df  tests  and  measure- 
ments), some  internal  development  and  demonstration  in  the  laboratory 
school  tradition  (e*g*,  some  of  the  wo^rk  of  John  Dewey)^     and  con- 
siderable provision  of  direct  services  in  the  field  service 

tradition    (e*g*>  education  professionals  in  the  uiri^ers i^tles  helping 

* 

'practioners  as  consultants  to  solve  immediate  problems,  evaluate  programs, 

X  ^  '  73 

provide  materials  to  meet  a  practioner-def ined  need,  etc.) 


2*    Stage  Two:  .  Research  Emphasis  and  Laissez-Eaire  Mode  of 
Management  (1954-1964)  ^ 


The  passage  of  the  legislation  establishing  the  Cooperative  Research 
Program  (CRP)  in  1954  was  the  first  majoz  breakthrough  In  support  of 
the  position  that  research  can  increase  Our  understanding  of  education 
and  should  therefore  be  supported  with  federal  funds.    Wit,h  the  flow 
of  CRP  funds  which  began  two  years  Iffter,  federal  involve?ment  In 
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educational  W  DSil  was  clearly  (if  half-heartedly)  initiated.  The 
tibial  apfpropriatlon  was  small  ($1  million),  and  two-thirds  of  that' 
was  ^rinarked  for  researcft"' relevant , to  mental  retardation.  But 
educational  research  was  thereby  established  as  an  item  with  a  claim- 
to  federal  support. 

During  the  late  '50s  and  early  ' 60s,  when  the  Cooperative  Research  a 
Program  (CRP)  was  the  most  highly  visible  source  of  e'ducational 
funding,  system-  priorities  were  determined  largely  by  the  community  ,  | 
of  educational  reseaj:chers  and  researchers  from  the  disciplines  carryi*tg 
out  studies  relevant  to  education.    The  dominant  mode  of  funding  was 
f ield-initfated ,  and  the  Office  of  Education's  style  of  research 
:r.anag=;7r*ent  was  closest  to  the  laissez-faire  inoda.    'Bhe  Office  of 
Education  functioned  largely  as  a  conduit  of  funds  to  the  research 
comnunity.    Tlje  locus  of  goal-setting  was  decentralized,  scattered 
amo_ng  all  the  various  researchers  and  research  ioetitution?  who  sub- 
mitted field-initiated  proposals  and  the  prominent  researcher^  who 
served  on  review  and  advisory  panels. 

In  a  researcher-dominated  context,  research  was^  rather  naturally 

emphasized*    Development  of  the^field's  knowledge  base  was  the  goal  of 

the  system;  funding  educational  research  projects  was  essentially  the 

strategy;  and  funds  flowed  primarily  to  the  universities  where  researchers 
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were  located*    According  to  Dershimer ' s  ^account ,  building  a  sound 

research  cotnmunity  was  one  of  the  key  objectives  of  the  CRP  program 
attracting_ first-rate  researchers  from  the  disciplines  to  work  on 
educational  problems  and  building  a  community  of  educational  researchers 
and  scholars  from  the  disciplines*    Clearly>  then,,  there  was  some  direct 
concern  about  capacity  building  objectives , and  indirectly^ university 
capacity  to  carry  out  education-related  research  must  hnve  expanded 
during  these  years.  , 

Even  vith  the  CRP  emphases  clearly  established,  ttuer^  were  several  visible 
signs  of  the  inevitable  dialectic*    Flrst>  OE  staff,  leadership,  and 
advisers  fought  over-  k^]   the  unsolicited  field-initiated  approaches 
favor^^d  by  the  research  community  and  OE  leadership  v3*'Cb)  OE  solicited 
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research  in  support  of  staf f -def ineci  neecis^and  programSj  as  desired 
by  mudh  of  the  OE  staff  ■ 

Second,  tfere  was  a  dialectic  over  the  extent  to  which  supported^re- 
search  should  be  expected  to  lead' directly  to  school  improvement. 
During  these  years,  the  forces  mustered  on  behalf  of  more  direct  ^ 
i^iprov^icent  strategies  and  research  more  targetted  at  application  and 
impact  gained  increasing  influence^  winning  the  next  round  and  bapOKiing- 
the  dominant  influence  in  stage  three,  which  we  shall  turn  to  shortly, 

And  finally,  there  was  the  dialectic  over  research  vs  ^  R£iD  or  development . 
Whi^le  CE^P  funds  were  prinarily  used  to  support  field- init ia ted  research^ 
CRP  funds  "^ere  also  used  to  sup^jort  two  nore  targ^tt^d  Jeveloptnent  ^ 
programs  for  -  curriculum}  iinprovement .    Most  notable  Ln  this  mode  were 
Project  English  and  Project  Social  Studies ^  modelled  after  another 
major  development  initiative  begun  in  the  l^te  '50s,  the  National 
Science  Foundation's  Course  Content  Improvement  Program.     The  RSF 
programs  to  redesign  and  upgrade  high  school  science  and  mathematics 
curricula  brought  leadirig  scholars  from  the  sciAnces^and  mathematics 
into  the  enterprise  of  ptroducing  courses  and  materials  for  high  school 
students        PSSC  physicss  BSCS  biology^  CIEM  cKemistry,  etc,^^' 
The  enterprise  sparked  the  imagination  of  educational  reformers  and 
seemed  for  a  while  tx>  offer  a  model  for  limitless  possibilities  in 
school  improvement.     Other  more  applied  or  developmental  work  was  also 
supported  at  this  time^such  as  projects  to  improve  instruction  in 
foreign  languages  and  to  increase  the^application  of  audio-visual 
and  other  media  technology  to  instructional  pruposes,  both  funded  by 
OE  under  special  appropriation^  mandated  by  the  National  Defense 
Education  Act  of  1958-    There  were  other  development  projects  as  well 
Project  Literacy,  the  Developmental  Program^  etc*    As  educational  reformers 
came  to  see,  increasing  potential  for  improvement  coming  from  this  more 
directed,  "more  applied  route,  a  new  .power  balance  emerged*     In  the  next 
historical  phase  of  educational  R/D&I,   the  development  position  won 
preponderant  influence,   the  terms  and  context  of  the  debate  changed, 
and  a  new  dialectic  began.  ' 
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3>     St,age  Three;    Devetopment  Emphasis  and  Bureaucratic  Mode  of 
Funding  (1964-1972) 

In  the  iTild  to^ate  '60s  and  early  '70s,  OR  on  what  one  observer 

77 

has  described  as  a  "developnient  bii^^ge" ,  If  figures  were  available 

on  all  funding  sources  and  a41  r/D6(I  activities  carried  out,  perhaps 
a  mors  balanced  picture  would  result.^  But  since  the  doiDinant  an#*most 
visible  educational  ^^/O&I  funding  was  from  OE,  and  since  0£  in  these 
years  was  actively  intervening  in  educational  R/D&I  to  create  a  whole 
new  system  under  OE  manage^ient  (which  in  effect  seerfied  to  ba  defined 
at  the  tLuie  as  the  (Aie  and  only  educational  RM>  system),  understanding 
how  macro-level(  issues  were  conceived  at  this  time  requires  focusing 
on  OS's  policies  and  the  nev  dialectic  that  eventually  ecperged  around 
these  policifes^  and  'renewed-  the  nacro-^level  debate.  '  * 

In  the  mid- '66s  ,  the  field- initiated,  laissez-faire,  research- oriented 

approach  that  had' characterized  iniich  of  CRP  funding  changed  drastically 

and  was  replaced  by  a'wholly  new  pattern.     Diy atlsfaction^  with  the  ^ 

non-cuTnulative  effect  of  CR?-funded  rftsearch,  its  lack  o€  impact  on  ^ 

educational  practice^  and  the  absence  of  discernible  school  inpra^ement 

as  a  return  on  the  taxpaye^rs*  investment  led  to  the  creation  of  the 

network  of  university-based  RcJ!)  centers,  regional  educational  l^iboratories , 

J     *  78 

and  various  other  sets  of  institutions  we  have  discrlbed  elsewhere^ 

They  were  established  as  a  network  external  to  existing  research  find 

practice  settings,   funded  and  presumably  ''mahaged**  by  OE  to  conduct  large-scale, 

mission-oriented,  programmatic  R^cD,-  focused  on  the  solution  of  specific 

educational  probl-fems. 

The  shift  from  the  laisse^-Valre,  CRP  mode  to  predominance  of  the  bureau- 
cratic mode  of  OE  management  was  gradupl^    When  the  laboratories  and 
centers  were  first  created,  each  institution  defined  its  own  mission 
based  on  the  areas  of  specialization  of  its  senior  personnel.  Over 
time,  however,  with  increasing  OE  use  of  targetted  researchr  programs 
and  procurement  through  RFPs the  locus  of  goal-setting,  priority 
determination,  and  strategy  and  policy  development  became  highly  cen- 
tralized.    The  locus  'of  initiative  and  control  shifted^to  key  OE  staff 

members,  with  some  assistance  frora  their  advisers  whom  they  selected 

'  .  79 
from  the  .research  and  R&D  comraunities. 
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Witft  the  shift  fo  a  centralized  locus  of  goal^set'ling/  there  was  a  marked 
change  in  goals  and  emphases*    There  appeared  to  be  less  arft  less  funding 
for  such  lon^-range  goals  as  development  of  the  field's  knowledge,  base , 
and  more  and  more  attention  to  the  intermediate  range  goal  of  developing 
products  and  programs  that  could  solve  current  operating  system  proble^is. 
Many  of  the  problem  areas  rece-iving  large  allocations  of  funds  (e,g., 
raising  academic  achievement  of  low- income  minority  ^udents)  were 
defined  t^y  social  and  political  forces  rather  than^by  t;he  dominant  con- 
cerns of  practitioners  at  the  time,  or  by  the  needs  of  the  field's 
knowledge  ba5e,  or  even  by  the  state  of  development  of  the  knowledge 
base  or  the  capacities  of  the  field's  personnel  and  institutional  base 
to  permit  effective  attack  on  particular  problens.    The  emphasis  in 
funding  shifted  from  research_co  development.    And  even  che  labs  and 
centers  which  initially  had  .been  given  the  freedom  to  define  their  own 
missions  and  agendas  were  given  che  message  chac  development  was  "in** 
and  the  einphasis  was  to  be  on  developing  packageable  products* 

The  prevailing  view  at  this"  time  ap)peared  to  be  that:     (a)  systematic 
R^tD  could  and  would  lead  to  school  improvement;  that  (b)  Che  fedfiral 
government  had  a  responsibility    to  define  problems  in  need  of  solution 
and  channel  these  funds  to  institutions  which  it  supported  for  the  purpose 
of  woirking  on  these  bureaucratically-def ined  problem  areas;  that  (c)  the 
^schools  would  be  reformed  from  the  outside,  largely  through  the  route 
of  providing  systematically  developed  and  tested  quality  products  to 
meet  needs  perceived  by  federal  bureaucrats  and  their  allies  in  the 

conmunity;  and  that  (d)  immediate  problems  were  so  significant  and 
pressing,  and  R&D  so  potent  an  approach  for  meeting  the  need,  that  the 
bulk  of  resources  should  be  allocated  to  develop,ment  activities  rather 
than, to  Such  longer-range  objectives  as  building  an  R^tD  community, 
strengthening  tHe  field^s  knowledge  and  technology  base,  or  developing 
personnel  or  institutional  capabilities,' 

Concern  with  developing  tRe. field's  knowledge  and  technology  base  had 
lost  center  stage  and  was  not  o^ily  slighted  but  many  of  the  funding 
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policies  anc3  strategies  of  this  period  were  even  iaimical  to  this  goal. 

Considerable  resources  wer^  allocated  to  '^putting  iato  place"  an 

institutional  structure  for  a  new  specializtid  R/D^tl  system.  Uo'^Sverj 

little  of  the  funding  vas  used  to  build  institutional  capabilities  for 

longer-term  system  development.  "  There  was  some  funding  for  research 

^  80 

training  programs,  but  this  was  discontinued  after  a  few  years. 
As  allocations  to  field- initlsited  research  programs  declined  and 
targetted  R&D  and  procurement  through  RFPs  increased,  proportionally 
less  and  less  of  available  R/DOi  resources  flowed  to  the  univers  it  ies , 
and  more  and  more  went  to  the  regional  laboratories  and  the  proliferating 

non-profit  and  for-profit  corporations  geared  to  the  marketplace  of 

8 1  ' 
federal  grants  and  contrac^ts.  The  effect  may  have  been  inimical 

to  long-term  growth  of  system  capabilities.     The  private  and 

quasi-public  (labs  and  center)  sectors  of  the  educational  R/D6tl 

system  expanded,  but  the  academic  sector  did  not  share  in  this  growth. 

.First-rate  university  research  talent  may  have  been  ^^turned  off*' 

from  working  on  educational  problems  (at  least  lunder  OE  sponsorship). 

And  equal'ly  significant,  the  training  of  new  research  or  R/D£(I  talent  ^ 

in  universities  may  have  been  adversely  affected.     Federal  funds  from 

training  fellowships  or  FV  061  grants  or  contracts  were  no  longer 

available  on  a  broad  scale  to  support  graduate  students,  and  the  ha:)ds-on 

experience  of  learning  through  Involvement  in  faculty  research  was' less 

widely  available. 

The  development  emphasis,  the  bureaucratic  m<?de  of  goal-setting  and 

strategy  development^  thie  decline  of  funding  for  field-ioitiated  research 

and  its  resultant  impact  on  universities,  and  practitioners'  dissatis-^ 

faction  with  the  whole  R/D&I  enterprise  --  all'these  factors  generated  i 

the  next  phase  of  the  ongoing  di^ilectic.     The'  AERA  called  fot  the 

resto:fhtion  of  greater  balance  in  program  plvinning  and  considered  wi^/s 

to  strcr^gthen  the  educational  research- R/DSI  community  so  that  it  could 

82 

assume  ^ln  active  role  in  ''field-based  planning/'         ^    The  National^ 
Academy  of  Education  issued  a  report  arguing  the  ca^e  for  fundamental 
^ese**^ch       ^'massive,   lasting  changes  in  education  cannot  safely  be 
made  Except  on  the  basis  of  deep  objective  inquiry," 
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And  increasing  attention  was  directed  at  ^he  finding  that  educational  %k 

84'  ^ 

practice  was  little  affected  "by  externally  developed  innovations. 

•mm 

The*  stage  was  set  for  the  next  phase  in  the  dialectic  fc^cused 
attention  on  dissemination  and  on  developing,  operating  *$3rstem  capacities 
and  the  mustering  of  forces  calling  for  a  renewal  of  fjLeld- 
initiated  research  funding.    It  Is  difficult  to  precisely 
date'the  end  of  stage  thr^ee  and  the  beginning  of  stage  *four;     the  growing 
influence  of  the  dissemination  perspective  and  the  SEA/L^EA  capacity-building 
approach  was  apparent  from  OE  prog^^Tu  support'at  least  as  early  as  1970. 
The  advoc^ates  of  field-initialed  research  funding  failed  to  score  a 
significant  victory  until  as  late -as  1977.    Stilly  1972  seems  to  be  a 
reasonable  boundary  point  between  stages  three  and  four  since  the 
establishment  of  NIE  involved  change^  of  potentially  fundamental  si*gni- 
f icance  *  ,  ^ 


Stage  Four:     NIE  and  Mixed  Strategies 

'     ^'    ^  \  ' 

A.     Significance  of  NlE's  Creation 

nib's  share  of  total  federal  funding  for  educational  r/d&I  represents 
an  even  smaller  piece  of  the  total  pie  than  OE's       when  OE  was 
the  key  spo^or  of  educational  R/D&Ij  and  even  now  after  tJIE  was 
established  to  be  the  .lead  agency  for  educational  R/D6tl,  Stilly 
the^ixcumstances  that  led  to  the  creatic^  of  NIE,  its  legislative 
mandate  to  "build  an  effective  R6cD  system'Sthe  labelling  of  NIE  as 
the  lead  agency  for  educational  R/D6tl  and  the, pivotal  role  assigned 
to  it  in  coordinating  mechanisms  that    have  been  established 
(especially  the  new  Federal  Council  on  Educational  Research  and 
Development)        all  suggest  that  btlE  is  now  the  most  critical  center 


of  macro-level  thinking  and  cert^inl^  the  most  visible  focui  of 

85  , 

pol icy    determination  for  educational  R/DScl*  \ 


The  creation  of  NIE*  as  an  R6rD  agency  apart  from  OE  was  an  iijiportant 
breakthrough  in  its  own  right  'in  the  evolution  of  the  federal  role 
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in  the  sponsorship  o£  educational  R/D&I.     It  was    imf^ortant,  first, 
because  it  suggested  recognition  o£  research  and    R&D  as  ii^stitution- 
alized  specialties  that  warranted  support  separate  and  apart  from 
operating  system  support,  ancj  that  perhaps  reqyired  different 
orientations  in  policy  formation  from  those  likely  to  dominate  ap 
agency  tied  too  closely  "to  practitioners.  (Whether  or  not  one  * 
views  this  separation  favorably  is  dependent  on  one's  perspective; 
but  clearly  the  separation  was  established, )  u** 

Second',  much  of  ttie#  initial 'support  for  NI£  came  from  leaders  of  the 
research  community  who  envisioned  NIE  as  functioning  in  much  the 
same  way  (and  with  the  sane  high  status)  as  such  prestigious  lead 
agencies  as  NSF  or  NIK.     Consequently,  they  assumed  the  be-tween 
bureaucrat  and  research  community  would    be  bridged,  the  research 
viewpoint  would  be  given-more  weight,  and  funding  would  again  be 
flowing  to  universities  and  to  researchers  to  carry  out  projects 
the  research  community  could  define  (or  at  least  willingly 
acknowledge  and  accept)  as  needed* 

* 

NIE's  creation;  then,  seemed  to" suggest  a  strengthening  of  the  federal 

commitment  to  educational  research  and  R5tD.    We  have  reviewed  the 

early  history  of  the  agency  elsewhere,  especially  its  considerable 

86 

problems  with  Congressional  critics.  What  is  important  for 

our  discussion  here  is  that  the  threatened  loss  of  federal  funding 
for  NIE  in  1974  seemed  to  raise  questions  anew  about  issues  that 
had  presumably  been  settled  -permanently  a  decade  earlier  ►  What 
'seemed  to  be  at  stake  was  not  simply  the  fate  of    an  agency  but  at 
the  same  time  the  future  of    federal  involvement  in  the  sponsorship 
of  educational  %^X^hA.    The  lack  of  political  skill  of  NXE^s  early 
leadership  may  have  Ifeen  a  factor  in  producing  the  agency's  dif- 
ficulties.    Bu^  more  ^ndamentally    what  seemed  to  be  operative  was 
the  old  dialectic  atout  \/hat J   if  anything,  c>>uld  be  gained  from 
support  o£  educational  research  or  r/D£<1,  with  skeptics  appearing 
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(brieCly)to  be  on  the  verge  of  gaining  the, upper  hand*  MlE^s 

weathering  of  that  ftjrbulent  storm  indicates  that  the  critics  o£ 

+ 

educational  K/d&I  have  receded  in  in£lu^:nce  again,  for  ai  while  at 
least,  until  the  dialectic  emerges  again  in  public  as  part,  of  the 
pol icy  process . 

B-     Contrast  Between  NIE  Emphases  and  EarlieV  OE  Etnphaa'es 

Our  impressions  of  the  contrast  between  current  NIE  emphases  ^nd 
earlier  OE  emphases  may  nee<jf  revision  after  som&  future  analyses 
are  written  of  R/dm.  policies*  of  OE  (and  other  agencies  as  well);  in 
the  '50sj  and  *60s.    But  for  the  present:,  it"  seems  useful  to  try  to  "  w 

pinpoint  some  of  the  key  differences  based  on  whatever  evidence  o#  ^ .  ^ 

^  /  ^  ( 

impressionistic  commentary  is  availablg^*  ^ 

a.    Comprehensiven'ess  and  Balance  '  *  " 

Overall,  the  main  dtf ferenc^as  appear  to  be  in  the  broader  definition 
of  R/DMj  more  comprehensive  conception  of  types  of  institut;ions  and 
personnel  comprising  the  R/dM  system  (or  conf^^r^t ion)  ^  and  greater 
.balance  in  the  funding  of  functional  specialties  ^  types  of  r/d&I 
institutions^  and  types  of  school  improvement  strategies.  \ 

•  ; 

h   .  Greater  Market  Orientation  ^ 


Compared  to  previous  periods  ^  the  NIE  approach  cippears  to  be  more  of 
a  mix  between  r/d6cI         marjcet-oriented  approaches.    Whereas  tl^e 
previous  emphases  in  federal  involvement  had  ^^^l^**        developing  the 
field's  knowledge  base  (1954-1964)  and  ??olviiQ^  edjucational 
problems  through  R^J)  and  packaging  of^solutlon  C,r964-1972)  >  the,  NIE 
orientation  appears  to    be    clearly  on  improving  practice>  w^th  * 
Vith  research  £^nd  R&D  materials  development  concieved  in  terms  of 

the  ultimate  goal  of  school  improvement:  -Research  and  R6D  still 

f  87 
receive ^a  large  share  6f  available  resources*  ^      Buf  in  the  NIE 


^trabegy,  dis^miaatioa,  impLementation/uti^Lizationj  and  building 
internal  operating  system  capabilities  receive  considerable 
atte^ition  as  well. 

c.       Inc lus ion^'of  Operating  Sygf^  in  R/D&I  Support  '  ^ 

NIE  dissemination  and  SEA  and  LEA  capacity-building  programs  also 
suggest  a  mix  of  decentral42ed  and  centralized  initiatives*  One 
aspect  of  this  mix  is  the  attention  given  to  SEAs  and  (to  a  lesser 
extent)  LEAs*  ^  -  '  ^ 

While  considerable  suras  of  money  flowed  from  OE  to  the  operating 

system  during  the  1964-1972  period,  these  were, generally  funds  for 

*direct  program  d¥>erations  and  services  rather  than  for  R/Ditl.  And 

-  vhat^R/D6iI  funds  did  go  to  the  operating  system  tended  to  be  largely 

for  demonstration  projects,  i.e. >  the  support  of  exemplary  practices 

or  programs  throuth  funding  provided  under  ESKA  Titles  I  and  III^  the 

Bilingual  Program,  the  Drop-Out  Prevention  Program,  etc*    OE  con- 

tinues  to  support  this  **exemplary  practice*'  approach  to  school  im-- 

provement*    What  seems  significant  about  the  earlier  period  is  that 

OE  apparent^ly  distinguished  between  the  ^"exemplary  practice  model"^ 

88 

«nd  the  *'RM)  model'^         and  most  (if  not  all)  of  what  OE  Conceived 
as  its  JI/D6cI  funding  was  then  concentrated  on  the  labs^  centers,  and 
other  specialized  institutnon^  established  by  OE  to  function  outside 
the  operating  system* 

NlE's  orientation,  on  the  other  hand,  appears  to  be  to  see  sEas  and 
LEAs  as^potential  sites  for  R/d&I  activity*    With  regard  to  such^ 
activities  NIE  pttigram  documents  describe  the  federal  role  as  on^  of 
facilit^ttng,  <!^llaborating^  and  coordinating,  with  much  of  the 
initiative  in  setting  and  problem  definition  decentralized  in  . 

S^As  and  LEAs.     SutJSt^ntial  sums  are  flowing  to  these  SEAs  and  LEAs  ' 
^ 'to  supporT;  capacity-building  programs  that  meet  needs  ,  identified 

and  defined  by  the  SEAs  and. LEAs  and'  fund  capacity-building  activities 

89     '  ' 
^proposed  by  them*  The  increasing  attention  given  to  these 
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SEA-  and  LEA-defined  capability-developing  prograins  appears  to  be 
part  of  a  discernible  shift  in  emphasis  from  produtt  development 
and  pfoduct  advocacy  to  change  process  advocacy  ^dVihange  process 
capability  development. 


d,    .  NIE-Directed  vs ,  Field  Initiated  Modes 

w  ,  ' 

Stillj  though,  despite  some  signs  of  increased  market  orientation  and 

greater  decentralization  of  initiative  to  the  operating  system,  the 

older^  bureaucratic  mode  of  goal-sett ing,  strategy  development,  and 

procurement  appears  to  prevail  (to  a  greater  or  lesser  degree  in  ^ 

differeyit  program  are^s)  in  the  agency's  funding  of  research  and  R&D. 

The  locus  of  goal-setting,  priority  determination,  strategy  develop'^ 

m'ent ,  etc^as    remained  largely  centralized  in  the  hands  of  NIE 

s^taff  and  treir  selected  advisers  from  the  field>  with  resultant 

continued  dissatisfaction  in  the  research-R/D&I  community  about 

NIE 's  emphases  in  R/D&I  Sponsorship  and  the  procedures  used  to  t)ro- 

cure  the  work  it  supports.    NIE 's '^program  and  most  of  its  funding  is 

focused  on  six  "priority  areas''  selected  by  NIE's  staff  and  policy-making 

body  (the  National  Council  on    Educational  Research,  NCER)  as  the  most 

pressing  problems  the  R/d&I  system  could  and  should  respond  to  with  the 

greatest  concentfatiori  of  available  resources  possible.    The  pr'evailing 

procurement  approaches  used  have  involved  either  i^)  channeling  larger 

sums  to  labSj  centers^  anS  other  specific  institutions  with  a  "special^ 

relationship"  to  NIE,  or  (b)  issuing  RFP  s    drafted  by  agency  staff  and, 

consultants,  some  of^' which  have  involved  tight  specification  of 

research  questions^  research  design,  instrumentation,  occasionally 

91 

even    data  analysts  techniques^  Unsolicited  field-initiated 

research  has  received  relatively  little  support.    Consequent ly^  the 
research^R/D6cI  community,  who  feel  they  are  in  the  best  position  to  ^ 
determine  what  problems  need  tackling  and  how  best  to  tackle  them^ 
has  foftnd  itself  le^t  with  little  if  any  support  for  the  kind  of  work  it 
would  like  to  do  and\treated  as  mere  technicians  to  carry  out  work 
designed  by  others,  much  of  which  researchers  have  criticized  as 
ill-conceived.  ^  ,  ^ 
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NIE  has  been  sensitive  to  nuch  of  the  criticism  it  has  recoived  from 
the  field  aad  a  number  o£  initiatives  have  been  taken  to  meet  the  concerns 
of  "the  research  cormiunity.     for  instance^  researchers  from  a  few  research" 
.  areas  were  involved  in  the  definijtion  of  research  ag^endas  for  their 

fields  (e.g.,  in  conferences  sponsored  by  what  wert2  then  called  the 

^  jii  92  - 

»aslc  Studira^and  Basic  Skills  groups  of  ).  .Also,  some  of  "the 

recent  grants  competitions  have  defined  only  the  areas  of  research  KIE 

wa;s  interested  in  supporting  without  specifying  particulars  of  the  * 

research  to  be  carried  out.  In  addltion>  ^^lE  concern  about  the 

field's  dissatisfaction  led  do  the  agency '  s  ,  commissioning  ^.our  policy 


analy^s  on  the  proper  balance  between,  field-initiated  and  NIE-dlrected 

94 

R^tD  and  a  second  analysis  by  the  National  Academy  of  Sciences  on 

the  adequacy  of  federal  policies  In  supDort  of  fundamental  research 

S5*  "  '  * 

relevant  to  education.- 
c        .  , 

The  outcome  of  NIE's  internal  policy    debate  on  funding  field-Initiated 

research  is  a  good  illustration  of  the  continuing  dialectic  in  the 

policy  proc^ssj  and  the  fact  , that  those  defeated  In  one  set  of  battles 

are  likely  to^^coJitinue  the  fight  and  try  to  muster  sufficient  support 

until  ultimately  their  view  ptevalls>  and  the  dialectic  begins  again j 

albeit  with  the  tables  turned  and  a  reversal  of  "Ins^  and  ''outs'*. 

Despite  the  contrary  positions  taken  In  two  policy  analyses  com- 

missioned  by  NIE>  the  NCER  passed  a  policy  resolutl(Dn  In  1977  c'alling 

for  allocation  by  I979  of  at  least  207*  of  NIE*s  funds  for  the  support 

of  fundamental  research  relevartt  to  education  (with  an  Increase  to  at 

least  30%  by  1985) ^  with  at  least  half  of  these. funds  to  be  allocated 

in  the"  form  of  research  grants  to  Individual  investigators  ox  small 
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groups  of  investigators  (I.e.  ^  the  old  field-initiated  mode.) 
Whether  this  resolution  leads  to  significant  changes  In  the  kinds  of' 
work  supported,  or  siinply  a  r<2-labelllng  of  work  that  would  otherwise 
be  fundedj  remains  tfo  be  seen.     But  the  stand  expressed  In  tlie  resolu- 
tion  is  Important  in  its  ojm  right  as  ^statement  of  the  proper 
emphasis  to  be  given  to  fundamental  research.     It  was  significant  Uoo 
for  reaffii^ming  the  principle  of  maxlnmm  possible  Involvement  of  the 
rese-irch  community  in  "identifying  research  ne^^ds  and  research  to  be 
supported.'^  '  * 
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{s  yet,  though,  tKe  research  and         connnunities  hav«  not  had  anything 

like  the  influence  of  researchers  in  some  of  the  scientific  disciplines. 

There  have  been  increasing  numbers  of  calls  for  a  strengthening  of  the 

^     research  and  R&D  communities,  and  -Che  development  of  mechanisms  to 

permit  the  field  to  exercise  leadership  in  defining  goals  and  research 
97  ' 

agendas.  We  may,  then,   in  time  see  yet  another  metamorphosis 

of  goal  setting  and  policy  jfarmation  in  educational  R/p&l,  with  signi- 
'  ficant  implications  for  R/D6il' priorities ,  strategies^  and  funding 
programs ,  ^  ^  ' 

e.    Lead  Agency  Role' 


Prior  to  the  creation  of  15IE,  OE  was  clearly  the  lead  agency  for 

educational  R£tD  as  well  as  the  education  sector  as  a  whole.  NIE's 

> 

position  as  lead  agency  for  educational  RM)  is  more  complex  to  carry 
out  given  the  current  context  in  which  it  functions;     (a)    Despite  its 
lead  agency  status,  NIE  controls  a  relatively  small  piece  of  the  total 
federal  budget  for  educational  R/D&I;  it  controls  fewer  R/D&I  dollars 
thaa  even  OE  whose  primary  mission  focuses  on  the  operating  system 
rather  than  R^,    And^^(^bi  given  the  more  comprehensive  concept  of^ 
R/D6tli  and  the  greater  nut3ber*of  institutions  and  even  institutional** 
types  included  in  the  broader  current  conception  of  R/D6tX,  a  considerably 
greater  number  of  considerations  must  Jnter  into  functioning  as  a  lead 
agency* 


*  * 

-  How  does  one  coordinate  a  system  made  up  of  so 

many  autonomous  actors? 

-  How  can  NIE  best  exercise  its  leadership  role  given 
the  'small  proportion    of  total  educat i'&rra^  r/d&I 
resources  it  controls?  * 

-  How  can    available  resources  by  properly  apportioned 

o 

across  all  the  various  improvement  strategies 
'(e*g*,  external  vs-  internal),  functional  specialties, 
performer.,  institutions,  etc*  now  conceived  as  essential 
parts  of  the  educational  R/D&I  enterprise  without 
dispersing  resources  too  thinly  to  permit  effective 
functioning, quality  outputs^  and  significant  impact? 
'  Are  there  ways  of  using  available  resources  efficiently 
and  econoitiical ly  to  achieve  multiple  purposes  and  to 
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permit  NIE  to  effectively  exorcise  its  lead  agency 

98 

role  despite  its^limited  cont?^ol  of^  resources? 
And  if  so,  how  does  an  agency  learn  to  function  in 
such  coTTiplQX  ways? 


The  Current  Dialectic 

The  current  dialectic  seems  to  us*to  center  on  several  ,ia^^^es^ 
particularly:  # 

^      *  -,the  manner  In  which  NIE  is  to  .carry  out  its 

responsibilities  as  lead  agency  £or  educational  - 

-  Che  degred  of  leadership  to  be  .exercised  by  the  field; 

-  the  extent, to  which  higher  levels  of  funding  caa 
be  channelled  to  the  operating  system  for  internal 
improvement  strategies  and  the  extent  to  which  - 
Rj£tD  can  become  more  market-oriented; 

-  the  proper  funding  balance  across^  func  tional 
.    3pec  i^I ties ;  ^  .  / 

-  the  extent  to  which  NIE  should  Cake  a  more  active 
role  in  system-building  and  capacity  "development ;  and 

-  whether  the  mosC  effective  route  to  building  system 

'   capacity  Is  to  return  to  the  field-initiated/laissez-falre 
mode,  or  instead  t&  more  actively  solicit  work  from 
fir3t-rate  r/D^I  performers  with  whom  KIE  can  develop 
"special  relationships/'  or,  .rathei  than  either  of  these 
alternatives  J  to  contimue^the  current  heavy  emphasis 
by  means  of  open  competition  in  response  to  RFPs * 
t 

*The  irlore  active  the  stance  NIE  take^  on  these  issues,  the  great;^  will 
be  its  need  for  various  kinds  of  data  to  inform  the  processes  of 
goal-setting,  priority  de  temttinaCion,  and  strategy. and  policy  deter- 
mination.     But  whatever  the  position  t^ken  by  NIE,  the  educational  1 
R/D^I  enterprise  as  a  whole  would  seem  t;o  require  more  Information 
about  itself,  its  capacities,  and  its  readiness  to  successfully 
untfertake  alternative  courses  that  might  be  taken,  ^ 


We  recognize'j  of  cours^e,  that  one's  orientation  on  most  of  these  t 
key  issues  is  likely  to  be  determined  by  value  poisitions  that  are 
relatively  immune  Co  influence^  and  especially  unlikely  to'  be 
swayed  by  daca.     Stilly  regardless  of  the  goals  and  strategies 
decided  on,  choices^  on  (at  the  very  least)  tactics  and  specific 
programming  rcay  be<  facilitated  and  perhaps  even  affe^cted  ty  several 
kinds  of  data*     Before  concluding  this  chapter,  we  briefly  consider 
these  data  needs. 
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IV.     DATA  tfeEDS,  .TO  INFOR.M  DECISION  MAKING 

■4 

Several  pieces  in  the  literature  refer  to  various  kinds  o£  data  needed  to 

identify  R^D  priorities  and  objectives  and  E>lan  effective  short-term  and 
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long-term  R/D&I  pr<?grainming ,  At  the  ver)^^least>  It  would  seem,  the 

following  types  of  data  need  to*  be  available  on  an  ongoing  basts  to  inform 
decision  'making:  '  V 

1  •  '  Data  on  needs  *  - 

A*     Information  for  assessing  the  gap  between  (a)  operating  ^ 
system  performance  and  (b)  its  stafed  objectives ,  or 
e:^pectations  for  operating  system  performance  as  expressed 
by  practiuioners »  policymakers,  parents,'  etc - 
B»    Perceived  needs,  as  defined  by  practitioners >  parents> 
policy  makers,  etc. 
'  Analyses  of  current  social  needs,  demands ^  and  con- 

ditioner to  permit  assessments  of  the  relevance  and 
effectiveness  of  the  operating 'system  as  currently 
functioning. 
2,     Data  on  Possibilities 

A.  Analyses  of  alternative  futures  fo,r  ^iioth  education  and 
society^  and  the  implications  for  both  the  operating 
system  and  the  R/d^I  system, 

B.  Data  on  supply  of  R/D6tl  system  outputs  vs  •  demand  for 
such  outputs,  with  imputations  for  bringing  the  two 
into  better  balance  (e.g,,  ways  to  stimulate  demand). 

C.  Analyses  of  available  technology,  research  findings, 
new  conceptions  from  int^^try,  etc.  that  might  have  ^ 
far-reaching  long-range  implications  i£  they  coul^  be 
effectively  applied  to  the  educational  context- 

3*  Data  6n  system  capacities  in  relation  to  requirements  fo;r 
system-building  and/or  requirements  for  effective  conduct 
of  specific  kinds  of  r/d^I  work- 

A,     State  of  the  art  in  relevant  discipline's,  research  areas  > 
development  areas ,  technologies ,  methodologies ,  etc* 
^  B,    Personnel  base:     types  of  personnel  available,  located 
ll  whereCby  institutions,  geographic  distribution,  etc). 
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with  what  typ^s  of  competGncieSi  developed  to  uhat  lev^l 
of  con^petencej  functioning  at  what  level  of  productivity; 
T^tQ  of  expansion  of  different  segments  of  the  personnel 
base  in  relation  to  different  funding  initiatives,  etc< 
Institutional  base:     numbers  and  types  of  ins titutions  j. 
located  where,  carrying  out  what  kinds  of  R/D5tl  activity, 
of^hat  qtjality,  with  what  levels  of  productivityj  etc< 

NIE's  Education    KCPU  Monitoring  Program  has  already  begun  to  collecC 
daca  on  the  organizational  base  of  che  field.     In  timej  we  would  hope 
-to  see  this  program  expanded  to  comprehensively  cover  all  these  various 
data  needs,  and  to  see  indications  thac  such  daca  are  being  used  to' 
inform  decision  processes. 
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V 


CONgUSIOMS 

Educational  R;0&I  has  been  criticized  repeatedly  tor  weaknesses  in 
goal'settingj  priority  detennii^at ion ,  policy  £ormation,  and  scirategy 
developmenc . 

On  the  most  general  level,  the  goals  of  federal  policy  for  the  system  , 
have  been  reasonably  consistent  since  the  federal  funding  of  edutrational 
research  (and  then  R^)  began  in  the  md''50s.     Using  the  current  ^formu- 
lation of  these  goals  (from  the  legislation  chat  created  NIE) >  these 
goals  have  been:     to  so Ive  educational  .problems ;  to  improve  educational 
practice;  to  develop  the  knowledge  and  technology  base  needed  for  these 
eff6rts;  and  to  build  an  effective  R&D  systen. 

However,  when  analysis  proceeds  beyond  goal  statements  to  specific  ^ 
policies^  programs^  and  activities  of  federal  agencies  (especially  OE 
and  NIE) >  and  when  special  note  is  taken  of  Relative  emphases  in  budget 
allocations  J  the^picture  thaj  emerges  is  one  of  marked  dijiconinuity^ 
shifting  goals  and  priorities^  and  policies  and  strategies  that  have  not 
-been  entirely  consistent  with  some  of  the  system's  goals.    There  appears 
now  to  be  greater  balance  in  the  strategies  pursued  by  NIE;  however, 
ic  *is  still  poo  early  to  see  how  NIE  will  carry  out  its  responsibilities  ^ 
as  lead  agency  for  educational  R/D&l.    The  implications  of  how  this  issue 
is  resolved  are  likely  to  be  significant. 

What  has  been  lacking  until  recently  has  been  adequate  translation  of 

broad  goal  statements^'  into  intermediate  goals  and  objectives  specific 

enough  to  guide  priority  deteraination^  policy  formation^  and  strategy 

development        and  specific  enough  to  serve  as' benchmarks .  for  nieasuring 
.      4  101 

.systec  perrorrTiance.  * 
+  ^ 

Also  iacking  Kave  been  mechanisms  to, develop  consensus  on  specific  system 
goal$j  priorities^  policies,  and  strategies  among  the  various  constituencies 
affected.    Determination  of  educational  R/D&I  goals^  priorities^  policies/ 
irfid"  strategies  is  clearly  a  highly  political  process.     It. involves  critical 


choices  about         available  resources  will  bye  used,  to  what  ends,  and  by 
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whom.    Therefore^  dl?Verse  interests  clash  here      (researchers,  R&D  personnel 

with  A^arious  functional  specialties,  , practitioners ,  federal  bureaucrats. 

Congress)      for  the  choices  that  are  made' determine ,  in  a  significant  way^ 

who  wins  and  loses       "^'hich  Institutions  will  receive  funding,  which 

f 

research  areas  will  be  supportedj  what  kinds  of  personnel  will  be  hiredj 

* 

etc.    Consensus,  thenj  may  never  be-achievable.     Stillj  if  consensus- 
developing  mechanisms  were  available,  key  polity  debates  might  be  carried 
out  'v^th  the  active  involvement  of  the  princ ip.al  *interes ts ,   in  a  forum 
that  f ac il it ated' bargai ning ,  coalition  formation,  and  perhaps  greater 
balance  in  the  choices  ultimately  i!fSde.    Of  course,  open  debate,  bar-  ^ 
gaining  and  balance  may  or  may  not  be  cohsideredf  desirable  depending 
on  orte^s  Values  and  one*s  current  status.     But  it  certainly  would  facilitate 
the  emergence  of  a  strong  constituency  for  educational  r/d^I. 

There  have  been  huinerous  analyses  in  recent  years  which  have  pointed  out 

the  need  for  consti'tuency  building  to  increase 'support  for  educational 
102 

research  and  R5tD*  Many^  of  the  funding  problems  encountered  by 

educational  K/d&I  have  been  traced  to  the  lack -of  a  constituency  to  push 
for  R/D£(I  funding        the  lack  of  an  adequately  organized  research  or 
constituency,  and  the  absence  of  practitioner  demand  for  the  outputs  of 

In  contrast  to  this  view,  Dershi:ner  has  suggested  ij)  his  history  of 
federal  sponsorship  of  educational  ^R6tD  in  the  '6O3  that  tsteinking  in  tenos^ 
of  political  constituencies  pushing  for  RSJ)  is  a  faulty  conception  for 
und'erstanding  what  happened  in  Washinfton  in  Che  '60s.    As  he  described 
federal  policy  development  for  education  R£J>  during  the  '60rsj  a  small 
number  of  bureaucratSj  with  the  support  of  a  small'nuriber  of  allies  in 
Congress  and  in  the  research  community,  were  able^  to  push  throygh  Chein 
ideas  without  relating  to  any  external  constituency  and  without  resorting 
to  pressure  pplitics  as  this  has^  been  tradit^nally  understood.  ^  But  -of 
course  the  isolation  of  policy  impetus  froffi  the  principal  itjterests 
affected    may  explain  why  educational  K/d&I  has  been  operating  without  a 
constituency'(of  practitioners,  researchers,  or  r/D^I  personnel)   --  ancf^ 
has  enocuntered  so  much  political  difficulty.  ,  , 

* 
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We  have  focused         actentton  in  this  chapter  on  the  key  macro-level 
issues,  at  the  center  of  the  dialectic  over  educational  R/D6il  for  the  past 
two  decades  or  so,     We  have  notedj   too,  that  historically  there  has  been 
a  close  relationship  between    the  dominant  goals  and  priorities,  on  the 
one  handj  and  the  primary  locus  of  goal-setting  and  priority  detenninationj 
on  the  other.     Inevitably,  th^  dialectic  will  continue/  Such  a  dialectic 
may  be  Inherent  in  the  nature  of  a  field  such  as  education,  which  is 
value-laden,  substantial-ly  fragmented,  and  lacks  success  models  that  are 
so  overwhelmingly  persuasive  that  other  approac\ies  are  no  longer  put 
forward.     But  the  continuing  dialectic  need  not  produce  the  sharp  dis- 
continuities in  functioning  evidenced  in  the  history  of  educational  ar/Oitl 
over  the  past  two  decades.    Consensus-building  mechanisms  may,  then,  be 
a  high  priority  systen  need,  to  provide  the  degree  of  stability  and 
continuity  required  for  further  system  niaturation. 
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cational Research  and  Development,"  op^  ci t,  ;  and  Office  of 

■  Education,  Educational  Research  and  Development  in  the  United 

^  States,  op^  cit, 

33*      For  instance,  see;         A*  Aver<^  et  al*  >  'How  Effective  is 

Schooling?   ^nglewood  Cliffs,  New  Jersey:    Educational  Tech- 
nology Pres^l974);    and  J*       Stephens,  The  Process  of  Schooling 
■  (New  York:    Holt;  Rinehart  &  Winston,  1967). 
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Research  for  Tomorrow's  Schools  (New  York:    Macmillan,  Pl969) ; 
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CounciL,  Sara  B.'  Keisle*  and  Charles  F,  Turner,  eds  *  (Washington: 
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Office  of  Education^  Educational  Res^ar^h  and  XifiVfclofimei^t  ii^  the 
United  States,  op.  clTT  V  '  K  "  ^ 

35,      This  may,  of  coMtse,  be  a  statement  iitMaith^         should  be 
noted,  though,  th^t  the  bulk  of  the  c^rriculLmlnef  teacher- 
tracing  institutions  and  sta^a  cert4£t'CaE:;i^>a' t^^^^iretnents  f<^ 
teachers,  administrators,  and  other  schoo^praf^'Ssionals  retlect 
this  assumption.  > 

'36,      For  instance,  see;    Cronbach  and  Suppes,  Research  for  Tomorrow's 
Schools,  op.  c^t> 

37.  For  elaboration-  of  this  argument,  see  our  chapter  on  educational 
development* 

38.  For  examples,  see  the  section  ori  exe:np,lary  products  in  our  chapter 
on  educational  R/T)6tl  outputs  ^  oiT  see  National  Institute  of  Educa- 
tion, 1976  Databoolc,  op.  <^it  > 

39.  See  discussions  of  this  in  our  chapters  on  the  history  of  educa- 
tional R7D£cI  and  educational  R/D6tl  outputs, 

40.  For  an  excellent  analysis  of  teaching  as  a  semirprofession  and 

"    -  the  impact  of  this  status  on  practitioners,  see  Sieber,  '^Organi- 

zational  Influences  on  Innovative  Roles,"  op.  cit.  f 

41.  See  our  chapter  on  implementation/utilization  of  educational 
R/D£iI.  ■  .  '  , 

42.  Cohen,  Ideas  and  Action:^  Social  Science  and  Craft  in  ^Educational 
■    Practice^  Qp.  cit>  * 

^         43.      Gideonse,  "Policy  Framework  for  Educational  Research,"  cfp.  cit* 
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46,      See  out  chapter  on  educational  R/D6tt  funding, 

47*      Campbell  et  al,  ,  R6cD  Funding  Policies  of  the  National  Institute 
of  Education,  op >  cit. ;  Radnor,  Spivak^  Hofler,  and  Young, 
Agency/Field  Relationships  in  the  Educational  R/D6tl  System^ 
#       X)P.  cit.  ^  ' 
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.  the  Educational  R/D&I  System^  op.  cit. 
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"^ne  "e:<ceptipn  here  is  the  piecG  by  Clark>  '^Federal  Policy  i^i 
Educational  Research  and  Development,"  op>  cit.  in  vhic!^  ho 
suggested  as  a  possibility  a  national  conference  board  '*to 
/    formulate  a  national  policy  and  action  platform  for  educational 
R6tD**  slmilai:  to  the  work       done  in  mobilizi^ig  school  support 
ort  the  state  level  by  the  New  York  State  ,£ducatioQal  Conference 
Board  as  described  in  Stephen       Bailey,  Frosty  P.  E, 

'   .  MaaTch^  and  R.  C*  Wood,  SchoolTaen  and  Politics  (Kew  York: 
Syracuse  University  Press,  1962), 
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practitioners  made  fck  the  OE  status  report  as  reported  in 
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Research  ^nd  DejpIoPment  in  the  United' States^  op.  cit.  and 
also  in  Office  of  Education,  Educational  Research  and  Develojp- 
oentt^n  the  United.  States ,  op>  cit.    Suryeys  of  practitioners 

had  D^en  included,  in  aorae  of  the.  planning  documents  of  NIE*s  ^ 
Dissemination  and  Resources  GrOup^  ^ut  as  yet>  to  our  knowledge^ 
no  such  surveys  Kave.  been  undl'ertajcen.    The  annual  Gallup  polls 
on  education,  or  some  siEjiilar  r^ularly  con<}^5fed  pollj-jjight 
.  be  used  as  a*  mechanism  ^  for  surveyings  public  opinion  oa  relevant, 
issues.  '  / 

52.  There  have^  of  course^  at  times  been  exceptions  to  this^ 
the  establishment  of  the  regional  laboratory  program  in  the 
mld-*60s^  the  recent  return  to  Congre^ioAal  interest  in  regional 
programs  for  education^  NIE*s  current  planning  toward  regionally 

'organized  RDx  CR£J)  exchange)  program^  NIE*s  support  for  programs 
to  develop  disserjiination  capacities  in  SEAs  and  local  problem* 
solving  capacities  in  LEAs. 

/  •    ^  ' 

53*      For  instance^  Detshimer's  call  for  more  **f ield-based  planning**  . 
in  Richard  Dershimferi  ed.  >    The  Educational  Research  Community: 
Its  Communication  and  Social  Structure  (Washington:  American 
Educational  Research-Association^  1970) , -ERIC  ED  057  275,  and 
the  thrust  of  this  volume       ^  whole* 


54.      Corvin,  ''Beyond  Bureaucracy  in  Educational  Research  Management,*' 


55.      For  an  analysis  of.  agency  bureaucrats  as  ^^technocrats*'  see 

Dershimer,  T>\e  Federal  Government  and  Educational  RM)^  op>  cit, 

'56,      Gidepnse^  "Research  and  Development  for  Edu^^atiom    A  Market 
Kpdel/'  op>  cit.    We  describe  this  model  earlier  in  this 
chdpter  in  section  1.4. 
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57*      Sieber,  "Federal  Support  Mr-Resear^  aad.Developcient  ia  Educa- 
tiort  arid  Its  Efrects/'  op>  cit\ 

58.  See:    De/akim^^  The  Federal  Gfivarnmeat:  and  Educatioaal  R6tD,  - 
.op>  elt  >  ;a^,  (STTba  aad  Clark,, The  Coa£iauratl<iaal  Perspective, 
op  /  cit . 

59.  Corwittj  "Beyoad  Bureaucracy  ia  Educati^aal  Research  Maaagemeat/' 
op,  cit> 

60.  This"  was,  for  iastancej  the  maia  afgumeat  agaiast  the  CRP  pattera 
\  of  fuadiog  aad  a  key  elemeat  ia  tKe  argumeat  for  programmatic 

\         RM)  aad  the  creation  of  the  labs  aad  ceaters,  ^ 

*  \  ■ 

61.  Gideoasej  ^*Research  aad  Development  for  Educatioa:    A  Market 

Model,'*  op.  cit. 

62.  For  a  good  descriptioa  of  the  field  service  traditioa  aad  how 
dt  differs  froci  the 'rM)  coaceptioa,  ?ee  Sieber,  "Federal  Support 
for  Research  aad  Developmeat  ia  Educatioa  aad  Its  Effects/* 

op>  cit>  . 

63.  For  aa  elaboratioa  of  these  political  reform  strategies  aad 
their  uaderlyiag  assumptioas ,  see  Harriet  Spivak,  School  Decea- 
tralizatioa  aad  Comnuaity  Coatrol :    Policy  ia  Search  of  a-^ 
Research  Ageada  (New  York;    Ceater  for  Urbaa  Educatioaj  1973) , 
available  from  Harvard^ Graduate  School  of  Educatioa  as  Special 
Qualifyiag  Paper  Submitted  by  Harriet  Spivak, 

64.  For  citatioas  aad  an  elaboratioa  of  these  various  aaalyses  of 
schools  as  iastitutioa$  aad  teachlag  as  a  professioa,  ^ee  our 
chapter  oa  Iciplemeatatlon/utllizatioa  of  educational  r/d^cI, 

65*'  Radaor^  Splvak,  Hofler,  and  Youag,  AgeacyrField  Relationships 
ia  the  Educational  R/D£tl  System,  op,  cit , 

.66^      Ibid.  ^  especially  pa^  poiat  (d) . 

67.      Ibid . ,  see  especially  C.  W.  Sherwia  aad  R,  S-  Iseasoa,  Fiirst 
Interim  Report  on  Project  Hlrtdslght,  June  30,  1966,    No,>  AD 
642-4t)0,  Clearinghouse  for  Federal  Scientific  and  Technical 
Informationj  Springfield,  Virginia* 

68*      For  instancej  see    Launor  F-  Carter,  From  Research  to  Develop- 
■  ment  to  Ij^e  (Santa  Monica,  Calif. ;    System  Development  Corp., 
,1966),  gRiC  ED  026  741, 

69.      See  section  11.4. 
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70.  Radnor,  Spivak,  Hofler,  ^rxdwYourxg,  Ageacy-Field  RelatioViships 
la  she  Educational  R/D6I  System,  op.  cit- 

*- 

71,  Clark,  "Federal  Policy  in  Educational  Reseairch  and  Deve lopmer\t',\' 
op cit ,  '  \^ 

^. 

72.  For  instance,  see  Cronbach  and  Suppes/  Research  £or  Tomorrow/' s 
SchooLs ,  op.  cit.  >  Chapter  11  (by  Lawrenoe  Cremin)  ;  also, 
D&rshimero  The  Federal  Government  and  Educational  R6D,  op.  cit* 

73,  On  the  field  service  tradition,  see  Sieber,  ^'Federal  Support  fdr 
Research  and  Development  and  Its  Effects, op.  c It .  ;  Sam  D. 
Sieber  and  Paul  Lazarsfeld,  The  Organization  of  Educational 
Research  in  the  United  States    New  York:    Bureau  of  Applied* Social 
Research,  Columbia  University,  1966.  ^ 

74^      Dershicier,  The  Federal  Government  and  Educational  RcJ)>  op.  cit/ 

75.  Ibid. 

76.  See  our  discuss^ns  of  this  in  our  chapters  on  the  history  of 
educational  R/D6I  outputs,  and  especially  the  development  function, 

77.  Sieber,  "Federal  Support  for  Research  and  Development  and  Its 
Effects,"  op,  cit^ 

78.  See  our  chapter  on  the  history  of  educational  R/D6I- and  especially 
ouc  chapter  on  educational  R/D^I  institutions." 

79.  Dershimer,  The  Federal  Government  ^nd  Educational  R&D^  op.  cit^; 
and  Corwin,  "Beyond  Bureaucracy  in  Educational  Research  Manage-Ki 
raent,"  op.  cit. 

80.  See  our  chapiter*  on  the  personnel 'base  of  educational  R/DW  ♦ 

81.  Tucker  et  al.  ,  Building  Capacity  for  Renewal  and  Reform,  op.  c  it .  ; 
NIE,  1976  Databook.  op.  cit.;  Albert  D.  Biderman  and  Laure  M.  ^ 
Sharp,  The  Competitive  Evaluation  Research  Industry  (Washington: 
Bureau  of  Social  Science  Research,  Inc.,  1972)  ;and  Ilene  N. 
Bernstein  and  Howard  E,  Freeman,  Academic  and  Entrepreneurial 
Research;    The  Consequences  of  Diversity 'in  Federal  Evaluation 
Studies  (Hew*York:    Russell  Sage  Foundation,  1975). 

82.  Dershimer  (e^!.),  The  Educational  Research  Community;     Its  Communi-  ^ 
cation  and  Social  Structure^  op.  cit. 

83.  Cronbach  and  Suppes,  Research  for  Tomorrow's  Schools,  op.  cit, 

84.  Fory  instance,  see      John  I.  Good  lad  et  al. ,  Looking  Behind  the 
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Classrooni  Door  (Worthingtorij  Ohio:    C,  A,  Jones,  1970);  and  / 
Se>'zioijr.  B.  Sarason,  The  Culture  of  t:he  School  and  the  Problem 
'o£  Change  (Boston;    Allyn  and  Bacon,  1971). 

It  should  be  borne  in  mindj  of  course,  that  NIE  is  only  qne  of 
many  sponsors  of  educational  r/d&I  activity.    If  one  Is  oriented 
toward  the  configuratlonal  perspecfiive,  or  if  one  views  notions 
^bout  system  management  or  other  types  of  ciacro-level  thinking 
as  sheer  foolishness  (or  worse),  then  the  aission.  definitions , 
objectives,  etc.     of  all  other  sponsors  and  performer  institi^tlons 
may  be  seen  as  equally  important  centers  of  influence  for  shaping 
the  realities  of  educational  r/d&I.    And  certainly  regardless  of 
one's  perspective  on  this  matter j  it  would  seem  important  for  us  * 
to  have  this  kind  of , information  from  these  various  pther  agencies 
and  institutionSj  to  permit  us  to  develop  a  sense  of  the  whole 
that  may  be  more  or  less  susceptible  to  coordination  or  manage- 
ment.   Howeverj  ve  have  come  across  relatively  little  in  the 
published  literature  that  is  helpful  for  developing  a  clear 
picture  fof  the  goals,  priorities,  policies,  or  strategies  of 
these  o^her  agencies  or  institutions.    There  is^  on  the  other 
hand,  a  sizeable  literature  on  NlE's  approaches  and  we  are 
familiar  with  much  of  this.    We  therefore  focus  our  attention 
on?>JlE  al^e  for  the  retnainder  of  this  discussion.  Although 
we  acknowledge  the  limited  focus  of  this  discussion,  we  are 
not  overly  troubled  by  it.     If  one  is  willing  to  give  any  sub- 
stance to  the  '^lead  agency''  mandate,  then  NiE's  positions  and 
strategies  must  be  considered  to  be  of  substantial  consequence 
for  the  educational  r/d&X  enterprise  as  a  whole. 

See  our  chapter  on  the  historical  development  of  the  educational 
r/d&I  system.  ,  S 


See  our  chapter  on  educational  r/d&I  funding  for  details. 

Ward  S.  Mason,  "Issues  Related  to  the  Transfer  of  the  Rj£tD  Center 
and  Educational  Laboratory  Programs  to  the  National  Institute  of 
Education, Internal  Memorandumj  National  Center  for  Educational 
Research  and  Development,  Office  of  Education,  July  17,  1972, 

See:    NIE,  1976  l^atabook,  op.  cit>;  also  NIE  do^:uments  for  1976 

and  subsequent  years  entitled  FY  Program  Budaet  or  Fiscal 

Year         :    Program  Plans.    Executive  SummSrV;  ^ see  especially 
NIE.  Preliminary  Program  Plans  FY    78  (Washington:    NIE,  July 
1979)  and  NIE>  Dissemination  and  Resources  Group,  Program  Plan 
FY  1978  (Washington:    NIEj  August  1976).    It  should  be  noted 
that  OE  was  funding  such  programs  at  least  as  early  as  1970. 

William  J.  Paisley  et  al,.  Recommendations  for  J^he  Dissemination 
and  Utilization  Program  of  the  National  Institute  of  Education^ 
Report  of  the  Research  Advisory  Committee  on  Change  Processes 
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in  Education  (Washington;    National  Center  for  Edut^^tional 
Cor^jBunicatioi;^,  Office  of  Education,  1972),  ERIC  ED  088  412.^  - 

91.  See  our  chapter  on  funding  for  a  discussion  of  the  pros  and 
cons  of  procurement  through  RFPs ► 

92.  i;atricla  E".  Stivers,  "Researchers  at  NIE :    frbm  Planning  irjto 
Action,"  Educational  Researcher^  Vol.  3,  No*  5,  May  197^* 

93*      For  instance,  see:    NIE,  Grants  for  Research  on  Organizational 
Processes  in  Education  (Washington:    Group  on  School  Capacity 
for  Problem  Solving,  NIE,  1977). 

94.      Radnor,  Spivak,  Hofler,  and  Young,  Afiency-Field  Relationstfigs 
in  the  Educational  R/D£<I  Slst^Ea,  op.  cit . 

95*      National  Academy  of  Sciences,  Fundamental  Research  and  the 
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I.   "CO^^IGl'RATION''  OR  '^SYSTEM"? 

An  effecCLvely^  functioning,  tnaCure  R/DStI  system  muse  have  a 
network  of  stable ^institutions  which  are  properly  attuned  to 
their  various  functions  and  appropriately  linked  to  each  other 
and  to  users.     Mature  R/D6«I  institutions  have  generally  shown  ^ 
high  degree  of  functional  specialization  and  strong  linkages 
across  specialties  covering  all  aspects  of  the  innovation  process. 

The  institutional  base  of  educational  R/DSd  has  been  expanded  and 

strengthened  substantially  over  the  oast  two  decades.  However, 

compared  to  many  other  fields,  the  network  of  institutions  that 

carry  out  research^  development,  and  other  innovation  functions 

t 

for  the  field  of  education  appears  to  still  be  weak  and  imfnature. 
Several  functional  specializations  are  still  lacking  or  only  in 
their  infancy.     Key  linkages  are  lacking  or  only  minimal.  The 
institutional  network  in  education  is  so  weak  ^nd  diffuse  that  two 
leading  theorists  of  educational  R/D6«I,  Egon  Cuba  and  David  Clark^ 
have  argued  that  it  is  erroneous  to  even  think  of  these  institu- 
tions in  terr-s  of  a  "system"  orientation.     Rather^  they  prefer  a 
conceptualization  which -descr ibes  this  network  as  a  "conf igura t ion ^ 
akin  to  a  "comnunity'*  of  independent  institutions  with  their  own 
disparate  goals  and  decision  structures*  ^ 

ThuSj  the  KPU  corintunity  is  described,  in  the  conf igurational 
view,  as  highly  decentralized,  consisting  of  a  number  of 
'  more  or  less  independent  and  co-equal  members^  who  may 
from  time  to  titre  find  it  helpful  tjd  form  temporary 
alliances  but  who ^  ^n  the  maiQ,  retain  their  independence ^ 
shun  authority  and  activity  ifela  t  ionships  >  and  engage  in 
as  many  different  kinds  of  KPU  activities  as  seem  to  be  needed 
I    and  feasible  for  them  to  maintain  their  self-suf f iciency- 
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The  pcticy  significance  of  chis  perspeccive  is  considerable. 
Cuba  and  Clark  have  argued  that  edtcacional  R/D6I  policy  should  be 
based  on  acceptance  of  the  structure  of  the  field  as  it  is  today 
(rather  than  how  it  might  be  some  time  in  the 'future)  and  accep- 
tance of  the  fact  that  these  disparate  institutions  have  legitimate 
interests  that  must  be  taken  into  account  in  the  development  of 
policy,  and  that  they  cannot  be  forced  to  function  in  a  manner 
they  view  as  contrary  to  their  interests.    As  described  by  Cuba 
and  Clark/  polici^  which  assume  the  existence  of  a  ^'system"  and 
call  on  organizations  to  function  In  a  manner  consistent  with 
some  nornacive  view  of  how  things  ^'ought"  to  be  rather  than  a 
realistic  assessment  of  how  things  in  fact  '^are**  can  only  turn 
these  institutions  away  from  partlclpa^ttng  in  ^federal  iaitiatives. 
It  is  this  factor,  they  argue,  which  explains  why  educational 
K/D&l  has  been  functioning  for  so  long  without  a  strong  political 
constituency.    Federal  policymakers,  according  to  this  yiew,  have 
developed  policies  according  to  the ir  notions  of  what  the  Institu- 
tional configuration  should *look  like  rather  than  perceptions  of 
key  actors  as  to  the  way  things  in  fact  are  and  are  likely  to 
remain,  regardless  of  federal  policy  initiatives, 

■The  conf igurational  perspective  won' substantial  acclaim  when  it 
was  fi^st  propounded  and  publicized.    And  it  did  a  considerable  ser" 
vice  to  the  field  in  pointing  attention  to  the  broader,  more  com- 
prehensive view  of  e<3ucational  KPU  that  NIE's  leadership  was  already 
accepting       that  educational  innovation  involved  a  broader  range 
of  functions  than  simply  res^rch,  development,  and  dlssecainatlon; 
that  the  Institutional  base  of  educational  R/D£(I  Included  nou'^only 
the  network  of  federally  funded  organizations  external  to  the  oper- 
ating system^  cr:eated  and  nourished  by  federal  policies  in  the 
1960s,  but  also  private  sector  organizations,  linkage  organizations, 
and  especially  existing  operating  sys tem 'l^rganlza t ions  (SEAs,  LEAs  , 
etc)  that  were  producers  of  educational  outputs  as  well  consumers, 
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^nd  the  various  teacher  training  institutions,  commercial  pub- 
lishers^  and  other  organizations  that  had/ long  functioned  asi 
ancillary  supports  to  the  educational  system.    This  broad  view 
of  educational  KPU  is  the  basis  of  most  current  thinking  in  the 
field,  and  clearly  the  configurational  perspective  and  its  advo- 
cates did  much  to  root  this  broader  view  more  firmly  in  the  think- 
icig  of  the  field. 

Still,  we  have  argued  consistently  throughout  all  of  our  analyses 
for  a  systems  perspective,  as  more  useful  for  developing  policies 
oriented  toward  building  and  strehgther\ing  system  functioning 
while  also  producing  needed  outputs  and  providing  needed  services, 
A  key  premise  of  all  of  our  work  has  been  that  the  institutions 
and  personnel  icivcHved  in  the  production  and  utilization  of  educa- 
tional R/D£tl  outputs  form  a  "system"  and  not  just  an  unconnected 
^'configuration'*  of  entities.    Acceptance  of  this  premise  does 
not  deny  that  there  can  be  and  often  is  only  a  weak  linkage  or 
integration  between  institutions  which  should  be  more  closely  re- 
lated and  whose  goals  might  show  more  coherence.     Hor  do  we  imply 
any  monolithic,  centralized  network.     But  there  are  very  significant 
implications  for  long-term  planning  and  monitoring  and  for  the 
development  of  initiatives  by  a  federal  agency  that  do  come  from 
such  a  ^'system"  perspective. 

Of  immediate  icfiportance  for  policy  development,  the  system  notion 
focuses  attention  on  how  elements  interact,  and  therefcJre  how 
decisions  made  in  relation  to  one  issue  or  one  set  of  ^  institutions 
can  havp  significant  implications  for  other  issues  and  other  in- 
stitutions.    Therefore,  possible  courses  of  action  come  to  be  con- 
sidered in  terms  of  their  possible  repercussions  and  side-effects 
throughout  the  system  and  not  simply  in  terms  of  the  immediate 
case  at  hand. 
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Of-mor«  long-term  importance  j  ^he  ^"yStem  perspective  directs 
attention  In  policy  development  to  cap^aclty  building  and  system 
maturation  requireu'.ents.     it^;enables  us  to  apply  wfjat  we  have 
learned  from  other  R/D&I  systems  about  the  stages  of  system 
maturation  and  the  kinds  of  policy  options  likely  to  farther  and 
speed  the  maturation  process.     It  also  permits  us  to  considerN^ot 
only  whan  is  generic  to  r/ D&l  systems  but  also  what  modifications 
seemed  to  be  called  for'  by  the  specific  features  of  the  educational 
context . 

# 

There  has  been  a  Ifvely  debate  in  the  educational  community  as  to 
whether  or  not  the  edb^catlonal  context  is  so  unique  that  systems 
notions  from  other  fields  cannot  be  validly  applied.     One  school 
of  thought  argues,  for  inspnce,  that  education  is  a  practice- 
based  field  relying  largely  on  a*craft  form  of  knowledge  that  is 
experiential  and  holistic  anfd  must  be  developed  in  the  practice 
setting  by  practitioners.    ^  if  this  is  true>  doesV^t"  make  sense  to 
develop  policies  to  support  "the  development  of  a  highly  specialized 
network        insti tu^ions j -most ly 'outs ide  the  practice  setting, "to 
develop  new  knowledge,  ^rogramSj  practices,  materials,  etc.  that 
simply  cannot  be  absorbed  by  the  practice  setting  given  its  current 
modes  of  functioning?  ^ 

Can  policy  be  developed  that  suitably  takes  into  account  both  the, 
field  as  it  is  today  and  the  field  as  it  might  be?    We  think  so, 
and  w^  argue    thjTOughout  this  volume  for  policies  which  we  believe 
do  give,  ample  weight  to  both  existing  realities  and  possible  futures 
However,  before  we  can  adequately  develop  such  policies,  we  will 
need  to  kr^.ow  considerably  more  than  we        now  about  what  the  exi^t^ 
ing  realities  are.    We  shall  therefore  review  in  this  suinmary 
chapter  what  sorts  of  information  are  already  available  about  the 
field's  institutional  base ^  and  what  more  we  will  need  to  know 
before  we  will  be  in  a  position  to  develop  workable  policies. 


II.     STRUCTURAL  CHARACTERISTICS  OF  THE  INSTITUTIONAL  BASE 
^^ 

Analysis    of  the  structure  o£  the  educati^al  r/d^iI  system  suggests 
thtf^existence  o£  several  parallel  subsjrstzetns  characterized  by  mini- 
mal -sp^cializatiori, '  considerable  redundancy^  looped  as  well  as 
adjacent  'Clusterings  of  functions,  major  gaps  between  functions, 
and  inadequate  linkages  among  subsystems  as  well  as  functions. 
The  overall  structure  is  diffuse,  much  of  it  lacks  formalization, 
'and  whatever  centralization  or  cctordination  might  seem  to, be  in- 
herent in  the  dominant  role  of  the  federal  government  in  r/d6cI 
s^ronsorship^  is  more  potential,  than  operational  is  time. 

Th^focus  of  our  attention  here  is  on  .the  network  of  institutions 
ch^  carry 'out  K/D&\  activities  per  se  rather  than  either  the  ^ 
superordinate  system  that  provides  resources  and  constraints  and 
accepts  system  outputs  (i-e.,  the  federal  and  to  a  lesser  extent 
state  agencies  and  .private  f oundatrtJns)  or  the  subordinate  system 
of  mostly  sector-spanning  organizati^s  that  provide  support  ser- 
vices  fe.g. ,  data  processing  service  bureaus,  equipment  suppliers, 
maintenance  firms ^  etc . ) . 

1.     Parallel  Subsystems  Within  the  R/d&I  System  ^  , 

The  structure  of  the  educational  r/D6cI  system  is,  in  reality,  a  set 
of  three  parallel  suh^pys^n^. 

A.     Colleges  and  Universities 

jCne  subsystem  is  made  up  of  various  organizational  settings 
located  within  the  colleges  an^  universities  --  schools, 
<:olleges,  and  departments  of  educxiflon;  educational  research 
^       bureaus;  various  academic  departments  in  the  social  sciences 
%nd  occasionally^ other  disciplines  as  well;  and  university 
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base<l  interdisciplinary  research  centers  and  tnstituJi^s. 


B.     QuasUPublic  and  Private  Sector  Institutions 

A  second  subsystem  parallel  to  the  first  is  made  up  of  the 

A 

large  and  pro'li  ferating  number  of.  quasi-public  and  private 
sector  institutions  currently  engaged  in  educational  R/D£(I  * 
the  federally  funded  regional  laboratories^  r^^d  cen*berSj 
ERIC  clearinghouses,  materials  centers  ^  etc. ;  non-prof i  t 
and  for-profit  research  corporations  geared  to  the  federal 
grants  and  contracts  economy;  organizations  from  privat^^  in- 
dustry  that  have  been  making  ceptafive  forays  into  educational 
R/D^I;  and  others  such  as  publishers  and  audiovisual'  fUrms 
chat  have  strong,  established  footholds  in  the  education 
sector. 


C.     SEAs,  ISAs,  and  LEAs 


The  operating  system  of  State  Educatign  Agencies  (SEAs), 
Intermediate  Service  Agencies  .(ISAs),  and  Local  E-ducation 
Agencies  (LEAs)  are  so  weakly  linked  to  these  other  two  sub- 
systems, and  often  so' redundant  with  them  in  the  conduct  of 
R/D<tt  activities,  that  we  have  Identified  the  operating -system 
as  a  thirds  parallel  .stream  rather  than  as  the  KU  targel^f 
KP  activities  In  these  other  two  streams.^ 


Linkages  VJithln  Each  Subsystem 

Within  each  of  these  subsystems  there  is  some  interaction 
of  a  moi'e  or  less  informal  nature       but  far  less  than  one 
would  imagine  given  the  pl^ysical  proximity  of  organizational 
unjLts  within  the  academic  setting;  or  given  the  operating 
system^s  formal  governance  structure  that  would  lead  oms  to 
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expect  to  find  extensive  interaction  and  monitoring  betveen 
SEA  and  LEA  personnel;  or  considering  the  comnonality  of 
incereTts  chat  would  lead  one-  to  e?cpect  extensive  communica- 
tion among  schools  or  between-  LEAs  and  SEAs. 

ISAs  represent  b.  new  development  aimed***;  increasing  linkages 
among  school  districtSj  and  between  school  districts  and 
their  SEAs.    Aside  from  this  one  exception  (and  even  here, 
only  sotne  states  have  created  ISM       and  these  tend  to  be 
quite  new^;  linkages  within  each  of  the  three  subsystems  are 
incidental  and  informal  rather  than  institutionalized ^  perma- 
nenCj  and  sttong.     Consequently,  communication  and  informa- 
tion flow!  are  weak^  ^nd  knowledge  production  and  utiiieatioo'^ 
are  inefficient  and  far  less  effective  than  they  might  other-  * 
wise  be.     Developments  in  social*  science  departments  tend'  to 
have  relatively  little  impact  on  developments  in  schools  of 
education,     R6tD  activities  in  one  research  corporation  have 
little  impact  on  R&D  activities  In  others."  As  yet>  local 
innovations  in  one  school  district  seem  to  have  little  impact 
on  practices  In  other  districts. 

E-    Linkages  Between  Subsystems 

Equally  (and  perhaps  even  more)  serious  are  weaknesses  in  the 
linkages  among  theae  parallel  subsystems.  The  academic  com- 
munity ter^ds  to  function  in  relative  isolation  from  both  the 
operating  s'ystem  and. the  research  corporations  that  dominate 
R&D  a<*tvity.  Consequently,  the  research  findings  pro<!xiced  by 
the  universities  have  relatlvelj^  limited  impact  outside  thac 
sybsystem-  The  operating  system  is  linked  to  publishers  and 
equipment  suppliers  in  the  private  sector  but  otherwise 


generally  develops  its  own  programs  an*i  materials  and  tends 

lO 


more  often  t^ian  not  to  operate  as  though  there  were  no 
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educational  research  comnunity^  no  relevant  research  findings^ 
and  no  externally  developed  RctD  products  and  prog^rams.^  The 
general  pattern  in  the  regional  laboratories  and  the  research 
corporations  has  been  to  develop  products  and  programs  in 
relative  isolation  from  either  the  academic  community  and 
its  accumulated  knowledge  base  or  the^user  system  and  i^s 
perceived  needs  and  constraints.    There  are  notable  .excep- 
tionSj  of  course^  and  some  strong  collaborative  'arrangements 
ha been  forged  in  a  number  of  instances  (e.g.^  Northwest 
Regional  Laboratory,  in  relation  to  school  districts  in  its 
^  r^egion)  .     Bi:t  on  the  .whole,  individual  R/D6I  institutio;!S  and 
organizational  units  tend  to  function  in  isolatton^  linked 
weakly  if  at  all  to  other  institutions*or  units  or  their 
immediate  subsystem  or  other  subsystems  in  the  macrostructure. 

Degrees  of  Functional  Specialization  or  Clustering 

A .    A  Low  Degree  of  functional  Specialization 

Given  the  range  of  institutional  types -involved  in  educational 
R/D&I  activity^  one  tnight  expett  to  find  a  ''natural"  special- 
ization of  functions  and  a  pass-it-on  flow  o'f  R/D&I  activity 
in  th^  rfelationship  among  these  subsystems.    The  university 
subsy-etem  would  seem  to  be  inherently  suited  to  research. 
The  non-university  research  corporations  would  seem  to  be 
designed  to  meet  the  needs  of  prograrninatic  development 
And  the  operating  system  jcould  be  (and  were  .for  a  time)  viewed 
narrowly  a^  the  target  to  receive  the  outputs  researched  in 
the  universities  and  developed  in  the ' corpora t ions . 

Hj^wever^  examination  of  the  kinds  of  R/d&I  activities  carried 
out  in  these  institutions  suggest^  th^t  there  is  some,  but 
considerably  less  functional  specialization  than  one  might 
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expect/ and  conside^bly  less  Hnkage>^  two-way-inceracciorij 
or  *-no"*jledge  feedback  Chan  one  would  expect  co  find  in  a 
mature*  well  integrated  system. 

The  relatively  limited  degree  of  specialization  and  extensive 

amount  of  re<5uridancy  that  charact^ize  the  erducational  R/DStI 

^yste[iv  can  be  seen  in*the  location  and  clustering  ofR/D^^I 

functions  in  the  various  institutions  that  make  up  the  sys^ 

tern.     The  greatest  Amount  of  specialization  occurs  at  the 

basic  research  end  of  the  educational  KPU  spectrumj  with  most 

basic  research  concentrated  in  the  universities  and  esoecially 

in  the  academic  departments.     Some  basic  research  is  also  done 

in  some  of  the  larger  wealthier  and  more  presigious  research 
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corporations  (a*g.  j  Educational  Testing  Service). 

Applied  research,  howeverj  is  carried  out  in  one  form  or 
another  in  research  institutions  or  units  scattered  through- 
out all  the  various  types  of  organizational  settings  in  the 
sys^tem       the  universities;  the  R£tD  centers  and  regional 
laboratories;   the  t'asearch  corporations;  and  even  some  of 
the  strong  SEAs  and  big-city  IXAs  that  have  the  resources  to 
carry  out  policy  research  as  P^rt  of  their  long-range  planning 
and  monitoring  efforts. 

The  bulk  of  federally  funded  development  work  is  carried  out 
in  the  regional  laboratories  and  university-based  R^D  center^ 
and  the  large  research  corporations .    However,  development 
work  in  one  form  or  another  takes  place  in  virtually  all 

9 

types  of  organizational  settings  in  all  thrtie  subsystems. 
Similarly,  dissemination  and  evaluation  contracts  are  being 
awarded  increasingly  to  institutions  located  in  only  certain 
segments  of  the  overall  structure  (dissemination  contracts 
increasingly  to  SEAs  and  organizations  working  with  them; 
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e^.T-uatioL  concracts  increasingly  to  the  r^^search  corpora- 
c ijons,     None th- less  ,  di ssemi najt ton  and  evaluation  activities, 
toOj  are  carried  out,  in  one  form  or  another  throughout  the 
structure^  even  in  organizational  units  within  the  super- 
ordinate  structure  of  federal  and  state  agencies. 


If  we  consi(^er  the  implementation  and  utilizarion  support 
functions ,  what  li^^le  linkage  ^p-cial  iza tion  exls  ts  to  pro- 
vide user  system  personnel  with  technical  assistance  In 
building  lnter:ial  capabilities  or  implenenting  externally 
develop-s'J  RiD  products,   tends  to  be  located  either  in  new 
1 inkage  and  technical  assis  tance  organiza tions  (often  small 
non-profit  corporations)  or  in  the  hands  of  a  small  group  of 
^-staffers  from  a  laboratory,  R^D  renter,  or  private-sector 
R^D  organization  th^t  is  trying  to  install  one  of  its  pro^ 
ducts.     Still,  even  here,  careful  analysis  uncovers  some 
linkage,  technical  assistance^  and  implementation  support 
'   activities  in  the  universities,  in  some  of  the  stronger  SEAs, 
and  in  those  few  L£As  and  individual  schools  that  are  well 
endowed  with  curriculum  specialists  and  other  specialized 
personnel. 

Overall,  then,  compared  to  some  of  the  more  mature  R/IJ&I 

systems  in  other  sectors  that  show  Very  high  levels'of 

specialization  of  organizations  by  functions  and  Sub- 

« 

functions,   functional  specialization  among  educational 
R/D&I  orga^nizatlons  tends  to  be  somewhat  limited.  Stilly 
regardless  of  how  education  may  compare  to  other  f iels  »  fund- 
ing da:a  suggest  that  there  is  a  substantial  amount  of 
specialization  and  division  of  labor.    After'  reviewing  the 
available  funding  data,  one  group  of  anai^ts  concluded  that 
"each  KPU  function  tends  to  be  supported  largely  in  oye  or 
two  kinds  of  organisations,  and  eath  type  of  organization 
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tends  to  receive  a  majority  of  its  funds  for  only  oae  or 

cvo  funct  ior\s /'^^    LEAi  reAive  virtually  aU'  of  their  KPU- 

related  federal  funding  fbr  demonstrations.  For-profit 

corporations  are  largely  dependent  on  evaluations.  SEAs 

are  heavily  dependent  on  detnons  tration  pro  jects »  but  also 

receive  significant  sums  for  development  work.     Non-profit  * 

corporations  receive  substantial  amounts  of  their  federal 

education  KPU-related  funding  for  development  vork  and  for 

demonstrations.    Academic  institutions  have  the  most  diverse 

pattern,  deriving  their  federal  support  for"  education  KPU 

activities  for  development  work^  basic  research,  artd  pilot 

13 

and  demonstration  projects  or  replications. 

i 

What  is  intriguing  about  the  lesser  special  tza^t  ion  of  educ^i- - 
tional  R/D&I  compared  to  other  sectors  is  not  only  that  there 
is  less  functional  specialization  among  organization  but 
also  that  there  appears  to  be  even  less  specialization  in 
substantive  areas  of  r/d&I  activity.     Basic  researchers  tend 
to  becort^e  specialists  in  narrowly  defined  research  areas  and 
subject  of  investigations.     But  this  seems  ti?  be  only  rarely 
true  in  the  case  of  the  other  functional  areas.     Our  observa* 
tions  on  this  point  were  made  several  years  ago^  and  some  of 
this  may  have  changed,  but  if  the  pattern  still  holds  »  the 
pattern  in  education  may  be  that  applied  researchers,  develop- 
ers, evaluatorSj  disseminators,  and  implementation  support 
personnel  tend  more  often  than  not  to  become  generalists 
within  their  functions       one  yesr  eyaluating  education  pro- 
grams; the  next  year  examTnlng  the  effectiveness  of  alterna- 
tive d  i  s  serriina  t  Lon  strategies;  the  next  year  assessing  the 
quality  of  ERIC  information  analysis  products;  etc.  .  Within 
a  few  months  time,  a  single  large  r/D^I  organization  within 
the  education  sector  may  respond  to  RFPs  and  bid  on  and  be 
awarded  contracts  covering  the  whole  range  of  functional 
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specialties  and  ari  array  of  topical  areas ;  and  some 
sar.e  personnel  snay  be  assigned  t&  work  on  several  of  these 
rather  different  contracts  at  the  same  time.     Some  of  these 
organizattons  may  also  be  working  on  conti:4,cts  involving 
R/D£(I  activities  in  fields  of  health,  personnel  development  ^ 
social  welfare  programs,  etc.    Clearly^  this  pattern  is  at  ) 
considerable  variance  from  a  sector  like  the  aviation/ 
aerospace  industry  where  there,  is  highly  developed  speci^l- 
izatio.T  by  function^  by  components  {e.g.>  airframes^  engines, 
electronics)  i  and  even  by  R£fD  problem  areas  (e.g.>  wing 
stress  analysis).     It  would  seen  ijsef^l  ro  gath^sr  so'^e  data 
on  this  pointj  to  assess  the  extent  of  specialization  at  * 
present^  and  the  extent  to  which  this  has  or  has  not  in- 
creased over  the  past  decade,  arrd  the  specific  functional 
and  substantive  areas  in  which  there  is  or  is  not  a  substan- 
tial degree  of  specialization. 


B.     A  Hi^h  Degree  of  Functional  Clustering 


Exanination  of  the  clustering  of  functions  within  R/Dal 
institutions  reveal s ,  not  surprls ingly ,  that  bas Ic  research 
is  Che  most  specialized  of  the  various  functions  and  the  least 
likely  to  cluster  with  any  of  the  others.    This  is  attribut- 
able to  the  nature  of  the  knowledge  and  technology  b^se  of  the 
basic  research  function;  the  socialization  and  training  of  its 
personnel;  and  the  values^  norms^  and  mores  of  the  university 
settings ''in  which  it  takes  place.     If  we  ignore  basic  research 
and  consider  the  remaining  r/d6I  functions^  we  find  several 
for:?s  of  both  adjacent  and  looping  clusters. 

A  significant  amount  of  c^ijs^tp/lng  surrounds  the  development 
function  e^g-  >  applied  research  and  development;  deveiop- 
n^nt  and  dis  semiha t ion ;  de velopmen  t  and'  product  ion  of  support 
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[materials  for  icnp lementac ion/uc H  12a ti on^  and  even  develop- 
tnenc  Misseminac  t on/  imple'^enta  tion  clus  rering.  .  The  clus  Ber- 
ing is  the  outcome  of  conscious  policy  decisions  of ^education- 
al R^D6tI  nanagers.    A  less  formalized  version  of  the  saT.e 
kind  of  clustering  (lainus  diss^dinacion)  \^ould  be  represented 
by  the  creative  teacher  who  generates  an  'idea,  gatners  rele.- 
vant  informaCLOn,  develops  it  intc^  a  teaching  strategy  and 
instructional  materials,  and  then  uses  them  in  her  classroom* 

Disseolnat ion  and  implementat ion/uti 1 ization  clustering  is 
becoming  increasingly  frequehc  as  a  result  of  the  kncvled^e 
base  and  personnel  base  thatlepans  these  tvo  functions  and 
as  a  result  of  the  kinds  of  organizational  arrangements  that 
are  being  created  by  explicit  and  intentional  policy  initia- 
tives of  federal  and  state  agencies  (e.g.,  training  prograas 
for  dissemination  and  utilization  specialists;  s^ate  crea" 
tlon  of  ISAs  to  provide  dissemination  and  technical  assistance 
services  to  ^school  districts;  N7E's  R<5tD  Utilization  Program; 
etc.). 

^ 

Applied  research  and  evaluation  were  a  natural  cluster  during 
the  first  fe^?  years  of  the  emergence  of  the  evaluation  funcr 
tion,  largely  because  evaluation  personnel  were  trained  as 
researchers;  were  interested  iii  conducting  research  rather 
than  "evaluation;  were  forced  into  evaluation  vor^  by  the 
operation  of  the  laws  of  personnel  supply  and  demand;  and 
tended  more  often  than  not  to  piggyback  research  projects  onto 
required  evaluation  activrt^9>    As  evaluation  has  matured 
anc!  developed  a:^  identity,  aethodologyj  and  personnel  base  of 
its  own,   this  basis  for  the  research/evaluation  cluster  has 
been  less  proninenti     Still,  there  are  several  examples  of 
well-run  RiD  programs  where  questions  uncovered  in  the  course 
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of  product  Qr  program  evaluations  are  turned  over  to  research 
personnel  for  fi:rther  invest  i gat  ion  or  iented  coward  future 
development  cycles  for  further  product  re f inenent  (e . g . ^  in 
the  development  of  the  ladividually  Prescribed  Instruction 
Program  by  the  Learning  Relgearch  and  Development  Center  and 
by  Research  for  Better  Schools). 

'  One  of  the  newest  clusterings  to  appear  is  a      i 1 ization/ re- 
search cluster  that  may  lead  to  maturation  of  a  practice- 
oriented  research  specialty. 

Also  relat^.vely  new  is  a  u:  1 1  iza t ion/deve loprrent /dissemination 
or  util  izaftion/disseciinat ion  cluster  evident  in  projects  to 
identify  exemplary  practlCefe^  document  and  analyse  them^  use 
theffl  as  the  basis  for  materials  development,  and  disseminate 
these  practices  and  materials  to  other  potential  users.  The 
configuration  is  changing  somewhat  as  more  and  more  resources 
are  being  allocated  to  building  linkages.     Initially,  this 

^   took  the  form  of  temporary  collaborative  arrangements  and 
joint  ventures  for  individual  projects ,  joining  together  in- 
stitutions  vith  complementary  capabilities  or  functional 
specialties.     Increasingly  the  consortia  and  networks  that 
are  being  proposed  "and  experiniented  with  are  intended  to  be 

*   permanent,  formalized  interface  arrangements  providing  either 
horizontal  integration  (linking  sl^milar  institutions  or 
organizations)  or  vertical  integration  ^linking  functions 
and/or  subsystems).     It  will  be  some  time,  however,  before 
we  can  expect  to  see  the  effects  of  these  ini tiative*  on 
the  configuration  of  educational  r/D6I  institutions.  ^ 

3.     A  Final  Point:     The  Place  of  Lar^e  Corporations 

One  further  poin$  should  be  noted  before  we  leave  the  t<rp^,c  of  the 
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scructure  of  the' R/D^I  system  in  education.     Several  large 
corporations  appear  ro  have  particularly  strong  positions  in  the 
grants  and  contracts  economy  of  the  education  sector        e.g.,  the 
American  Institutes  of  Research,  Rand  Corporation,  Stanford  Re- 
search Institute,  and  Education  Testing  Service.     In  fact,  in  the 

period  ?V  1973  -  FYz-igTS,  fewer  than  50  organizations  received 

14 

the  majority  of  ^'lE  funding  support.        Still,  the  number  of 
R/D^I  Institutions  receiving  funds  from  all  sources  is  substantial 
and  it  would  seer,  unwarranted  at  this  time  to  suggest  that  certain 
types  of  r/DccI  in  the  education  sector  are  dominated  by  a  few 
lar^e  institutions  in  a  pattern  resenbling  the  aviacion'aerospace 
industry.     However,  we  will  be  in  a  better  position  to  assess 
this  question  after  the  N'lE  KPU 'monitoring  project  provides 
empirical  data  about  the  individual  institutions  that  carry  out 
educational.  R/D^I  activities        essential  information  for  under- 
standing the  emergent  configuration  of  educational  R/D&I  institu- 
tions and  for  developing  appropriate  policy  initiatives  and  scrate' 
gies  for  macrostructure  management. 

J 
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III,     KEEDED  EMPIRICAL  AMD  AI^ALYTICAL  WORK 

Several  ^cinds  of  errpirical  and  analytical  work  would  seem  to  be^ ' 
needed  to  inform  policy  <3evelopment  dimed  at  strengthening  the 
institutional  base  of  educatiof^al  R/05tI. 

At  the  v^ry  least,  we  need  to^  develop  considerably  more  precise 
information  than  we  have  now  about  the  types  of  capabilities  re- 
quired to  carry  out  various  kinds  of  R/D6cI  accivity  in  education. 
We  include  here  three  levels  of  capabilities:    personnel  com- 
petencieSj  organization  capabilities  (thac  entail  considerably 
more  than  simply  the  sum  of  the  competencies  of  the  personnel 
within  an  organization) ^  and  system  capacities  (whichj  likewise, 
involve  more  than  simply  the  capabilities  of  the  organizations 
that  comprise  the  system's  institutional  base). 

Both  analytical  and  empirical  work  {in  successive  cycles)  would 
seem  to  be  called  for  to  identify  ^the  various  kinds  of  capabili- 
ties required.     It  would  then  seem  essential  to  coriduct  surveys 
and  other  investigations  to  assess  levels  of  capabilities  for 
various  kinds  of  educational  R/D6cl  work  and  to  identify  and  locate 
those  institutions  which  currently  appear  to  show  evidence  of  high 
levels  of  particular  capabilities  and  might,  therefore  serve  as 
centers  of  excellence  around  which  to  strengthen  and  expand  exist- 
ing capacity. 

In  addition,  moreV^pecific  information. would  seem  to  be  needed 
about  existing  linkages  and  information  flows  among  the  various 
institutions  that  carry  out  educational  R/D6cl  work  and/ or  use 
educational  R/D&I  outputs. 

Beyond  thatj  we  need  to  better  understand  how  certain  types  of 
institut  ional  sett  ings  affect  educational  R/DScI  functioning.  We 
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would  want  to  see  a  series  o£  process  analyses  carried  out  to 
explore  and  document  the  various  organisational  factors  that 
facilitate  or  hinder  high  quality  r/D^I  functioning  of  different 
types  in  different  types  o£  organizational  settings.     Is  it  true, 
as  is  generally  assumed,   that  basic  research  is  best  carried  out 
in  academic  institutions?     chat. development  work  is  best  carried 
out  inR^D  centers,   laboratories,  or  research  corporations? 
that  evaluation  work  is  best  done  by  for-profit  corporations? 
l£  these  assumptions  are  true,  why  are  they  crue?    What  organization- 
al constraints  work  against  equally  high  quality  basic  research 
functioning  in  non-acadenilc  settings,  or  equally  high  quality 
development  work  in  academic  institutions?    And  so  on.    We  would 
want  to  develop  an  understanding  of  how  key  organizational 
variables  impinge  on  r/D£cI  processes.    And,  we  would  want  to  get' 
a  handle  on  the  question  of  whether  or  not  certain  types  of  in- 
stitutions* are  best  suited  to  certain  types  of  R/D£tl  functioning. 
Are  the  first-rate'  performers  of  evaluation  research,  for  instance, 
distributed  across  all  organizational  types,  or  are  they  virtually 
all  located  within  only  one  type  of  institutional  setting?    Are  the 
costs  of  a  given  type  of  r/D6cI  activity  greater  in  one  type  of 
organizational  setting  than  anothe^  and  if  so,  why?    Are  there 
ways  CO  judge  the  cost"ef fectiveness  o£  different  institutional 
settings  for  different  kinds  of  educational  R/D&I  activity?  In 
shore,  to  what  extent  can  (or  should)  the  educational  k/dl1  Insti- 
tutional base  be  understood  In  terms  o£  functional  specialisation 
by  organizational  types?    To  what  extent  is  this  concept  unrealis- 
tic or  even  Inappropriate  to  the  educational  context? 


Our  *'systen-orienced"  perspective  suggests  the  need  for  NIE  and 
other  key  sponsors  o£  educational  R/E)6<1  activity  lo  develop  some 
clear  notions  about  the  kinds  of  capabilities  and  linkages  that 
have  CO  be  nurtured  and  developed  to  permit  the  system  co  perform 
effectively  in  the  future  in  carrying  out  the  types  of  r/D6<I 
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activities  projected  as  needed.'    Policy  initiatives  should  take 
into  account  these  visions  of ^he  future  of  educational  R/D6X- 
However ,  we  acknowledge  the  validity  of  the  key  point  made  by  the 
proponents  of  the  conf igurational  perspective.    We  have  consis- 
tently argued  for  policy  development  that  takes  into  account  not 
only  generic  notions  about  how  mature  R/DctI  systems  function  but 
also  contextual  perspectives  that  orient  policymakers  toward  what 
is  feasible  and  desirable  at  a  given  ^oint  in  time  in  a  particular 
context  such  as  educational "R/D6I        taking  into  account,  there- 
fore, the  interests  of  diverse  educational  R/D5tl  performer  organi- 
nations  as  they  define  these  interests.     Before  we  can  devise 
sound  policies  that  take  into  account  both  generic  and  contextual 
factors,  thoughj  we  will  need  to  develop  a  sound  ecnptrical  base 
on  how  R/D^tl  processes  are  affected  by  different  types  of  organi- 
zational settings  within  the  educational  R/D6tl  institutional  J>ase, 

■  ■  k 

A  good  place  to  start  might  be  using  data  gathered  in  the  recently 
completed  organizational  survey  undertaken  as  part  of  NIE's  \ 
Educational  K^iJJJonitorlng  Programy^  These  data  might  be  used  to 
develop  sampling  frames  on  differ^t  types  of  organizations  carry- 
ing Out  significant  amount  of  different  types  (if  educational  R/D6fl 
activj^ty ,    Explxiratory  process  analyses  and  docunfentation  efforts 
might  be  started  in  several  of  these  organizational  typea^  with 
more  elaborate  work  following  at  some  later  time  when  some  ^f  the 
initial  conceptual  and  methodological  issues  have  been  resolved.  ' 
But  regardless  of  where  work  on  these  questions  begins,  they  would 
certainly  appear  to  warrant  priority  attention  if  we  *are  to  be  able 
to  build  strong  system  capacities  for  high  quality  educational 
R/D6X  functioning. 
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There  is  a  large  literature  on  the  regional  laboratories,  R^tD 
centers,  and  other  institutions  created  by  OE  in  the  1960s.  Much 
^of  'this'  literature  is  referenced  In  our  :Cl^apt^  on  the  historical 
developfflent  of  the  educa^tlonal  R/MI  system,  aiul  we  refer  the  reader 
to  that  chapter  ^or  more  extensive  citations^    tor  illustrative 
purposes  here,  we  cite  the  fallowing:    Office  of  Education, 
Educational  Research  and  Development  in  the  United  States  (Washington: 
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(Washington:    NIE,  1976);    Francis       Chase,  The  National  Program. 
of  Educational  laboratories  Cl>ashington :    OE,  1968);         J.  Boyan, 
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and  Development  in  Education,  Vol,  3,  No.  2,  Iffnter  1970;  Stephen 
K,  Bailey,  "A  Final  Report'  from  the  Mational  Advisory  Committee^  on 
Educational  Laboratories,"  Educational  Researcher  (newsletter),. 
Vol,  21,  September  l^Wf  'John  D,  Herzog,  "The  Productivity  of 
Undemanaged  Research:    Five  Years  of  the  Harvard  R£tD  Center," 
Journal  of  Research  and  Development  in  Education,  Vol*  5    No.  4, 
Sunner  1972;    J,  Victor  Baldridge  and  Rudolph  Johnson,  The  Impact 
of  Educational  RSD  Centers  and  Laboratories :    An  Analysis  of 
Effective  Organizational  Strategies  (Stanford:    Kationai  Academy 
of  Education,  1972),  ERIC  ED  079  860;     Roald  Campbell  et  al. ,  R&O 
FLinding;  Policies  of  the  Isational  Institute  of  Educati^oa:  Review 
and  Recoimnendations  (Washington:    NIE,  1975);    and  Panel  for  the 
Review  of  Laboratory  and  Center  Operations,  Research  and  Developnient 
Centers  and  Regional  Educational  Laboratories:     Strengthening  and 
Stabilizing  a  National  Respurce  (Washington:    NIE,  1979).  ~ 

On  the  private  sector,  see  for  instance;    Paul  Goodman,  Gerald 
Holton,  Donald  W,  Oliver,  G,  Howard  Goold,  and  Edward  Katzenbach, 
"The  Education  Industries;    A  Discussion,"  Harvard  Educational, 
^Review,  Vol,  37,  'No.  1,  Winter  1967;    Nancy  A.  Bord  et  al..  Study 
of  the  Education  Products  Industries,  New  Tork,  Institute  for 
Educational  Developrient^  as'  cited  in  OE,  Educational  Research  and 
Developnient  in  the  United  States,  op.  cit*,  pp.  169^-70^    and  Williain 
A.  Firestone,  "Educational  Field  Research  in  a  ^Contract  Shop',*'  The 
Generator  (Division  C^AERA  Newsletter)*  Vol.  5,  No*  3,  Spring  1975. 

On  SEAs,  for  instance,  see:    Henry  M,  Brickell,  Survey  of  State 
Education  Department  Research,  Development,  Dettionstration ,  Dissemina- 
tion, and  Evaluation  RT)DDE_^  1969-70  (New  York:    Institute  £or  ^ 
Educational  Development,  1971),  ERIC  ED  078  548;    Jerome  T;  Murphy, 
'^Title  V  of  ESEA;    The  Impact  of  Discretionary  Funds  on  State 
Education  Bureaucracies'*  Harvard  Educational  Review,  Vol,  43, 
No<  3,  August  i973;    Jerome  T. Murphy,  Grease  the  Squeaky  I?heel:  A 
Report  on  the  IttipLementat ion  of  Title  V  of  the  Elementary  aod 
jeccmdary  Education  Acq  of  1965,  ^'Grants,  to  Strengthen  State  Depart- 
ments of  Education"  (Cdlhbridge:    Center  for  Education  Policv  Research, 
Harvard  University,  1973);    and  Sally  BulRley  Pancrazio,  ''State 
Edu^htion  A'gencies'as  Research  Arenas,*'  Educational  Researcher^ 
Vol.   7,  No.  1,  January  1978, 

On  LEAs,  see,  for  instance:    David  G,  Ryans,  "Are  Educational 
Research  Offices  Conducting  Research?*'    J.ournal  of  Educational 
Research,  Vol,  31,  November  1957;    National  Education  Association, 
''Research  Units  in  Local  School  Systems,"  Educational  Research 
Service  Circular,  1965,  No,  5;    and  Edith  K.  Mosher,  Wliat  About  the 
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School  Research  Office?  (Berkeley^    F^r.Wesc  Laboratory  fot^Educa- 
^    '  tional  Research  and  Development>  1969)/  ^      ^  '  f 

6,  See,  for  insdaace,  Robert  Travers,  *'A  Study  of  the  Relationship- 
of  Psychological  Research  to  Educational  Practice/*  in  Training 
for  Research  and  Education^  R,  Glaser^  ed *  {^ittsburghi  University 
of^ittsburgh  Press,  1962);    J,  Lindeman,  S.       Bailey,  J,  S. 
Berke,  and  L.  H.  NauTn>.  Sorng  Aspects,  of  Educational  Research  and 
Development  in  the  United  States  -  Report  icit  the  OECD  Review 
(Syracuse:     Syracuse  University  Research  doi:H>oration,  1968);  Ronald 
Havelock  and  Mary  Havelock,  Educational  Innqv^atioa  in  the  United  , 
Stgtes  (Ann  Arfcor ;    Center  for  Research  on  the  Utilisacion  of  ^ 
Sci'^tific  Knowledge,  Institute  for  Surrey  Uesearch >  University 

of  Michigan^  1973);    and  Ronald  G,  Hav^lool^  * '^Locals  Say  Innovation 
is  Local;    A  National  Survey  of  School  Superintendents,^'  in  Wiy t 
Do  Research  Findings  Say  About  Getting  Innovatiprrs  Into  Scliools: 
A  S^-nposiun,  3anford  Seakin  and  Mary  V^l  Brown,  ed^i,  ,  (PhilacJi&lphia; 
Research  for  Better  Schools,  197A)* 

7,  The  bestf^vailable  data  on  federal  funding 'of  educational  R/D£fl 

by  performing  organizations  is  diiTnited  to  data  on  projects  in  early 
childhood  and  adolescent  education*     (See  our  chapter  on  Funding 
for  a  description  of  thi&  ''SRG"  data  base,  and  it^limitatibns.) 

*  According  to  these  data  (which  are  also  the  basis  for  the  informa- 
tion provided  below  in  footnotes  7-^10  and  12),  71%  of  federal 

'    education  KPU  funds  in  F6  1975  w^i^  to  academic  institutions,  lh% 
to  non-profit  corporations,  and  ^\  to  for-profit  corporations* 
3  Camot  E,  Nelson  and  Ward  S.  Mason,  1975  Federal  Fundinj^  for  Educa- 

tion Knowledge  Production  and  Utilization:  Pro.iect  Cont-ent  and 
Performer,  By  Agency  (Washington:    NIE,  1977),  Table  15,  p.  33. 

Ibtd.    Applied  research  funding  in  F6  1975  was  distributed  as 
^      "         follows;     34%  to  academic  institutions,  29%  to  non-profit  corpora- 
tions, A%  to  SEAs,  10^  to  LEAs,"lA%  to  other  state  and  local 
agencies,  less  than  0*5%  to  for-profit  corporations  and  8%  to 
*'oCher"  types  of  organizations. 

9*      Ibi d.    Development  funding^ln  FY  1975  w3s  distributed  as  follows: 
38%  to  non-profit  corporations,  33l2.^o  academic  institutions,  2%' 
to  for-profit  corporations,  11^  to  SEAs,^  A%  to  LEAs,  A%  to  other 
state  and  local  agencies,  and  8%  to  "other'*  types  of  organizations* 

10.     tbidf    The  figures  on  ''pilot  or  demonstration  projects  and  replica- 
tion^" are  as  follows:    66%  to  LEAs,  8%  to  academic  institutions, 
8%  to  non-profit  corporations,  less  than  9»5%  to  for-profit  corpora- 
tions, 8%  to  S^^  3%  to  othe^n^tate  and  local  agencies,  and  7% 
^  ^         to  ''other"  organizations. 

The  "figures  for  ''research  support  and  utilization**  (which  includes, 
but  is  not  limited  to  di^ss>emfhation)  are:.^         to  ;icademic  i^istitu- 
tipns,  52%  to  non-profit  corporations,  8%  to  for-profit  corporations, 
10%  to  SEAs,  less  than  0.5%  to  LEAs,"l%  to  other  state  and  local 
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^genci^s  > 'and  5%       ^'other'^  prgaoi^tiqns  ,   ^ '  T'' 

Xhe /f'^^*^T^*es  for  evaluat'ipn  . research  afe:    21%  to  academic  insti- 
t^tionSj  IT/^  to  non-^prof :^6oT'^rat:ior\s>         to  ^oir-proftt 
c*orporl'tJi:6ns>  less  than  -0.5%  to'-QEASj  ,0  to  LEAs>  1%  to  other 
s'tate  and  local  ^encies^'^nd  2%  tp  ^ther  organi2ation;s  t  The 
"figures  for  policy  reSea'^ch  Latt^/Dil  activity  we  h^ve  tended  to 
coll'apse  into  a  single  cate^^.ry  with  evaluation  research)  are: 
11%  jto  academicN^MtitutloDSv  3A%  to  non-profit  corporations^ 
20%  to  for-proeit^orppr<ei6ng>  1%  to  SEAs,  ITL  to  LEAs  >  12%_  to 
other  $tate  and  loeal\ -agencies  >  and  5%  to  "^rther"  organizations  * 

ImpleiDentalion/UtilizatiorL  ca'fi^i)e  viewed  here  as  a  subcategory  of 
^'Res^arch  Support- and  y tilizati^D.  For;  the  figures  on  this>  see 
above>  footnote  9.  '  ^ 


12.    >:elson  and  Mason>  Project- Content  and  Perfon^er^  By  Agency  >  op,  cit. 


13,    Ibid*    The  figures  on  tb>is  for  federal  funding  of  educaJiiQp  KPU- 
relevant  activity^are  as  follows:    ^7%  of  L5A  funds  are  for  demon- 
strations;   77%  of  the  funding  going  to^or-prjpfit  corporation^  is 
for  evaluations;    67%  of-^SEA  funds  are  for  demonstration  projects 
a^i  another  27%  for  developii^ent  work;     for  non-profit  corporations  > 
the  funding  is  received  largely  for  development  work  (38%)  or 
demonstrations  (28%) >  the  funds  goin^  to  academic  institutions  are 
for  basic  research  (22%)  >' development  workX30%)>  and  pilot  and 
demonstration  projects  or  replications  (27%)* 


lA,    NIE>  J976  Databook.  op,  cit. 

15,    The  non-profit  corporations  and  (to  a  lesser  extent)  the  universities 
seem  particularly  favored  in  the  NIE  funding^  but  this  may  be  balanced 
by  predominant  orientations  toward  other  institutional  type by 
-    other  federal  agencies  Cfor  instance,  OE  fitnding  vafors  LEAs  > 

Public  Health  Service  funding  favors  the  universities).    See  Nelson 
and  Mason>  Pro.jecf  Content  and  Performer^  By  Agency^  op,  citf 


ERIC 


4 

EDUCATIONAL  RESEARCH,  DEVELOPMENT, 
A-ND  T^NOVATION:     THE  I>:STITUTI0NALX2ATION 
0?  CtL«GE  IN  EDUCATION 

CHAPTER  FIVE 


October  1979 


Harriet  Spivak 
Michael  Radnor  ^ 

t 

The  project  repo^rceci  herein  i;as  perfomed  under  Contract  i'-  NIE^ 
C-^00-76-0110  for  the  National  Institute  of  Ed^Jcation>  Dcpartr^nt 
V  ^  T'^**'^ -  1  on  ar'!  ' "o '  ^  / *    *Fo'  ^^'\^r ,  th::^      ^" r: o-^s  E?'*  pr ^  =; ^  ^ 

herein  d'^  riot  nece^<;::>rily  reflect  the'^positioa  or  policy  of  tht* 
Na:ir>n.i't   InstltLite  of  Education  and  no  official  endor5;en:ent  o,f  th^ 
National   Instltuto  of  Education  should  b?  inferred. 


345 

< 


CONTENTS 

I.  DEFINlTtO};  OF  PERSOy:^£L  BASE  OF 

EDUCATIONAL  R/D&I  /  3'50 

II.  THE  AVAILABLE  LITERATURE  351 

III.  EXPANSION  OF  THE  PERSONNEL  BASE  353 

IV.  CRITICAL  WEAKNESSES  IN  THE 

PERSONNEL  BASE  354 

I        1.     Funccioial  Imbalance   

2.  Inadequate  Supply  of  Trained 

R/Dil  Managers  .  .   .  .'  ■  35^ 

3.  Backgrounds  and  "Training  354 

V      V.     ,    '^ME  SEEJIINGLY  INTRACTABLE  PROBLEMS'  '.   .  356 

VI.         POLICY  ISSUES  357 

1.  Rates  at  Which  the  Personnel  Base 
Can  be  Expanded  for  Different 

Functions  357 

2.  Attracting  First-Rate  Personnel    357 


3H/f  I  3A9 


Tiie  personnel  base  of  educational  R/D^I -<±ppears  co  be  one  o£  its 
r:iost  critical  weaknesses  and  one  that  is  central  to  many  of  the 
problen\s  faced  by  the  field.    Without  an  adequate  supr^ly  of  first- 
rate  talent,  the  field  has  been  unable  to  produce  impressive  outputs 
or  develop^  the  kind  of  high  quality  knowledge  and  technology  base 
that  vould  seem  to  be  essential  if  significant  achievercents  are  to 
be  nade  in  the  future.     Criticisms  of  the  personnel_  base  have  been 
nade  frorn  the  outset  of  the  institutionalized  system's  history^  , 
(and  even  in  the  discussions  that'led  to  its  creation"),  and  the 
criticisms  remain  today. 

Yet  despite  this  unhappy  situation,  there  have  been  relatively  few 

significant  Initiatives  to  strengthen  the  personnel  base  of  the 
3 

field.      And  even  more  rer^arkable,  our  knowledge  about  this  personnel 

base  has  advanced  little  over  the  past  decade  or  so.    Until  ^;IE 

undertook  its  KPU  Monitoring  Program  organizational  survey  a  couple 

of  years  ago,  ve  vete  still  at  the  rather  rudimentary  level  of  simply 

trying  to  estiMte  the  numbers  of  people  we  are  talking  about.  Only 

now  are  we  beginning  to  get  hard  data  on  numbers  .of  personnel  carry- 

^  ing  out  R/DST  functions  in  various  kinds  of  organizations  active  in 

the  education  sector.^    Host  descriptive  information  about  the  field's 

5 

personnel  base  was  produced  in  the  mid-'60s    and  described  the  situa- 
tion before  it  was  changed  somewhat  dramatically  by  the  transition  to 
organized  r/d&I  as  the  dominant  mode  of  functioning  {and  therefore  the 
requisite  skills  and  competencies)  has  be^n  commented  on  in  some 
insightful  articles  in  recent  years. ^    However,  there  has  been  almost 
no  empirical  study  of  these  new  modes  of  functioning^  or  their  impli- 
cations for  policy  requirements  to  strengthen  the  field's  personnel 
bas  e .  * 
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I,  ^  DEFIN^ITIQS  OF  PERSONNEL  BASE  OF  EDUCATIONAL  R/P^I 

To  avoid  confusion^  a  definition  of  who  we  are  talking  about  in  this 

chapter  would  seem  to  be  in  order.    The  personnel  base  of  the  educa^ 

tion  operating  system  in  this  country  is  comprised  of  well  over  tKree 

8 

TQilLion  education  professionals,.     However,  relatively^  few  of  :hes5 
in'structional  and  aduiinistracive  personnel  who  staff  the  operating 
system  carry  out  significant  amounts  of  R/Diil  activity^  and  fewer 
still  carry  out  R/DSI  roles  as  institutionalized  F^eci^slities. 

The  personnel  of  concern  :^  us  ht?re  in  tnis  charter  ?.re  those  vho 
play  ^ecialgzed  roles  in  research^  develop^ient ,  di^5eT>inaiion» 
"  inplenentation/u^ilization  support  or  other  linkage  activities^  eval- 
uation or  policy  research.    We  recognize  the -considerable  amount  of 
internal  innovation  and  practice-based  developne/it  work  that  go  on 
vichin  the  operating  system,  by  teachers^  adrainistrators^  and  others 
vho  have  not  been  assigned  speciali^ed  r/d&I  roles.*  v;e  ^shall  discuss 
this  practice-based  innovation  in  several  other  chapters  for 
instance,   those  on  development^  dissemination^  iziplenentation/utili^ 
zation^  infomation  flows^  and  outputs.    We  acknowledge^  tco^  that^ 
niuch  needs  to  be  knov*n  about  hov?  these  operating  system  personnel 
carry  out  these  roles  nore  effectively.    However,  in  this  chapter^  we 
have  restricted  our  attention  to'the  personnel  who  carry  out  institu- 
tionalized roles  in  educational  R/Dil^  and  this  should  be  clear  at  the 
outset* 
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11 .     THE  AVAIUSLE  LITEP.ATfRE 

The  relevant  literature  is  not  small.    Yet  we  Icnow  relatively  little 
about  the  specialized  personnel  base  of  educational  R/DSI/ 

For  convenience>  the  available  literature  can  be  categorized  in  terms 
of  several  concerns.     Sone  pieces  fall  wholly  under  one  heading^ 
others  touch  on  nore  Chan  one  cor.cern./  The  various  concerns  t\/at.  can' 
be 'J^^d  to  categorize  the  literature  are  as  lollovs: 

1^     c^TTieri'tary  or.  t\e  '^enerclly  -^diozre  q-ali-y  of  the  field^s 
personnel  base; 

2.    quantitative  estimates  of  the  nuzrbers  of  personnel  presently 
carrying  out  educational  R/D&I  roles  and  projections  of  the 

nusibers  of  such  personnel  likely  to  be  needed  at  various 

^     ^  10 
po  mts  m  the  ruture ;  \ 


3.     analyses  of  the  personnel  base  in  terns  of  productivity 

criteria  (e.g.  >  quantity  of  output  per  R/D5iI  professional);'''^ 

■  ' 

A.    analyses  of  the  distributiort^-eff  the  R/DSI  personnel  base 

across  functional  specialties  C^-g-  >  numbers  of  researchers> 

12 

developers ,  dissemination  spec ia lis  ts  >  etc  * ) J 


5.     analyses  of  the  distribution  of  the  R/D&I  personnel  base  " 
across  organizational  settings  (e.g.,  numbers  employed  in 
academic  ins t i tut  ions >  in  LEAs,  in  SEAs,  in  non-profit 
research  corporations,  etc); 

6*     e'xanvinations  of  the  professional  backgrounds  and  career 

lines  of  educational  r/D&I  personnel  (e.g.  >  disciplines  in 

which  they  vere  trained,  work  experience,  career  lines> 

14  "  * 

professional  orientation^  etc.); 
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V 

f  d 

Cage>  sex>  education>  minority  status>  etc-); 


analyses  of  deniographic  data  on  educational  r/DSiI  personnel 

15 


8.    analyses  of  the  organizational  settings  i5l  which  r/d^1  is 
carried  out  and  the  implications  of  these*  settings  for  the 
kinds  of  Competencies  and  patterns  of  functioning  demanded 
of  personnel ; 

9/    analyses  of  tne  conpetencles  (knowledge,  skills,  and 
sensitivities)  re<:juired  to  carry  out  various  R/D5rl 
sp'^cialties  ar^d  consideration  of  the  implications  for 
training  prog'ra":s  or  for  s^jch  possibilities  as  certification 
of  R/D&I  persor.nel ; 

10.  descriptions  and/or  assessments  of  training  prograuis  and 

other  initiatives  that  have  besn  undertaken  to  upgrade  the 

18 

personnel  base  of  the  field; 

19 

11.  descriptions  of  models  for  new  training  programs;      and  j 


12.    discussions  o^  various  options  that  raight  be  pursued  to 

20 

strengthen  the  personnel  base  of  the  field- 


Based  on  this  literature>  several  sunmary  statements  seein  justified 
as  to  both  the  progress  that  has  been  made  over  tHe  past  decade  or  so 
and  the  continuing  sources  of  weakness  in  the  field's  personnel  base- 
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III.     EXPA.NSIO>:  OF  THg  PERSO^;^'EL  BASF. 

The  specialized  educational  R/Dirl  personnel  base  has  undergone 

substantial  expansion  in  the  past  decade  or  so.    In  comparison  to 

the  mid-'60s,  the  educational  r/D&I  personnel  base  has  doubled 

(perhaps  tripled).    The  best  estimate  was  thad  the  R/D&I  system 

21 

personnel  base  in  1964  totalled  about  A, 000  persons.        In  1974, 
several  estimates  suggest  a  mean  figure  of  about*  10>000  persons 
(estimates  range4^^i:<Sn  8-12,000,  and  higher  or  lower  esti:r,ates  can 
be  found,  deDending^  on  one's  definition  of  an  educational  R/D&I 
system;)  .  / 

Clearly,  then,  considerable  development  of  the  personnel  base  is 
evidenced  in  terr.s  of  sheer  numbers.    However,  it  is  not  entirely 
clear  at  this  tine  whether  the  overall  quality  of  the  personnel  in 
the  fi^ld  has  improved.     In  some  fields,  such  as  basic  research, 
there  has  been  some  concern  that  funding*  expanded  more  rapidly  than 
what  could  be  abSorb'ed  productively  by  the  existing  high  ^/jality  base 
of  researchers,  attracting  substantial  numbers-  of  researchers  with 
less  impressive  credentials  than  those  who  had  previously  dominated 
federal  research  funding.     (We  consider  this  point  further  in  our 
chapters  on  research  and  funding.) 
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IV.     CRITIC^L  WEAKNESSES  IN  THE  PERSONNEL  BASES 


Despite  whatever  gains  have  been  made  over  the  past  decade  and  a  half, 

the  literature  suggests  that  the  educational  R/D6tl  personnel  base  is 

23 

still  Inadequate  in  sh^eie  numbers.        In  addi^ptoTT7  several  other  factors 
suggest  that  the  personnel  base  may  be  the  syste[ii*'s  most  critical  point 
of  weakness,  and  nhe  most  difficult  to  overcome. 


1 .  Func  t iona 1  Imbalance 

Although  we  will  hp  in  a  much  'stronger  position  to  arrive  at 
judgments    on  these  questions  when  the  data  from  IJIE^S  Education  KPU 
Monitoring  Program  organizational  survey  become  available,  existing 
data  suggests  that  the  educational  R/D6tl  personnel  base  'is  dispro- 

24 

portionately  concentrated  in  research,  evaluation, research  and  developnient; 
is  critically  sparse  in  dissemination;  and  almost  totally  absent  in 
functional  specialties  that  are  just  emerging  or  have  yet  to  emerge  ^e<g*, 
need  identification  j  -;acquis  it  ion,  and  implementation/utilization  support) . 

2.  Inadequate  Supply  of  Trained  R/h&l  Managers 

It  also  appears  that  the  field  suffers  particularly  from  the  lack  of 

an  adequate  supply  of  trained  or  experienced  R/D&.1  managers,  or  even  an 

appreciation  of  R/d&J  management  as  a  function  that  could  benefit  from  ^ 

25 

specialized  skills  and  training. 

Backgrounds  and  Training  ^ 
« 

By  training  and  professional  background,  educational  ^/D6tl  personnel 

tend  , to  come  out  of  either  the  psychology/sociology  statistical  research 

26 

tradition  and  the  university  environment      or  out  of  school  system 
positions  (e.g. J  teachers  or  administrators). 

4 

With  few  if  any  training  programs  geared  to  producing  R/D6tl 
specialists  (arid  the  few  that  have  been  available  geared  more  to  the 
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pattern  of  academic  project  research  rather  than  programrnat ic  devel- 
opment),  on-the-job  training  has  be(>n  the  primary  mechanism  for  prc^- 

At 

ducing  personnel  with  appropriate  %kills  and  competeacies  an 
inefficient  strategy  at  best.    Some  initiatives  have  been  taken  to 

develop  training  programs  more  suitable  to  the  needs  of  educational 

27  *  • 

R/D6I  , functioning.        But  as  yetj  it  is  too  early  to  detect  a  signif 

icant  change  in  the  character  of  the  system's  personnel  base* 


356 

V,*  SOME  SEEMINGLY  IOTRACTA8LE  F[lQ8LE^tS 

The  recruitment,  training,  and  socialization  of- a  talented  personnel 
bas«  for  educational  R/D£tl  will  require  ovorcomlng  several 'seemingly 
intractable  proJ)lems>.  for  example;     x  ,  *  ^ 

I,     the  low  prestige  of  Education,  educational  research,  and 


educational  R/D6I; 


the  orientations  of  most  of  those  who  come  ou^ft^ffij^lverslty 
^settings  toward  advancing  theory  rather  than  improving 
practice;  toward^indlvlcLiallstlc  rather  than  team  functioning; 
toward  relatively  homogeneous  irathar  than  heterogeneous 
personnel  skill  mixes;  toward  producing  publications  rather 
than  products  or  ptograms;  towibrd  a  professional  rather  than 
a  bureaucratic  style  of  functioning  and  n^nagement; 

A  - 

the  complexities  of  developing  suitable  training  programs, 
given  the  ambiguity  that  surrounds  the  definition  of  work 
roles,  requisite  skills  and  standards  for  various  functional 
specialties  in  the  field  and  the  weakness  of  the  existing 
knowledge  base;  *  ^  ■         '  ^ 


4.     the  Instability  of  FStD6:f  funding;  and 


i 


the  insecurity  of  R/D^I  positiolS?>f ompared  to  tenured 
university  posts-  ,  ^ 


9 


VI,     POLICY  ISSUES 

1,    ?a.ies  at:  which  the  personnel  Base  Can  Be  expanded  for  Different 
ruf^ctions  ^  9 

/^ur  Icnowledge  of  other  R/D6I  systems  suggests  that  the  rate  at 
which  the  personnel  base^can  be  expanded  varies  among  R/d&I  system 
functions,*  In  research  (and  to  a  lesser  extent,  development),  the 
rate  is  depemdent  on  the  number  and  s^ze  of  the  existing  centers  of 
excellence  (which  alone  can  provide  the  training)  and  is  a  long  term 
process.    For  the  linkage  functions  (dissemination  and  to  a  lesser 
excer,:  developmeat) ,  training  programs  can  be  developed  at  relatively 
nodcst  levels  of  funding  and  personnel  trained  withia  a  relatively 
shor:  time  frame.    However,  training  in  these  functions  will  be 
constrained  by  (1)  rates  and  levels  at  which  users  can  reasonably 
absorb  their  out'puts  and  ^2)  the  .relative  lack  of  codification  in 
the  ^^wledge/technology  tSases*    Thus,  merely  investing  dollars  in 
tra5?;iing  is  not  alvays  wise  or  effective, 

2'.    Aztractln^'  First-Rate  Personnel     ,  ; 

There  has  been  much  criticism  j^f  educational  R/D&I  for  its 
failure  to  attract  eminent  r&searchers  and  first-rate  younger  talent 
froa  the  disciplines.    But  Is  it  possible  to  attract  talented  per- 
sonnel to  educational  R/D&I,  given  the  present  poor  quality  of 
system  outputs  and  the  resultant  inability  to  overcome  the  system's 
low  _^re3tige?    Is  it  reasonable  f,o  try  to  intervene  now  in  the 
ma'u^ation  of  the  system's  .personnel  base?    Or,  is  it  wiser  to  coa-^ 
centrate  resources  on  a  few  key  projects  where  the  critical  taass  of 
talent  already  exists  and  impressive  levels  of  achievement  are  wit^^in 
reach?    Will  a  few  exciting  high  quality  R/D&I  outputs  do  more  to 
attract  talented  personnel  than  resource-building  strategies  focused 
on  recruitment  and  training? 

High  level  debate  "bn  these  questions  wottld  seem  to  \Se  in  order, 
leading,  one  would  hope,  to  lon^-range^planning  of  interrelated 
product  development  and  r^sdurce-bui,lding  strategics*  to  speed 
syst-jr^  fnaturati'on  + 
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For  inscance>  s^e  conunents  in:  ^  Daniel  E.  Griffiths>  Research 
in  Educational  Administration:    An  Appraisal  and  a  Plan  (New 
York:    Teachers  C6llege>  Columbia  University>  1959;  Nichoias  ^ 
A.  Fatt'u>  '"The  Role  of  Research  ^n  Education  —  Present  and 
Future>"  Review  of" Educational  Research^  Vol.  30,  No. ^5, 
December  1960>  pp  409-421;  Robert  Bargex,  Egon  Guha,  and  Cora- 
hanrf  Okorodudu>  Development  of  a  National  Register  of  Ejduca- 
tional  Researchers,  Cooperative  Research  Project  No.  £'6U 
CColumbuSj  Ohi^o:    'The  Ohio  State  University  Research  Founda- 
tion>  1965);  Paul  F.  Lazarsfeld  and  ^am  D.  Sieber,  QrRa'nigjnfi 
Educational  Research  (Englewood  Cliffs;    Pren tice-Hall >  1964)5  ^ 
San  D.  Sieher  and  Paul  Lazarsfeldj  The  Or^anigation  of  Educa- 
tlonal  Research  in  the  United  States^  Cooperative  Researcji 
Project  No.  1974  (^vdwOfork:     Bureau  of  Applied  Social  Research> 
Colujmbia  University,  1566)  ^  Guy  T.  Buswell,  T.       McConnell>  Ann 
M.  He^ss>  and  Dorothy        Knoel>  Training  for  Educational  Re- 
sear       Cooperative  Research  Project  Mo.  51074  (Berkeley:  Cen- 
ter  for  the  Study  of  Higher  Education,  University  of  Califomii 
196^4;  Egon  G.  Cuba  and  Stanley  Elam>  ed^t  >  The  Training  and 
Nurture  of  Educational  Researchers^  Sixth  Annual  Phi  Delta 
Kappa >  1965);  and  see  discussions  of  how  the  personnel  base 
of  the  field  was  viewed  at  the  tima;  asjjdescrlbed  in  Plchard 
Dershimir>  The  Federal  Govermment  and  Educational  R£tD  (Lex- 
ington>  Massachu^tts :^    Lexington  Book^>  1976).    For  sairifH-es  of 
continuing  criticisms  of  ^he  personnel  base  of  the  bield  over 
s^he  next  five^years  or  so>  see:     David  L.  Clark  and  John.E. 
Hoprclns>  A  Report  on  Educational  Research,  Development^  and 
Diffusion  Manpower.  1964-197^4  (Blomington :    Indian  University 
Research  Foundation>  1969);  Lee  J.  Cronbach  and  Patrick  Sup- 
p^rs^  eds>  Research  for  Tomorrow's  Schools^    Disciplined  In- 
quiry for  Education  (Mev^York:    Macm^llan,  1969);  Ronald  G. 
Corwin  and  .Maynard  Seider>  "Pattem^'qf  Educational  Research: 
Reflections  on  Some  General  Issues>^'  irf  The  Educational  Re- 
search Commufiity:  '  Its  Conmuniration  and  Social  Structure.  Rich- 
ard Dershicnir>  eJ\  (Washington  r    American  Educational  Research 
Assoclation>  1970)>  ERIC  ED  Obi  275;jVlfred  Yates>  ed ,  >  The 
Rote  ofRefsearch  In  Educational  Change  (Palo  Alto:  racific 
^o\s..^^^lJ.)^  and  Carolyn  Persell,  The  Quality  of  Research  on 
Education:    An  Empirical  Study  qf  Researchers  and  Their  Work 
(New  York:'    Bureau  of  Applied  Social  Research  >  Columbia  Uni- 
7er;ilty>   !97]).    Tor  dn""evGn  fnore  current  version  of  the  sarne 
critique;  see:"  Roald  F'/ Camobpl]  Qt  al.,'"RfiiD  Funding  Poli- 
cies of  the  N'atioT^al  Institute  of  Education:    Review  and  Re-  , 
comniendacions  (Washington:     :;iE;   1975).  "  "  " 

For  instdnee>  seethe  description  of  the  1964  Gardner  Task 
Force  view  of  thi^  in  Dershlmlr\  The  Federal  Covcrnment  and 
Ed'jc^tlonal  ^h^j  op.  cit.  *  '  " 


There  haVd  beagi  a  fx^v  notable  exce^ltions  to  this,  such  as:  the 
Graduate  Research  Training  Program  and  the  grants  made  with  the 
assistance  of  the  Conmictee  on  Basic  Research  in  Education  of 
the  National  Acadeny  of  Sciences"  National  Research  Council. 
Hovever,  both  of  these  prograns  and  inost  federal  support  for 
j-esearch  training  programs  ended  in  the  late  I960's.    We  shall 
consider  these  matters  later  in  the  chapter*    One  other  excep- 
tion here  is  "the  creation  of  the  National  Academy  of  Education 
ccTTiprised  of  eminent  leaders  of  the  field>  and  this  organiza-- 
tion  is  still  functioning. 

At  the  tirie  this  chapter  was  drafted,  we  had  not  yet  seen  the 
findings  from  NIE!s  Education  fOPC  Monitoring  Program  organiza- 
tional survey  carried  out  by  the  Bureau  of  Social  Science  Ro- 
s^iarcrjlnc.  However,  by  the  clr:^;  tMs  volune  is  published, 
these  data  should  be  available  to  the  field. 


For  instance:     Barger,  Cuba,  and  Okorodudu,  Development  of  a 
National  Register  of  Educational  Researchers,  op .  cit ■ ;  Bus- 
well,  McConnell,  Hei3S>  and  Knoel,  Training  Cor  Educational  * 
Research,  op ■  cit.  ;  Cuba  and  Elan,  The  Training,  and  Nurture  of 
Educational  Researchers ,  op.  cit.      -  ^ 


For  instance,  Konald        Corvin,  Beyond  Bureaucracy  in  Educa- 
tional Research  Mariagemer.t ,  in  The  Generator  (Division  C  AERA 
Newsletter),  Vol.  5^  Na.  2,  Winter  1975;  and  William  A.  Fire- 
/st^one,  "Educational  Field  Research  in  a  'Contract  Shop,'", 
The  Generator  (Division  G  AERA  Newsletter)  >  Vol.  5,  No.  3, 
Spring  1975* 


One  notable  exception  here  are  The  Oregon  Studies  in  Research, 
Developnentj  Diffusion  and  .Evaluation  (Manniouth >  Oregon:  Teach- 
ings  Research  Division,  Oregon  State  System  of  Higher  Education, 
1972).    The  Stiidy  director  was  H.  Del'  Schalock.  Vo^me  IV  pre- 
sents tuetXry^ase  studies  of  r/DoiI  functioning .    The  f IndiT^s 
are  summarized  in  Volume  I* 

ijptional  Institute  of  Education,  The  Stat^is  of^ducation  Re- 
search-an^  Development, in  the  United  States;     1976  Databook*   ,  y 
(T/ashington:    NIE,  1976).  ) 

These  sources  include  thje  references  cited  abcrve  in  footnote  I. 

ME,  1^76>  Databook,  op.  cit  ■  ;  Phi  DeltG-  kappa/,  National  Reg- 
iscer  oF  Educational  Researchers  (Blooraington,  Indiana;  ?DIC, 
1966);  Clark  and  Hopki:ns ,  A  Report  on .  Educational  Research^  ' 
development^  and  Diffusion  ^V^power,  og_^__cit  * ;  and  John 

■        V,  /■ 

■  \ 
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'■  /  ' 

Hopkins >  An  Updating        the  Clark-Hopkins  Manpower  Projectionsr 
AERA  Task  Force  Technical  Pager  No.  25  (Washington:     AERA,  1971)/ 

11.     Barger  et  al..  Development  of  a  National  Register  of  Educational 
Researchers^  op .  cit . >  and  Cronback  and  Suppes ,  Research  for 
Tomorrow's  Schools jOp.  cit. 


12.  NIE,  1976  Databook.  op.  cit.;  Clark  and  Hopkins^  A  Report  on 
Educational  Researchi,  Development ,  and  Diffusion  Manpower^ 

00.  cit .  :  and  Hopkins  ^  An  Updatin'g  of  the  Clark-Hopkins  Hanpover 
Proj^j^J^ons^. 

13.  Ibid, 


14.  lb  Id , ; ' Egon  G,  Cuba,  The  Place  of  Educational  Research  in  Edu- 
cational Change  >  as  reprinted  in  The  Oregon  Studies,  op .  cit . ,  i 

'        Vol.  II;  B.  K.  Worthen  and  H.        Byers^  An  Exploracory  Study  of 
Selected  Variables  Related  to  the  Training  and  Careers  of  Educa- 
tional Research  and  Research-R-^lated  Personnel  (  Washington: 
AERA,   1970);  B.  R.  Worthen>  R.  D.  Anderson,  and  M.  Byers> 
A  ^tudy  of  Selected  FactQrs  Related  to  the  tr^aining  of  Research- 
erSt  DeveloperSj  Di^fusers^  and  Evaluators  in»,EducatiorF  (Wash- 
ington:   AERA,  1971);  John  E.Hopkins  "arvd  Blame  R,  Vorthen,  An 
'  Analysis  of  Characteristics  of  1969-70  Trainees  in  Title  IV 
Graduate  Research  Training  Prd^a^Tis  and  a  Comparison  with^Sie- 
bers  Study  of  1966-67  Trainees  (Washington:    AERA,  1970J; 
Bernard  J-  Fleury,  Jr.,  Ermma       Cappelluzzo,  and  Wi  C*  Wolf, 
Jr,  ,  "Demographic  Data  for  Trainers  of  Educa^onal  Researchers,^' 
Educational  Researcher  (Nevslettj^r) ,  Vol.  21,'  April  1970;  Blaine 
R.  Worthen  and  John    E.  Hopkins,    *A  Conmentary  on  the  Quality  of 
Trainees  in  Title  IV  Graduate  Research  Training  Programs/'  Educa-   ■  ^ 
tional  Researcher  (Newsletter),  Vol.  22  (June  1971),  pp, 
See  especially  demographic  data  on  AERA  members  published  anijualj^y 
in  the  Educational  Researcher,  such  ^s  Arliss  L.  Roaden  and  Blaine 
R.  ;;orthen,  "A  Profile  of  AERiV  Men'b^rs  as  Researchers , "  Educational 
Researcher  (Newsletter)  ,  Vol.  21,  October  1970;  and  Joe  A*  Johnston, 
"AERA  MeiT^}>ers:     A  Profile,  1969;"  Educational  Researcher  (Ne^jsletter) , 
■Vol.   21,  Decenber  1970, 

15.  Ibid , 

\ 

16.  Of  particular  value  here  are  The  Qre^on  Studies,  op;  cit.,  especi-  ^ 
ally  Volur.es  1  and  IV;-  and  Convin,  "Beyond  Bureaucracy  in  Educa* 
tional  Research  ^^anag€ment , op.  cit. 

17.  See  especi'ally  Schalock ,  Thomas,  Morse,  Smith  and  Arrinersman,  The 
Qrej>on  Studfes,  Vnl*   I.,  op .  'cit.;    H,  Del  Schalnck  anc3  G.  Roger 
SpII,  '*A  P'ranework  for  the  Analysis  an^l  Empirical  Invi^stigatfoh  of 
Educational  R>  D.  D  and  E,''  in  The  Qxej;on  Studies,  Vol.   Ill ,  op. cit. 
B.  R.  Worthen  and  R-  M,  Cagne,  The  Development  of  a  Classification 


Systeiri^  fsr  Functions  and  Skills  Required  of  Research  aad  Research- 
Related  Perbonn^I  in  Educatic^n^  Technical  Paper  N'o.  1  (Boulderj 
Colorado;    /i£RA  Task  Forc£  on  Research  Trainingj^Laboratory  of 
Educational  ^l^^search,  ^University  of  Colorado,  1969),        R.  Worthen 
and  J.  R*  Sanders,  The  Development  of  an  Interview  Technique  to 
Collect  Data  on  Inpo^^nce  and  Availability  >of  Selected  Competencies 
in  Research^  DevelopT?.ejU  jl  Diffusion ,  and  Evaluation  (Boulder^ 
Colorado :    Laboratory  o£  Educational  Research University  of  Colorado, 
1970);   ^J.  R.  Sanders  aftid  3,  R.  Worthen,  An  /gfaiysis  of  Enplovers* 
Perceptions  of  the  Relative  Importance  of  Selected  Research 
Research-Related  Competencies  and  Shortaiges  of  Personnel  vfith  Sucn 
Competencies  (Boulder^  Colorado:    Laboratory  of  EducatlPnal  Research, 
University  pf  Colorado^  1970);    G.V.  Glass  and  B.  R,  Worthei;*^ 
Interrelationship  Among  Research  and  Research-Related  Roles  i:^ 
Education:    A  Conceptual  Frar^.ework  ,  Technical  Paper  No.  (Boulder, 
Colorado;    AERA  Task  Force  on  Research  Training^  Laboratory  of 
Fducational  Research,  University  of  Colorado,  1970);  V.  Glass 

and  B.  R.  IVorthen^  Essential  Knowledge  and  Skills  for  Educational 
Research  and  Evaluation,  Technical  Paper        (Boulder,  Colorado:  >_E:R-A 
Task  Force  on  Re^eaych  Training,  Laboratory  of  Educational  Research, 
University  of  Colorado^  1970);    A,  R,  Coller,  A  Taxonomy  of  Pro^rar:- 
matic  Tasks  in  an  Educational  Evaluation  Facilitation  and  Coordination 
Sysneni,   (Northf  ield,  Illinois  r    Cooperative  Educational  Research  ' 
Laboratory,  Inc.,  1970  (USOE  Contract  OEC-3-3061391      306l) ;    R.  D. 
Anderson,  J.  M.  Soptick,        T.  Rogers,  and  B*  R,  WortKen,  An  AnaXvs-is 
and  Interpretation  6f  Tasks  and  Competencies  Required  of  Personnel 
Conducting  Exenplary  Research  and  Research-Related  Activities  In 
Education  Technical  Paper  ^^23  (Boulder  >  Colorado!    AERA  Task  Force 
on  Research  Training^  Laboratory  of  Educational  Research^  University 
of  Colorado^  1971);     B.  R.Vbrthen,  Some  Tasks  and  Corgoetencies 
Frequently  Required  in  Educational  Research'and  Evaluation,  Research, 
Evaluation  and  Development  Paper  No.  5  (Portland,  Oregon:  Northuest 
Regional'  Educational  Laboratory,  197A);    B.  R,  Worthen,  ^'Competencies 
for  Educational  Research  andlEvaluation,"    Educationaj.  Researcher, 
Vol.        No.  1,  January  1975;  \and  Robert  M,  Gagne>  ^'Qualifications 
of  Professionals  in  EducationarTJ^D/'    Educational  Researcher^  Vol*  4, 
No,  2y  February,  1975, 

t  ^ 

For  instance,  Guba  and  Elam,'  eds..  The  Training  and  Nurtur^e  of 
Educational  Researchers ,  op>  cit.;    Buswell  et^al^,,  Traini^^  for 
Educational  Research,  >op.  cit.;     Sai\       Sieber,  Analysis  of  USOE  • 
Research  Training  Programs ,  1966-67^ (New  York:    Bureau  of  Appliec 
Social  Research*  1968);     B.  R.  Worthen,  The  -Impact  Qfe>Researrch 
AssistantVhip  Ex^eVience  on  Subsequent  Development  of  Educational 
Researche^s>  Unpublished  Dissertation,  Columbus*  Ohio:  Evaluation 
Center,  Ohi^  State  University,  1968);     B.  R.  liorthen  and  W,  J. 
PophaiTi,  Research  Training  Activities  Stinulated  by  the  AERA  Task 
Force  on' Research  Training  1969-70  (Boulder,  Colorado:    AERA  Tas;; 
Force  on  Research  Training^  Laboratory  of  Educational  Research, 
University  of  Colorado^  1970);    J,  R,  Sanders  and  G.  E.  Hanna^  A 
'purvey  of  Tr;=iininK  Prograns  of  Selected  Professional  Associations 
^Boulder,  Coloradoi    AERA  Task  Force  on  Reisearch  Training,  Laboratory 
of  Educational  Resea;rch,  Univtirsity  of  Colorado,  19^0);     Kon  Ual'<er^ 
*'The  Future  of  USOE'^s  Re^;earch  Training  Program?'^  Educat'ional 
Researcher  (Sewsle^ttjer) ,  Vol.  21^  At>rll  1970;    B.  J.  Fleury,  E.  M. 


f 


Cappellu230,     and  W,  C.  Wolf>  Education  Resea-rch  Training 'Prograr.s : 
Requirements  for  Adniission(Anhersc:    Univc^rsity  of  Mass,  ^  1969)  ^ 
Minieo;     Gary  Hanna,  ^'Research  Trainingi"  ^New  Programs  Ene'rging/' 
Educational  Researcher  CSews le t ter)  >  Vol .  21>  May  1970;     Erid  R, 
Rudi^  "New  Graduate  Programs  and  Structures  with  Specific  Emphasis 
on  Institutes  and  Centers/^  Journal  ^f  Research  and  DevelQ:^T>ent 
in  Education,  Vol.  5\  No,        Summer  1972;         James  Pophan,  "Getting 
in  Trainiag:    A  Decade  of  AEPjV^s  Efforts  to  Prevent  Professional 
Obsolescencs>"    Fducational  Researcher>  Voi.  3,  No*  A,  April  1974; 
Williarn  J.  Russell,  '^AERA*s  Research  Training  Program:  Reaching 

LOutt'^  Educational  Resear<f^er,  Voir  4>  No*  11>  December  1975;  and 
Phi  Delta  Kappa,  Evaluation  Training  Catalogue  (Bloomington,  Ind.; 
PdK>  1975)*    There  have  been  other  sorts  of  initiatives  to  strengthen 
the  personnel  base,  notably  the  COBRE  effort  to  attract  basic 
researchers  frop  the  disciplines,  as  described  in;    Joha  B.  Carroll 
and  Patrick  Suppes>  "The  Corj^^lttee       Basic  Research  in  Education: 
k  Four-Year  Tryout  o:  Basic  Science  F-iiading  Procedures,"  Id\:C£:tir;raI 
Researchers  Vol,  3>  N'o,  2>  February  197^;     COBRE,  Final  Roport  of 
the  Couiftiittee  on  Basic  Research  in  Education  (IVashington ;    !^*a clonal 
Academy  of  Sciences  -  National  Research  Council,  1972);    and  Caineron 
Fincher,  "COBRE  and  the  DIleTrimas  of  Basic  Research  in  Education  >" 
Educational  Researcher^  Vol.  3,  No.  2>  February  197A*  ^ 

19.  instance>  see:    D.  L.  Stufflebean  Proposal  to  Design  New  Patterns 
f^^'^'^aining  Research,  DeveloDrnent-,  Demonstration/DisserT^ination  and 
paluatlon  Personnel  in  Education  (Washington:    DHEW>  1970);  Paul 

^tiood^  Final  Report  of  a  Debi^n  of  a  Survey  for  Determining  Training 
/ and  Personnel  Requirements  for  Educational  Research,  Development^ 
^    Dissemination  and  Evaluation,  2  Volumes  (Berkeley:     Far  West  Laboratory 
for  Educational  Research,  Development  ,^  Dissemination  arrd  Evaluation, 
1972);     Richard  A.  Dershimer,        James  Pophani^  and  William  J. 
Russell,  Development  of  Training  Models  for  Educational  Research: 
A  Conceptual  Scheme  for  a  Professional  Association  (Washington: 
AERA,  1973);    A.  'Jwaideh  and  J.  Knowlton^  Proposal  for  a  Two-Year 
Fellowship  Progra.-n  to  Train  Educational  Effusion  Specialists 
(Blooraington ,  Ind  .  ;  'Audio-Visual  Cen  ter  ,  Indiana  University ,  1970)  , 
mimeo;     W,   L.  Goodwin  and  B.  R.  Worthen ,  Design  Specifications  for 
the  Developiient  of  Simulation  Materials  for  Training  Educational 
Researchers     (Boulder,  Colo.:  AERA  Task  Force  on  Research  Training, 
Laboratory  of  Educational  Research,  University  of  Colorado,  1970); 

James  Pophan,  Final  Report >  Development  of  a  Pilot  Library  of 
Cassette  Tapes  Dealing  With  Recent  Advances  in  Strategies  and  Features 
Of  Educational  Rcgearch(Washinj:ton:    USOE  'Project  No.  00729  ,  1971), 
Note  also  that  the  Oregon  Stu^^s  volumes  were  initially  put  together 
with  some  thought  of  providing  basic  materials . for  new  training 
programs* 

20.  See  for  in.<;tance:     Cronback  and  Suppes,  Research  for  Tomorrow's' 
'SchooJ-S ,  op .  .cit ;     and  Richard  E*  Schutx,  ^'Now  is  the  Future  for 

R^D  Training  in  Education/'  Educational  Rcg^-archer,  Vol,  2,  No.  3, 
May  1973.  '  ^ 

21.  For  instance,  see  Roald  T\  Campbell  et  al .  ,  R&D  Funtfln^  Policies  of 
jhe  Natjlorl^l  Institute  of  Education:     Review  and  Recommendations 
(Washington;*    :;IE,   1975);     Mt^,  1976  Da-tabook ,  op.  cit. 
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22,  ^llE,   1976  DatabQOk>  op.  cit. 

23,  Scja  The  Oregon  Scudies,  op>  cit>  VolTy  I- 

24,  N'lE,  1976  Da^abook^  oiJj__Qit^. 

25^  For  instance>  see  the  references  cited  above  in  footnote  19. 

26.  Ronald  G.  Corwin  and  Saad  Z.  Nagi*  **The  Case  of  Educational  Research," 
in  The  Social  Contexts  of  Rese3rch>  Saad  Z.  N'agi  and  Ronald  G, 
Corwin^  eds,  (New  York;    Wiley,  1972)."^ 

27.  This  viewpoint  is  suggested  at  one  point  in  Marc  Tiicker>  Mary 
Harahany  Berlin  Kelly,  VJard  Mason » and  Saul  Yanofsky^^  Building; 
Capacity  for  Renewal  and  Reforr^:    An  Initial  Report  on  Knowledge 
Production,  and  Utilization  in  Education  (^'ashingtop :    llll,  1973). 
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d'f  Sill  the  aspects  of  R/D6!lf^we  consider  in  our  analytical  frarnework,. 
Che  one  that  probably  Qost  ^gnifica^ly  iriyf^accs  and  deterciines  the 
,^hape  of  al^  ^|^er^  is  fending.     It  largely  determines  what  r/D^I 
activities  Will  (and  will  ^ot)  be  carried  out^and  by  whom,  lAdlre 
it  thereby  shapes  what  r/DSJ?  funq^^s  will  be  Ueveloped^  what  sores 
of  insciLutional  and\^personnel  bases  will  be  strengthened^  what  sorts 
of  Capacities  will  be  developed  (and  where). 

Despit:i  tne  obvious  policy  signi f icafe^  of  data  o^  these  bas^c 
descriptive  sorts  of  rnatters,  until  recently  there  ha^  been  little 
solid  inforniation  about  hpw  educational  R/D^I  funding  is  distributed 
across  functions^  performer  insJtitutions,  activities;  etc.    Over  the 
*J)ast  f??w*yearSj  there  has  been/a  considerable  amount  of  analytical 
effort' focused  on  tljes^  natters. I  Although  there  are  still  substantial 
gjps*  in  what  is  known^  we  have  far^nore  understanding  of  this  now  than^ 
only  a  few  short  ye^x/k  ago.     In  addition^  som^  key  issues  of  funding 
policies  have  been  t4ckl$"^artd  discussed  in  the  literature,  reflecting 
several  of  the  criticaVvfunding  concerns  debated  in  the^i^ld.  We 
shall  attempt  to  review^^nd  assess  much  of  this  he^je.  ^ 


Our  analysi^  in  this  chapter  Is  presented  An  five  sections.  First, 
provide  a  broad  overview 'of  the  literature,  describing  the  kinds 
of  discussions  of  educatiional  R/D£tI*f;/^diag  that  ^re  ava^ilable. 
Second,  we  take  note  of  the  various' types  of  problerr^s  in  educationally  \ 
^/Dc<I  funding  that  are        cu$Sed  in  the  literature.     In  a  third  section 
we  suTO:iariEe  the  findings  c^f  various  anaifyses  o'f  the  ^distribu  t  ion  of 
^ducational  R/D^iI  across  funding  sou^^ces,  functions^  performing  insti- 
Miiition^,  activities,  etc.  also  consider  funding  data  that  ^ may  ■ 

soon  be 'available  frOi-v^TKE'^  KPU  Monitoring  Program,    We  then  turn 
to  a  nuTibVr       signi^icani  finding  policy  issues  that  have  beert 
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debated  ia^ recede  years,  examiae  various  optioas  chat  have  beea  coa- 
sidertd,  and  3^t;ci.i),ate  about  contextual  factors  t^h^  may  have  influ- 
enced che  coutrse's"of  action  tak'en.     Finally,  we  identify  a  nuniber  of 
fOndip.g  policy  issues  yi  need  of  exploration  and  suggest  the  kinds 
of  data  agd  analyses  thac  seetn  to  be  called  for  Co  provide  a  sound 
basis  ror  policy  debate, on  such  issues. 
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1.       0;^RVI£W  Or  IKE  AVAlUBIi:  LITERATURE 


The  available  ii^emture  on  edacational  MDSI  fuaclin^  is  o£  thr^jt^ 


1,  pieces  Chan  refer  to  funding  issues  or  prot>IeQ:i  ^arc^ 
of  50^.e  l^roader  discussion  of  issues; 

2,  presentations  or  da:a  series  or  analyses  of  subs  tan:  lal 
^  bodies  of  f^jndlng  data;  and,  "  ^  t 

3,  policy  analyses  focused  on  funding  issues. 

I.      Broader  Discussions  that  Mpntioa  Funding  Issues  or  probl^ps 

Alnost  from  the  outs^c  of*  active  fdd^ral  involve:nent  ia  the  sponsorship 

of  edJcationa%^/D6l,  ani4  especially  since  the  creation  of  the  labs 

and  C'-:;:Tters,  funding  problesis  have  been  referred  to  in  the  literature. 

'Initial  expectations  for  high  (and  ever-increasing)   levels  of  fur.dir.g 

were  ^^jickly  dashed,  ^ad  the  Utt;rature  of  the  Xa^e  ^60s  is  f;.lied 

with  pleas  for  nore  fundin|,  more  stable  allocations>  longer  funding 
/        ^  1 

J  N^ycle^j  etc.      Many  of  the  same  points  are  made  in  more  recent  assess- 

fnehts  as  well  as  (fo^  instance>  the^rapbeil  Report's  recommendation 

^  ■  for  higher  levels  of  R££0  .funding >^  *or  San  Sieber's  call  for  greater 

ft  *  ' 

y         ^  ^*balance^\and  "continuiT!^^'  3s  two  design  requisites  for  5  national 

'  "  3 

t  t  RciD  s/sreni  f^ft"  education  ). 


S-^  l'::'.^r^?st  "n^  ^^tb  of  J  t^i : : : :  i  c  :^  ar«  miluded  iit  so-ie  oz  * 

^t:.jadei:  presentat  Lons  >  especially  to  buttress  the 'argiit^t  that  higher 

l^vt^W  of  funding  ar*^,  neede<i  to  cnabie  educational  R^^D  to  achieve  its 
I 

goal>.'  Oi^e  favorite  kind  of  statistic  examines  educational  R6D 
fiindi.n^  as  a  perce^iudg?;  of  total  education  expenditures  and  compares 
this  to  aliocatioiTs  Vnr  R6fD  in  other  sectors.      Another  provocative 

■\  .  ■'  V 
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use  of  statistics  is  che  USOE  Bureau  of  Research  'V'hat  night  be' 

analysis  described  in  the  OE  status  report        an  estioiate  of  the 
annual  need  for  development  funding  based  on  estimates  of  the 
(a)  total  nurnber  of  alternative  curriculum  units  that  should  be  ^on* 
sidered  for  developmenc  to  ?Sfter  the  full  r^ange  of  school  years  and 
subjects,   (b)  the  average  per-unit  development  costs;  and   (c)  the 
^^verage  numBer  of  years  required  from  conception  through  ^stalla- 
tion  for  a  given  unit.^    We'jhalL  consider  these  various  sets  of 
"^statisci's  Later.  ' 

k>      D'lto.  Series  or  Analyses  of  Large  Bodies  of  Fundin:^  Data 

s 

There  art;  currently  -four  large  bodies  of  data  on  educational  tk^^l 
funding,  and  a  fifdh  that  should  be  available  shortly. 


:;SF  Data 


The  first  of  these'  is  part  of  the  broader  body  of  data  on  federal 
furiding  of  all  RoD  published  annually  since  1952  by  the  National 
Science  Fourtdat ion '  s  Division  of  Science  Resource  Studies.  Edu- 
catior.  Kas  besei  analyze^^        a  separate  category  only  since  the 
analysis  published  in  1971.    The  1971  analysis  provided  data 
on  education  going,  back  as  far  as  1963" for  agencies  wita  educa- 
tion a5  a  prln^ar/ mi ssiDn  Iffcf;^.    The  1972  an|||Hsis  was  considerably 
broader  ii>  scope,  covering         federally  funded  acti^ties  that 
could*i>*i  categorized  as  educational  R^J)  regardless  of  the  ptir^ry 
missidn  of  th^  sponsoriug^agency;  however ,\  these  statistLCS  o"- 


l^^V.  S^jbsequ^TUi  ar*rua*l"  a^i^yseS  in  this  seri^  present  educa- 
tional KoD  data,  £at:  ati,  fpifSfral^^enctcs  ^or  1969  and^a^l  subst 
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£>      0MB  Data 

J 

A  second  annual  series  is  published  by  the  Office  of  Mana^c-:nent 
^  and  Sudgec  fOM3)  tor  subnission  to  Congress  each  January  along 
with  the  Preaidenc's  proposed  budget.    The  Special  Ar.alyses 
arc  desi|ndd'^^t^*4how  the  fiscal  impact  of  the  various  federal 
orograjTa  in  specific  funccional  areas.    Education  is  cne-of 
rnx:se  rum: :.onal  areas . 


'Z.-.-j  ::atior,al  kcXie--;  of  Sciences  (^iAS)  data  base  diff^rrs  fro-n 
trie  y^S?  ar,d  C>3  data  in  being  the  result  of  a  one-tirr^e  study 
ra:p,er  than  &n  ongoing  data  serie^   The  data  '.jer^  generated 
frcn  a  s:udy  of  social  RoD  shid  related  activities  in  15  'Social^* 
pclicy  arsas.     Education  wa^  onfe  of  thesjt  areas.    Xhe  final 
report  on  this  project  has  not  yet  been  published^  bui:  prelimi- 
nary data  have  beeja^avaiLable  to  reaearchers^and  agency  p-rsor-nel 
ai  least  since  1976^^ 


SRGData 


A  fourth  data  base  has  been  collected  by  the  Social  Research 
Crcjp  (SRGjy  of  George  ^rtashingion  University  for  the  Interagency 
panels  for  Researc|i  and  Deve lop!aeg.t  on  Early  Childhood  and 
Adolescence,  one  of  t>ie  interagency'' coordination  mechanisms  set  , 

up  by  the  federal  government,    SRG  publishes  annual  resorts  for 

*  9  ' 

zht  parcels  on  the  projects  spo^^iored  by  the  nvToer  a'^-^^^c  L^^s . 

Ihii  data  base:  is  available  for  special  analyses  and  a  number 
of  suJh  special  analyses  Iiave  be.en  conducted  by  NIE's  RciD 
S.^^iteTi  Suppor:  Divisj^on.  - 
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£.      Analyses  bv  rUE^s  R&D  Svsj:^:TrSifp?orC  Division 

The  XSF>  KAS,  aad  SRG  data  bas'es  provide  differea^c  cstirrLaties 

of  total  federal  funding  of  education  R6tDj  for  chey  differ  con- 
siderably on  a  number  of  key  dimensions  which  deternined  the 
kiuds  of  data  each  collected  and  .analyzed.    The  staff  of  NIE's 
R6!D  System  Support  Division  have  recently  published  a  nui^iber  of 
highly  useful  reports  which  identify  the  similarities ^and  dif- 
fert^nces  amng  these  data  bases,  describe  NIE^s  aps^oach  to  each 
of  th^  key  concep^Lual  ar.d  procedural  issues  on  which  these  <iata 
:>^^-^^  cl^ffer^  and  cnen  pr^s^rx  what  "iHisc  be  viewed  as  the  best 
current  fundir.g  es:i:nates  available  tHac  nake  optical  use  of 
the  :nforn^ation  provided  by  all  four  data  bases.    The  reports 
fortncoT^iag  to  dace  provide  estioates  of  total  federal  funding 
for  education  R6tD  ^nd  the  discribution  of  total  funding  acro.=;s  >i 
ag^ncieSj  functionSj  projecL  contentj  and  performing  organizations. 
The/  also  provide  inforrr^tion  abouc  how  agencies  differ  in  the 
fur.dmg  they  pro  /ide  by  function,  by  project  content ,  and  by 
perforrting  organizations.^^    V.e  will  consider  these  analyses  in 
so^e  detail  later  in  this  chapter.  ,  , 

?>*^..Tr^3  Educa^ior^  K?L'  Monlroring  Prograrn 

* 

liiZ'^  RLD  System  Support  Divi^^ion  has  plans  for  an  Education 

Viojiltoring  Progra'm,  developed. alon^i  lines  parallel  to  the 
:^ro.^ram  of  the  Science  Resources  Dii^ion  of  NSF.  The  inonltoring 
program  is  e^:pected  to  gathi^r  periodic  statistics  on  the  educati*inal 

tri'  ::H.r*^.v2se   inde rs: and i ng  ^c'"  system  f unct ion ing,  and  ev*il- 
'j^iti::;^^  o:   the  i-^act  of  various         systcrr  polis:^^  initintives. 
— ^^I-.  nd'Jltion,  the  I'on i:or in;;*',  t'ro^ra:;^  is  envisioned  to  include 
d.it.i-^ntheri^Do  ^"^^  special   i.^-'i^th  policy  studies  of  specific 
h'fZ  \      issues  . 


r 


*   The  pro:^ra.Ti  ha5*not*as  yet  rt_^(-c^ivt^d  anplc  f^nlin:;  far  ""^ro  Jthan 
a  ch^  pr^ilLTinary  projtjc^s-  Th^?  da Cii-t^ath^rin;;  and  analyse!^ 

leadm^^  to  the  publA:acion  of  che  1976  Da c a b o . k  *ere  first 
of  th€;se  projs;cts.  Tne  analyses  of  federal  funding  o:  edvic^ti  " 
K?L  r.enciorted  esrlier  al?io  fall  under  this  brcsd  prograr.. 

A  current  very  i::iportan"  project:  involves  a  ^^.r^/ey  of  all  orgarti- 
zatLons  iderj^tiried  as  RiD  perfcr?.er-».   Basic  mforr^acior:  is  b^i-^.;; 
^j^-tharcd  on:   f '^r.ding ,  personnel ,  R/Di* I  ac ti  vi  t  les  ,  nV'^b^  rs  of 
?  re  jG^  :3  ,  r  i  story  ,   invol ve"^.^-^,::  li  inter-c  r:^a"  .zat  ^'^^.nil  col  1^ 
^  >iJTauivt=  ar  rarriT.eri::3 ,  tt^.  Tii^sc:  cata  =hc'jl^  bsr  available:  rcr 
5-^^cri;jary  jrE^tlyst^^  in  1979-  It  '^^as  expected  w":at  tr^is  sur  'ey  .Ic 
be  repcaU;^  oo  a  p^Vilbdic  basL^^  and  that  it  vuld  proba:^ly  be 
expiT.ds?  and  supr^ le-rient^d       otr:sr  periodic  S-:r?eys  m  tr.e  future. 
a:  the  present  ti.'re,  however,  the'  f^cure  pro?p^ct"  for'^r^is^ 
^r:5.tiou3  program,  are ''unclear  *         ^  ^  ^ 

I:  ar.pie  fi^ndin^  for  chis  pro^rsn  is  not  forrhcor.iig  in  t: fut:ure> 

anjth^^r  possibility  for  usei  as  a  data  base  for  'ncr.itoring  ^d^ 

ucation  Y^'C  niigtic  be  expansion,  and  refinerienC  o:  the  Interagency 

Research  Information  Syster-  (IRIS;,   referred  to  earlier  as  the 

SRu  data  base.  :love7er>  given  rhe  projected  costs  of  such  a 

Droposalj  this  do^is  not  seeT;  to  have  received  art  enthusiastic 

response  frors  the  :nez^ber  agencies  of  the  Federal  Interagency 

Conr.Ittee  on  Education  (FICE)  Subcomittee  on  Education  RDDi^E 

11 

*jjruc-n  supports  th-^  riaintt^nance  of  this  data  base.        It  ren?iiris 
CO  be  seen  whether  or  no,t  the  creation  of  the  ?ede*sl  Council 
^/VizT\^3^^-\  R<^=i^^^ch  n^j      /-I'.p^^'it  a^:l:>  fcrc^        the  ar^u- 
nt  ch^'it  1  ^onitcring  syst*;^n  for  education  K?l"  is  needed, 
riowever,  rcir.ardlesp  of  what  i'^  dene  lo  the  fMt^rc  to  carry  out 
for  *^4n  on^o^ng  nonitqrin;-'  systen,   r^uch  r.^in  be  g-alned'fron 
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crve  publicatrioa  of  findings  froR  the  current  organizational  survey. 
And  too,  additional  insights  may  be  derived  frorn  secondary  ' 
analyses  when  che  data  base  is  made  available  to  R6D  systen 
researchers  and  policy  analysts. 

C,     The  1969        Status  Report 

The  best  published  source  of  information  on  educational  R/D£(I 
funding  in  this  country  as  of  1969  may  still  be  the  Office  of 
ZdMat  ion'  6  siazus  re;>ort  -^r^^f^ared  by  tlendrik  Giaeonse  and  his 
staf:  /or  the  C^CD  cross^/iational  revie^^  of  educational  R&D^^ 
Tnis  an^ilysis  pr*ovides  data  not  only  on  OE  funding  during  the 
'5Cs  and  '69s,  but  also  education  R&D  funding  data  frojn  NSFj 
CEO,  and  other  federal  sgen.c  ies  .  -Also  included  is  sorne  mnimal 
information  abO'^t  funding  provided  'by  private  foundations  and 
other  sources  (staffe  agencies,  universities,  professional  ass- 
ociations,  e^tc)  and  an  esciniate  on  the  total  spent  on  education 
RSD  in  the  U.S.  by  all  sources  in  f7  L963. 

ii.-  NIE's   1976  Da^abook 


In  1976,  Ward  >!ason  and  his  staff  in  the  R6([T  system  Support 

1 3 

^Division  of  :;iE  p^jblished  the  1976  Databook,       based  on  contract 

vor.^  carrieci  out  by  Stanford  Cniversity  by  Williaa  Paisley, 

U 

Ma*  Uda  Butler-Paisley,  an^i  Karen  ^Shapiro.        Tne  Da tabook 
updated  and  expanded  on  the  funding  data  provided  in  0K/;**1969  - 
F> t  :i t u^i  reptort .  I  r  Provided  u^d  it^d      c  in^. c^^^  of  t     ^  I  vd^'-^a t i"  r: 
VtVJ  furiding  in  the  U.S.  and  f.jnding  pr^jvid^d  by  various  federal 
a>U'ncies,  by  SF.As  and  LEAs ,  by  foundations,   ic.idenic  in?;titati  ^ns, 
and  Industry,   fric?  e<iti^.ate.^  of  Total  fed=?r*.il  funding  '«rere  laCir 
r'jfined  and  ftjrt  i-^r  updaCed  :n  the  wtv.  ^v^-llys^^'^  refc-rred  to 
o-^v-*  in  Section  T*)  In  addition,   tiir    ^1.- ^ bj provided  dctail^jd 
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information  about  the^  federal  funding  obligated  to  specific 
^  pro^raLTiS'  and  copies  by  federal  agencies  sponsoring  significant 
amoants  of  educational  RiD>  the  funding  provided  to  speciaXtzei 
R/D&I  instinutLOr.Sj  and  the  distribution  of  f^inds  geographically. 

/.'e  will  dra:;  or.  funding  d^ta  fron  both  the  OE  status  report  and 
the  y-lt  Databook    in  this  chapter. 

'Zfl  '^  -'-  An^^-lyses  Ti^cused  on  rundins  Issues 


Tnere  is  probably  a  lar^  fugitive  literature  of  internal  luerr^oranda  and 
consultants'  reports  prepared  for  K/OLl  sponsors  on  their  funding 
Dolicit:s.  'sfe  have  ^.ade  no  effort  to  be  conprehensive  in  our  review  of 
'such  poIZcy  analyses.  Nor  have  we  tried  to  locate  or  to  present  a  rep- 
reser^tative  sa:nple  of  such  analyses.  Rather>  w/  consider  here  anal^^jses 
that  have  been  produced  in  recent  years  on  four  particular  funding 
issues  which  we  viev  as  critical  in  thei r  'potential  impact  on  the  shape 
of  the  educational  R/D^xI  enterprise  in  this  country,  for  some  time 
to  cone. 

A.     Institunional  Support  vs ,  Program  Purchase  ^ 

In  1972>  while  legislation  fjr  the  creation  of  NIE  was  still 
pendingj  OB  nada  a  radical  change  in  its  funding  policies  for  the 
^  labf;  and  centers.        Instead  of  "institutional  supg^rt'*  Eor^hese 

J  n  -  c  [     1 1:^'!^ ,   i'-zMrh  ^u^iran t eed  ch^  Ir  exis t^:^"c^^  and  el  l". in \  ted 
th-i.T  from  con^petition  with  other  Ps^D  perforiner5  for  federal  funds)  > 
the  nev  "p^035rarn  purchase"  policy  assuflned^  these  institutions  had 
n^-.'-'  rt'iich^^d  r^tur^  statu^^>  were  no  longer  er.titled  to  special 
t^'^itnentj  ar^d  should  therefore  conpete  on  an  equal  fo<Dting  with 
ot'^-T  in:-:!:  itf;t  ions  f  or^fmult  i  -yp.-ir  proj^rnd  support . 
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^  [C  inhericed  Che  program  purchase  policy  aiong  with  responsibility 
for  the  labs  aad  centers.  The  debate  over  "institutional  support" 
vs.  "program  purchase'^  though>  continued  in  the  early  ye^irs  of 
NIE's  exhisCence,  Though  NIE  pre"sunabj.y  resolved  it  from  the 
outset  in  favor  of  "progra^^ptirchase^j  the  labs  and  centers  were 
able  to  get  the  decision  reop^aed^and  then  reversed.  The  issue  has 
ree^ierged -^ntermitten'tly  in^. various  forms  and  may  appear  aga^n  as 
a  live  question  in  fondins  policy  for  educational  R/D6I* 

Crr^  parsc^ular  fortji  in  which  the  questions  were  raised  appears  in 

sone  internal  OE  documents  circulated  in  1972  —  one  by  Charles 

Frye  elaborating  the  policy  and  a  second,  by  Ward  Mason  raising 

1 6 

some  issues  In  relation  to  ityiplenentation  of  this  policy. 
will  consider  these  documents  later  in  our  analysis. 

B.     The  CasTpbell  Report  ^    ^  ' 


In  1975  >  >^IE  co:nmission.ed  a  oanel  of  consultants  chaired  by  Ron^ild 
Campbell  to  review  NIE's  funding  policies>  especially^those  with 
regard  to*  the  labs  and  centers  and  the  issue  of  program  purchase 
vs*  institutional  supp&rt.   In  a  few  monthsj  the  panel  produced  the 
'^Cf^^pbell  Report'%  cailing  for  (arnortg  other  things)  the  creation 


of  "national  laborat/ries"    to  replace  tbe  regional  laboratory 
concept  —  selecting  them  from  at?\ong  the  ^existing  labs^and  centers 
those  that  neeC  criteria  of  high  quality  and  relevance      to  NIE's| 
nissionSj  and  entering  into  ^*J?pecial,  relationsh ips "  v;ith  some      '  . 
oth^r  high  quality  ir^tlcutions  a^?  w^ll.        shiill  consider  several 
of  the  recorriTnend^tions  made  in/this  report  later>  particularly 
its  crittcis^of  MIE's  heavy  reliance  .an  procurement  through  open 
conpetition  rather  than  "funding  and  stipportipg  those  who  can  best 
do  }IIE* B  workj"  the  latter  bein|>  the  policy  "^advocated  by^  the 
con^?ul  cants  who  prep^ed  the  report.  ' 
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Agency-Field  Rela tionshipfi  in  the  Educational  R/D&I  System 

* 

A  third  funding  policy  analysis  we  draw  on  in  thts  chapiter  is  a 

18 

report  we  pre|3ai:ed  for  ^'lE  in  1976,  approximately  a  y^ar  aft 
the  Cnmpbell  Report  was  subniicted  and  apparently  shelved*  ^ 


The  analysis  requ^stfed  by  the  agenoy  was  to  focus  on  what  the 
appropriate  balance  should  be  between  field-initiated  and  NIH- 

19 

directed  research  and  Ri^D,  The  i=5Sue'was  under  review  within  NIE, 

i:i '  r-i^^pons^  :o  consi^lecabie  criuicLsrn  from  the  field,  has  bsen 

sevc^reiy  criticized  by  the  research  coriuiunity;  funding  for  field- 

\ 

initiated  research  had  dwindled  and  was  for  a  time  totally 
elininated,  and  the  agency  was  relying  increasingly  on  agency 
directed  approaches  to  procuring  research  ana  R^D  (priniaTily  open- 
conipecition  in  response  to  RFPs  prepared  by  t^IE  staff  or  occ- 
aisionally  consultants), 

.  "V 

ft 

Our  CISST  polic^  analysis  team  reconceptualized  the  issue  in  ter'ns 

^>  \  »  .  , 

of  how  NIE  could  achieve  its  purposes,  through  procurements  and 

other  actions,*  taken  in  collaboration  with  the  field.  This  approach 

was  an  attempt  to  put  the  procurement  questi6n  into  a  broader 


con^xt,  prpvide  a  comprehensive  framewark  for  policy  d^eloptnent 
for  NT^  as  t'h^  lead  agency  for  educational  R/D5fl,  and  permit 


integration  of  fLindin^  policies  vith  otlrcr  agency  po^icties*  Th^ 
ar^alysis  focused  hea^^ly  on  :   (a)  the 'lead  agency  concept; 
(b)  an  approach  to  understanding  educational  R/D&X  as  an  immature 
system  in  need  of  systen-building  and  therefore  irtacro-leve.!  lead- 
ership; (c)  the  manner  in  which  System  building  purposes  can  b^ * 
\iui:it  into  j>rocurentents;  and  (d)  the  apjiroaches  an  agency  can  take' 
in  relating  to  the  field  to  achieve  its  purposes  Cs^tem-building 
as  well  as  other  purposes)  in_  collaboration  with  the  field.  The 
analysis  touche^  on  one  of  the  same  questions  considered  in  the- 
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Campbell  Report  —  i.e.,  the  need  to  reach  out  to  the  best 
performers  *to  solicit  vork  from  them  and  "build  their  (^rrd  thereby 
the  si^tem's)  capabilities.  V^e  shall  consider  the  analysis  in  soz:e 
detail  later"  in  this  chaptlr* 

D.    Stren^theni:if;  Fundamentajl  Research  r 

Although  the  Agency-Field  Relati6nship    analysis,  seemed  to  be 
♦ 

enthusiastically  received,  creating  a  considei'able  stir  within 

20 

so?^  units  in  the  agancy  for  a  "few  months,      it  coo  was  shelved^ 
like  the  Campbell  RepoVc  ba^fora  it*.Just  hov  little  impact  the 
report  haH  can  be  seen  from  a  fourth  set  of  documents  we  consider 
in  our  section  on  funding  policy  issues  —  i,e.>  1977  documents 
relating"  to  NI£'s  policy  decisions  on  the  fund^g  of  fi&ld- 
initiated  fundamental  reslarch,  a  key  elem^ent  in  the.field- 
initiated  vs ,  agency-directed  issue  NIE  had  requested  guidance 
on  in  commissioning  the  Cl&ST  policy  analysis*the  previous  year 
^ (Agency^ Field  Relationships) * 

These  document's  include:  (a)  the  final  report  q£  the  National 
Academy  of  'Sciences  (NAS)  Committee  "of"  Fundamental  Research 
Relevent  to  Education,        coimaissioned^ by  NIE;   (b)  the  report; 
of  the  Program  committee  of  the  National  Council  ^n  Educational  ■ 

ijesea'r'ch  CNCER)  ,  NIE's  policy  making  body,*  including  the  NCER 

■    ^  ^  22 

draft  resolution  on  the  funding  of  field- In^iated  research; 

and  (c)^an  examination  oT^otb  these  documents  by  our  CISST  policy 

analysis 'teamj  under  4  contract  with  HIE  Ci^icluding  both  -a  critiq^ie 

of  these  pieces  and^a  propose;^  alternative  approach  for  the 

23 

funding  of  fundamental  research  relevent  to  education)* 


These  documents  are  of  interest  not  only  fpr  the  particular  funding 
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^  policy  issue  they  .explore,  but  also  for  underscoring  how  little 
impact  policy  analysis  is  likely  to  have  when  it  runs  counter 
to  policy  preferer\ces  already  formed  or*"  to  policy  pressures  from, 
interest  groups  'to  whom,  decision  makers  fe^l  a  need  to  be  '  ^ 
responsive       whether  because  these  pressures  reflect  their  own  , 
preferences^  or  foi?;isome  other  reasons.  In  this  case,  the  policy  - 
decision  that  was  made  used  one  of  these  reports  as  a  just- 
ification  (the  NAS  report),  though  it  went  considerably  beyond  what; 
was  specifically  called  for  in  that  report,  and  ignored  the^ 
recommendatioPpS  nade  in  two  other' reports  co:ni'nissi9ned  by  NIE 
(both  Agdticv-Field  Re^lationships  and  S-trengttiftnins  Fundamental 
Research,    oiir  analysis  of  the  N/fS  ^nd  -NCER  drafts  on  fundamental 
research)'*    We  shall  consirJer  all  of  this  in  some  detail  later  in 
this  chapter .      -  ^ 

II.  FCNDINC  PROBLEJ^S 

The  funding. of  educational  R?D&I  has  tended  to  suffer  from  five  ke^ 
weaknesses:,  relatively  low  levels  of  funding,  insufficient  diversl- 
fixation  of  sources,  instability,  i<v'adequate  concentration,  and  inadequat 
attention  to  funding  policy  development.  We  shall  consider  eachof  these 
■problem  areas  in  turn., 

!■  Relatively  Low  Levels  of  Funding 

\         ■  _  \ 

Several  kinds  c?f  statistics  have  been  used  to  underscore  the  point  that 
the  Irvel  of  funding  that  ha3  been  av'ailablo  for  educational  R/d^I 
is  rather  low,  considerably  too  low  to  meet  the  need.  The  most  basic  ' 
of  these  statistics  are  (A)  stimates  of  the  total  funding  support  for 
educational  r/D&I  in  this  country,  ^^m  all  sources*  This  fcaslc 
statistic  is^  then  used  in  severa^l  other  calculatloas  comparing  this 
statif^tic*  to  others:  (B)  expenditures  on  r/d&I  in  the  education 
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sector  as  a  percetmage  total  spending,  on  K&D  in  this  country;  ^  ^ 

(C)  educational  Ji/DW  expenditure  ^  a  percentage  of  cotal  education 
expenditures  by  all  levels  of  go^rnment  in  this  country?  (d)  com*- 
paoisons  of  the  percentage  of  education  expenditures  allocated  to 
K/V&I  with  percentages  allocated  to  R&D  in  oth^r  stfttors;  and  com- 
parisons of  the  same 'allocated  -to  educational  .n/DSl  with  (e)  expectations 
about  levels  of  funding  growth  for  educational  K/D&I  and  (F)^  estimates 
of  the  sums  required  to  meet  the  need  for  educational  r/D&I  outputs. 

A.     Estiirace  'of  Total  Funding  for  Educational  k/P&I 


The  best  available  estimate  of  total  funding  for  educational  ^/D^tl 
in  this  country  from  all  sources  (public  and  private)  is  somewhere 
between  $605  million  and  $673  million  C<iepending  on  what  is 
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included  or  exc luded 'from  the  given  estimate),  with  $619  million 

24'  ^ 

the  nost  likely  figure.  ^  These'data  are  ^for  Fiscal  Year  19] 
the  most  recent  year  for  which  such  an  estimate'is  availablo- 


i 


Educational  R/D&I  Spending  in  Comparison  to  Total/^pendin^  in  ' 
the  b\S*  ' 


That  $619  million-  represents  perhaps  2%  of  vCTe  total  spent  on  K&D 

by  all  3^urces  in  this  courjtry.  In  1973/^otal  K&D  expenditures 

in  this  country  were  over  ^ib  billi^if^  ^    TJhat  figure  is  shurely 
.somewhat  higher  now: 


Educational  k/D&I  £:<p><Klitures  as  'a  Porc&nta^^e  of  Total 
Education  Expenditures 


Even  mocc,  signifj^nt  than  the  fact  that  only  2%  of  all  K&D 
funds  in  thia/country  are  sp'ent  in  the  education  sector  is 
'another  st/tistic  which  underscores  how  little  of  tt^  money 
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Spent  on  education  in  this  country  is  allocated  to  r/D6I  activitie;?, 
By  the  early  1970*s,  education  expenditures  had  reached  $90 
billion  and  are  expected  to  soojn  exceed  $100  billion.  Using 
the  $90  billion  figure,  and  the  $619  .million  estimate  of  FY  1975 
expenditures  for  educational  R^l)  by  all  sources,  we  calculate  cha^t  ' 
no  niore  than  0*7%  of  total  education  expenditures  ate  allocated 
to  R/D6I  act/ivitics. 


D,     Comparison  of  Allocations  to  r/D61  in  £duc^ion  and  OthejL^Sectors 

.  The  inadequatiy  of  the  educational  R/Dil  funding  level  is  suggested 

by  comparison  of  ^^the  allocations  to  R/D6I  in  education  with 

si^^iil^r  allocations  in  other  sectoijs,*Of  all  the  statistics  used 

to  bi:ttress  the  argument  for  higher  educational  R/D^I  funding 

*^  27 

levGls>  these  statistics  are  cited  mosD  frequently.  ,The 
comparison  to'  the  0*7%  figure  for  educational  lyDfirl  noted  abovef 
the  following  figures  are  cited* for  other  sectoi^;  in  industry^ 

CO  5%  of  expenditures  are  allocated  to  R6D;  in  agriculture^ 
1  -  1^'/ in  health  care>  the  figure  is  given  as.5%- 


If  attention  is  restricted  to  allocations  by  the  federal  government 

alone,  the  relevant  comparisons  are  as  follows:  the  federal 

government  spends  1%  of  all  its  education  funding  on  R^D 

of  all  its ' education  funding  on  the  broader  "KPU") ;   in  comparison^ 

KTJ^jof  total  federal  spending  on  health  goes  to         and  over 

10/^  of  federal  defense  spending  goes  to  R^D.  Such  compa-E;isons>  though, 

nay  h-:  soriewha^t  risky,  Asffpointed  out  by  Tard  Mason  and  Xelson  Carnot 

'  2S 

of  NIE's  R^(D  System  Support  -Division^        the  federal  government 
provider  different  levels  of  support  for  different  sectors. 
In  the  defense  sector^  the  f edei^^l^^government  provides  virtually 
all  funding  —  for.R^D  and  for  the  operational  system.  In  the 
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education  sector,  by  way  of  contrast,  the -federal  cotitributioti 
to  anual  education  expenditures  amounts  to  only  11%,  with  the  ■ 
remainder  provided  by  state  and  local  governments*  The  fed^al 
R^D  budget  is  oijiented  heavily  to  only  a  few  sectors^with  defense 
accounting  for  half  of  the  R&D  budget;  space  and  exploration, 
another  15%;  and  health  an  additional  15%*  Elducations*s  portion  ' 
of  the  cotal  fecferal  RiD  budget  amounts  to  only  slightly  niore 
than  VA. 

*' 

This  t^ould  seem  to  suggest  that  educational  R&D  is  assigned  a 
relatively  low  priority  by  federal  (Jecision  makers.  But  other  ^ 
factors  tnust  be  considered  as  wetl.  For  instance,  defense  R^D 
is  HkeLy  to  require  considerably  more  costl]^  technology  than 
educational  R&D.  Or>  one  night  assume  that  educational  R&D  is 
heavily  funded  by  sponsors  other  than  the  federal  government 
(which  is  not    the  case, as  we  shall  soon  see)  and  therefore  that 
additional  fefderal  funding  might  not  be  needed.  Or,  it  might  be 
argued  that  the  immature  state  of  development  of  educational  r/D&I 
at  this  time  severely  limits  the  amount  jof  money  ^at  can  be  spent 
productively    and  the  rate  of  quality  expansion  of  the  educational 
K/D&I  enterprise  that  can  be  expected  for  the  near  future  a 
valid  point  we  shall-  deal  .with  later  in  this  chapter* 

Even  taking  all  considerations  into  account,  these  comparisons 
suggest  ^hat  the  level  of  funding  for  educational  r/DSI  is  likely 
to  pose  a  serious  problem.  This  conclusion  seems  underscored  further 
by  a  number  oc  otner  contextual  fJictors  that  affect  edu^jational 
R/D&I,  notably:   (i)  the  immaturity  of  educational  r/D&I  compared  to 
these  other  sectors  and  *the  resultant  need  for  eiipeasfve  cap^city- 
building  expenditures  and  investment  in  developifi|  the  field's 
knowledge  and  technology  base,  and  (b)  the  .enormous  size  and 
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variaoiii'ty  as  well  as  the  plurialistic  pattern  of  decisioiimakir^g 
that  characterize  the  operating  system  to  be  Impacted    Clearly  > 
then>  substantial  resource  investilfent  is  likely  to  be  needed 
apart  from  the  costs  of  product  development  activities  an^^logous 
to  tho3e  in  other  sectors- 

E.     Expectations  about  Levels  of  Funding  Growth 

The  Jirst  annual  appropriation  for  the  Cooperative.  Research  Prograrr. 
(Ct^)  in  1957  was  for  only  $1  "million.  That  figure  more  than 
doubled  the  follovlng  year.  By  Fiscal  Year  1960^  in  only  four  years 
time>  OE  was  spending  approximately  $10  million  for  research  and 
dissemination  appropriated  under  CRP>  NDEA>  and  other  legislation. 
By  196a*  four  years  later>  that  figure  nearly  doubled  to  over 
Sl9  million.  The  very  next  year>  FY  l965;^  the  funding  level 
doubled  again  to  over  $36  million.  And  one  yeai<later>  in  TY  1966, 
the  figure  nearly  tripled  to  over  $100  ra^lion. 

That  astonishing  growth  "rate  generated  high  expectations  for. 

continuing  expansion  of  the  educational  R&Df  system.  Rowever>  the ^ 

year  1966  represents  the  end  of  the  rapid  growth- period  and  USOE 

funding  for  *'research  and  training"  remained  around  $100  million 

30^ 

for  several  subsequent  years. 

There  have>  of  course,  been  substantial  gains  in  .the  level  of 
funding  for  ediication^l  R/Dil.  fn  1969>  OE  estimated  in  its  status 

report  th-^t  approxinatsly  million  was^ spent  on  educational 

♦  ^  31  ^ 

r/D^iI  in  this  country'  by  all  sources.       As  of  FY  1975>  as  noted 

earlier,  NI^  estimated  that^'same  figure  to  be  approximately  $691 

million.  Other  statistics  show  gains  also.  For  instance>  earlier 

literature  cited  statistics"^  showing  educational  RiD  receiving  a 
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smaller  percentage  of  the  c^jtal  eLiucaifton  dollar  (0.2^  " 

33 

and  the  federal  education  dollar ■  (0- 5%)        chan  is  the  c<3se  for  the 

ft 

FY  1975  daca  —  i.e.,  0*7^  of  fotal  expenditures  and  approximately 
1%  of  the  federal  education  expenditures  were*spent  on  RirD  in, FY 
1975.  The  differences  tnayj  of  course,  be  due  to  -  differences  in  the 
way  the  statistics  were  calculated  at  different  times,  or  to  more  . 
complete  information  available  now  than  earlier.  But  it  certainly 
does  seem  equally  if  not  even  more  plausible  that  education  R/DM 
expenditures  sre  increasing  somewhat  faster  than  the  tot^l  e^^^^anlcn 
expenditures.  .  *  *  ^ 

Still,  whatever  the  growth  rate  has  beert,  since  1966,  funding  levels 
have  fallen  far  shore  of  early  expec tatioE^ .  "This  becomes  abundantly 
cleai:  from  exaniination  of  some  ,of  the  lij^erature  of.theU^t^  J60's^ 
as  the  peaking  of  federal  funding  for  educational  R/d&I  began *to  be 
felt.  As  discussed  by  Francis  Chase  and  Stephan  Bailey  {who  success- 
ively   headed  the  National  Advisory  Cominitcee  on  Educational 
Laboratories  in  the  '60*s),  the  laboratories  alone* were  expected  to 
receive  funding  of  $100  million  a  year,  and  even  this  figure  was 
described  by  Chase  as  too  low  to  permit  them  to  function  adequately. 
Cha;se  estimated  that  the  regional  laboratories  would  each  have  needed 
between  ^3  million  and  $10  million  a  year  to  carry  out  the  kinds  of 
work  they  were  to  perform;  the  R^^D  centers  were  ex|)etted  to  need 
at  least  $2  million  to  $3  million  a  year.  Clearly>  the  then-extant 
funding  level^of  $30  million  a  year  for  29  labs  and  centers  had 
fallen  far  short  of  the  expectations  of  the  pjjoponents  of  educational 

rVd^^i.'^''* 
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F.     Comparison  of  Available  Fun4ina  tflth  Estimaces  of  Xeeds  and  Costs 

i 

There  is  relatively  litcle  agreement  in  the  fieid  of  education  on 

what    is  needed  to  improve  the  schools  and^certainly  nociiing  like  a 

comgreh^nsive  data  base  on  needs  and  cl^e  probab^  costs  of  alter- 

native  approaches' to  meeting  those  needs.  There  is  not  ev^n  an  easily 

accessible  data  base  on  che  cost  of  more  than  a  handful  of  the 

enorpoua  number  of  educational  R/D£rT  putputs  that  have  been  produced. 

We  are  told^  for  instance^  chat  Sesame  Street  .<7Pent  $S  inillion  a 

vear  in  I'ls  early  years;  that  it  cost  $100  million  in  direct 

development  costis  for  each  videotaped  rninicourse  developed  by 

che  Far  West  Laboratory  co  crain  experienced  ceachers  in  specific 

skil.is;  that  by  l?60j  when  t^SF*s  Course  Contenc  Improvemenc  Program 

was  in  full  swings  ^JSF  was  spending  becween  $5  million  and  $6  million 

a  yoar  on,  a  dozen  development  projects  (including  PSSC  physics^  - 

35 

BSCS  biology^  CHEl  chemistry^  and  SMSG  mathematics).  However^ 
it'is  racher  difficult  to  make  effective  usa  of  such  information, 
especially  "for  the  planning  of- funding  requirement*s . 

One  of  the  most  interes^tftig  attempts  to  estimate  needs  and  coses 
was  carrp^ed  out  nu  OE  planners  ia  1968  And  described  ty  Hendrik 
Gideose  and  hitfc.staff  in  the  1969*0E  status  report:  ^ 


Bureau  officials  developed  what  they  felc  was  a  conservative 
estiniate  of  the  continuing  need  for  support  of  educational 
development  work  alone*  Using  existing  organizational 
categorizations  for  education.  Bureau  officials  e^tinated  at 
20  the  number  of  school  years  for  which  "the  Bureau  of  Re^ 
search)  has  dev^lopmenc  responsibilities.  The  escimate  was 
based  on  two  preschool  years,  2  pos tsecondary  years  in 
vocational  and  technical  areas,  and  k  undergraduSte  year9  at 
the  College ' level.  The  Bureau  estimated  that  a  reasonable 
number  of  full-year  curriculums  which  migKt  be  developed 
for  each  of  these  ?0  school  years  would  be  10  (e*g.,  10  subject 
matter- feilds  for  grade^ll,  etc.)^.     On  this  estimate  the 
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total  naniber  of  fall-year  carricalums,  ststed  as  units, 
for_which  the  Bureau  of*  Research  could  be  responsible 
would  be  200*  If,  f  urtbermore ,  the  Bureau  were  to  persue 
as  policy  the  development  of  alternative  approaches  to  each 
unit  to  permit  and  indeed  ^enhance  local  and  State  op'dions  in 
course  selection^  the  total  number  of  potential  curriculum 
units^competing  for  supppct  can  be  calculated  at  600*  In 
addition  to  the  development  of  learning-effective  materials 
within  the  existing  structure^of  schooling  and  education 
(whqt  industry  would  call  defensive  research  and  development) 
it  might  also  be  deemed  desireable    to  develop  alternative 
approaches  to  existing  instructional  arrangements  and  school 
organization  (offensive  research  and  developne'nt)  .This  add-' 
icionai  effort,  equivalent  to  perhaps  200  curriculum  units, 
would  be  directed  to  what  can  be  termed  radical  departures 
from  existjing  instructional  practice* 

The  potential' '^fj,eld"  f or-educational  development  at  any  given 
point  and  tiiae,  ^therefore  might  approximate  800  units  of 
*  '  *    development  wark  designed  .to  produce  learning  materials  for 
one  f  ull  ^year*s .  instructiortal  use  >n  a  given  curricular  area* 
■Estimates  now  increasingly  more  firmly  based  on  hard  data 
suggest  an  average  'c^st  fpr  the  development  of  such  a 
t     curriculum,  unit  of  approximately  $4  million*  If  the  time 
I    span  for  a  developmpit  unit  is  approximater-ly  7  years  from 
the  time  of  conception  of  the  idea  to  the  completion  and 
release  of  th4  materials  to  tVie  school  systems  of  the  nation, 
then  it  is  possible  to  conclude  X800  course  units  times 
S4  million  divided  by  7  years)  that  the  average  investment 
vhich  might  reasonably  be  directed  to  educational  development 
each  year  ^approaches  $460  million,36 

It  should  be  noted  that  the  $460  million  per  year  estimate  is  for 
curriculum  development  costs  only.  It^oes  not  coiner  the  consider- 
able costs  lilcely  to  be  incurred  in  support  of  fundamental  research 
dissemination,  demonstration,  implementation/utilization  support, 
personnel  training  and  other  capacity-building  programs,  etc,  ^ 

Of  coui:se,  this  mind-boggling  "what  might:  be"  analysis  is  purely 

I 

hypothetical.  And  certainly  one  need  not  conceive  of  all  this 
pCjEential  development  work  being  undertaken  at  the  same  time.  Still 
it  is  useful  as  an  indicator  of  the  scale  of  the  potential  need. 
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and       'at  least  suggestive  that  t^  current  funding  levels  for 
educational  R/D^I  are  not  adequate  to  meet  the  needs  Eoj  ^ome 
time  to  come.  *  *  ^ 

G.    Summary:  Low  Levels^of  Funding 


In  sumnjary,  che  best  available  estimate  is  that  approximately^  $619 
million  is  spent  each  year  in  this  country  on  educational  R/d&I. 
Th^t  $619  million  represents  approximately  only  2%  of  che  total  ■ 
spent  on  R&D  in  this  country  and  only  0.7%  of  the  total  education 
expenditures.  The  percentage  oE  education  eicpenditures  allocated  ^ 
to  R£(D  compares  very  unfavorably  to  similar  figures  for  suchJ*other 
sei:tors  as  industry,  agrictilture,  and  he'alth  care.  This  is  e;sp- 
ecially  true  when  consideration  is  ^iven  to  the  immaturity  of 
educational  R/D&I  arid  the  need  for  costly* capacity-building 
expenditures  apart  from  the  direct  costs  of  product\^development. 
The  $619  million  figure  seems  even  more  inadequate  when  viewed  in 
the  light  of;. '(a)  early  expectations  atout  funding  levels  (and 
^  the  rate  at  which  they' would  grow) >  and  (b)  estimates  of  the 
considerable  need  for  educational  R/d&I  outputs  and  the  heavy 
'costs  lik^y  to  be  incurred. 

^  ;         ■  * 

2.     Inst^£^icient  Diversification  of'  Souirs^s  t 

Of  tTie  approximately  $619  million  estimated  to- be  spent  each  year  on 

educational  R/D&I  in  this  country,  the  besit  available  estimate  i^  that 

$51^  TTilllion,  or  SV/^  (in  FY  197S)  came  from  various  departraentti  or 
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agencies  of  thejfederal  government.      Clearly^  the  federal  govern- 
ment has  become  the  primary-^^ponsor  oj^  .educational  R/D^I*  The  remaining 
17^  came  from  state  and  local  governmfents,  private  foundations,  and 
other  private  "sector  sources  (unlv<irsities,  industry,  etc^)* 


3:}. 
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Greater -diversification  of  sponsorship  would  se^em^to  be  advisable  given 
the  political  vulnerability  of  edjucc^tional  R/DSI  expenditures  in  a'    -  ^ 
climate  of  limited  r/DSI  system*  legitimacy  and^lack  o£  substantial  - 

* 

confidence  in  the  system's  ability  to  produce  a  reasonable  return  on 
the  taixpayer*s  investmen-t*  Clearly,  though,  substantial  investment  in 
educational  R/D&I  h}^  the,  private  sector  or  by  state  or  local  govern-  ' 
meats  is  not  highly  Itkely  unless  imaginative  new  incent ive&  are  provided 
and  bold  now  initiatives  are ^^>tiken  to  attract  this  new  sponsorship* 
i^'iL's  progr^im  o£  grants  to  btates  for  buildiag  statewide  dissemination 
capacity  may  function  in  the, long  run  as  seed  money  to  attrdft  additional 

state  funds  to  the  support  of  dissemination  and  other  r/DSI  functions. 

'  38  " 

And  clearly,  states  have  expanded"  their  functioning  in  these  areas. 

At'  various  times  over  the  past  10  to  15  years,  efforts  have  been 

made  to  create  incentives  to  attract  p^rivaEe^itidustry  ^to  educational 
39 

R/DSI- '      We  have  little  way  of  knowing  how  much  more  R/DSI  funding 

J  .  ' 

can  be  attracted  from  private  foundations.  And^  higher  education 

institutioa$^  have  b^en  under  severe^  financial  pressures,  making  all- 
ocations of  sizable  internal  fundtng  for  r/dsI  unlikely*  Still,  there 
has  be^n  considerable  discussion  in  recent  years  of,  the  need  to  str- 
engthen'the  role  of  the  universities  in  the  conducy  of  research  and 
RSD,  and  perhaps  innovative  approaches  to  sponsorship  may  be  found  * 
(e,g.,  pooling  foundation,  federal^  and  university  funds  for  particular 
pi;oframs).  Whatever  the  specific  approaches^  gi-ven  the.  severely 
limited  growth  rate  of  federal  funding  for  educational  R/D£kl  in  recent 
^years,  greater  diversification  of  , funding  seems  essential  if  the 
scope  of  the  educational  r/D6I  enterprise  id  co  t^xpand  substantially* 
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3.  .  Instabllitiv  of  Funding^  ^ 

InsEabiliJty  of  funding  has  been  one  of  the  most  serious  problems 
faced  by  educational  R/D^I  o^er  its  brief  history-  The  ^early  promise! 
of  ample  funding  was  clouded  within  only  a  few  ^arSj  with  the  rapidl 
expaJfslon  of  funding  for  the  labs  at^c^nters  peaking  is  early,  as  I 
1966 

t 


at^c^nters  peaking  as  early,  as  I 
AO.  I 


Funding  for  different  types  of  R/D^I  activities  has  t&nded  to  ebb  and 

flow  within  the  frequent  shifts  and  fluctuations  in  federal  educalJi^fel 

R/D&X  priorities.  Fumdamental  rese^ch,  for  4'ist:ance>  suffered  Erotaf  ' 

an  absolute  as  well  as  a  relative  decline  infunding  after  its  early 

period  of  expansion  under  the  Cooperative  Research' Program-.  It  hae  now 

rebounded  and  appears  to  be  on  the  rise  ^gain,  especially  in  the 

^^^^  *     '  ^  . 

funds  obligated  by  NXE*  Development  funding,  to  consider  another 

example,  expanded  rapidly  in  the''- late  '60s,  only  to  becomes  re- 

considered  and  lesser  priority  in  the  '70s*  And  within  functions, 

specific  topics  and  research  areas  seem  also  to  have  come  into  and 

then  got  out  of  favor. 

-Si' 

Federal  reliance  on  annual  rather  than  longer-tetn  funding  cycles  was 
a  frequent  cau^e  of  complaint  in  the  early  tears  of  educational  R/D^I- 
Pl^^pS^ere  made  for  longer-term  funding  ccJtPmitments  po  permit  long- 
range  planning  of  complex  multi-year  projects,        and  some  modifica- 
tion of  the  funding  policies  in  this  direction  has^  been  apparent. 

The  creation  of  NIE  si;e^ed.for  a  tiuie  to  only  adt^^fe"  instability. 

In  the  early  years. of  its  existence,  NIE  underwejit  several  changeip^of' 

directors  and  internal  reorganizations,  which  created  instability  in 

sop.e  program  afr^as*  MLE's  aj>propria'tion  struggles  with  Congress  added 

to  the  shaky  image  of  the  educational  r/D&I  enterprise.  Created 

i 


initially  with  an  FY  1973  iuT\4^  level  o£  over,  $100  milHon,  the  ^ 
Institute  was  threatfine^  with  a  zero  funding  level  that  would  hav^ 
termnated  its  existence  the  vQry  nexy  year.  Eventually,  NIE  funding 
over'  the  n^xt  few  years  sl?abill'zed  at  appraxiinately  the  $70  to  $75 
siilllon  lev^l.-'But  clearly,  the  ups  and- downs  of  funding  for  this 
lea<i  agenc^^^*for,.the  system  in\iust  a  feV  j^ars^  and  -the  enormous  gap 
between  the  current  $90  million  level  and  the  initially  expected  level" 
of  nearly  double  that,       suggest  'that"  the  educafio/ial  R/D&I 
enterprise  still  lacks  sufficient  funding  stability  to^ support  long- 
*  term  planning  ajj^  system  developmer^t,  Ij:  woulS  seem  that  greater 
long-term  stability  will  be  needed  -to  attract  the  resource  b^se  of 
first-rate  personnel  and  subcontractors  needed  to  permit  systera 
maturation. 


Ay  Inadeg.uate  Concentration  of  Funding 


The  difficulties  posed  by  low  ov^rdll .  finding  levels  are  complicated 
fifllther  by  allocation  patterns  that  tend  to  disperse  what  little  ^ 
money  :^s  available  over  a  large  nut^er/of  projects  rather  than  con- 
centralingjit  sfltf ficiently^on^  few*  The  trend  appears  to  have^  been 
toward  grelter  and  greater  cpncenfcratlbn  of  funding,  as  more  and  more 
projects  have  lost  funding  and  Inciaeasing  numbers  of  federally  ^ 
supported- wD&I  Institutions  have  gone. out  of  existence,  Still,  given 
the  lirn^ited  funding  available  and  the  high  c^osts  incurted  by  large- 
scale  -educational^^D&I  programs;  ^gr^ater  Concentration  may  be 
essentloHf  elective  programs  and  products  are  to  be  pr9duced. 
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5.  Inadequate  Attention  to  Fundin^jl^olicy  , Development 


From^our  perspective>  a  veil  conceived  funding  policy  for  educational 
R/D&I  would  be  formulated  afber  consideration  of  a  host  of  factors 
for  instance,  agency  rgission  and  goals  in  relation  to  those  of  other 
sponsors/o£  educational  R/D£(I;  the  state  of  development  of  the  / 
■educational  R/D^I  syatem  and  its  system  building  requireraents;  the 
existing  degyee  of  balance  or  imbalance  among  R/d&I  functions  as  ^ 
CurrenLjy  funded  (as  compared  to  sbme  sense  of  minimum  degrees  of 
balance  required  for.  adequate  system  functioning  ^nd  development) i  . 
the  need  f^^ some  ^degree  of  stability  and  continuity,  ^tc. 

There  is  relatively  little  evidence  of  much  at.tention  to  these  kinds  ^ 
of  systematic  considerations  in  the  planning  or  budgeting  processes 
of  MIE  as 'the  lead  agency  f or  educati9nal  R/dJi,  or  "of  any  of  the 
other  key  sponsors  of  any  of  the  other  key  sponsors  of  educationar  . 
R/D&I.   (This  is  apparent  in  the  manner  in  which  the  Nationa!t\^Council 
of  Edu<^ation  recently  resolved  t^e  issue^of  establishing  a  budget 
set-aside  for  fundamental  research.  We  shall  have  more  to  say  about 
this  later  in  this  chapter.)    Since  at  this  time  funding  policy 
appeai^s  to  be  the  primary  ^leverage  federal  agencies  are  able- to  exert 
on  R/D£(I  functioningj  these  sorts  of  issues  would  seem  to  warrent 
considerable  attentiqn. 

i. 

III.     AVAILABLE  pj^A  OM  EDUCATIONAL  R/D&I  FUNDING 

 1  ■  i4  '^^ 

■  V 

Until  recently,  very  lictle  specific  information  was  ^available  on 
funding  of  educational  R/D£(I-  Dollar  amounts  were  published  for 
specific  programs  orNagencies.  But  few  analysts  attempted  to  answer 
such  basic  questions  ai:  how  nfuch  money  was  being  spent,  by  Vhom,  for' 
whatj  wlt;h  wfwt  ^consequences  —  ei^lrer  for  educational  R/DSI-^as  a 
whoXcj  or  for  the  segment  of  educSlional  R/D£(I  supplied  by  federal  " 
agencies. 


here  were  the  data  series*  oa  R^tD  funding  published  by  HSF  an^  Oi^. 


But  (as  we  ^Sll  see  shortly)  the  information  ^pplie<^"by  these 
analyses  had 'several  shortcomings  for  establishing  R&D  funding  levels 
for  t;hfi'  f ield*  of  .education.  ^     -  *  ^ 


There  a^e^till  many  unanswered  questions',  as  we  shall  take  note  bf 
some  of  these  in  a  subsequent  section  df  this  analysis.  But  thanks 
to  the  effort^^^  Ward  Mason  and  his  staff  in  KIE'^s  R5tD  System  Suppo'rt 
Division,  we  havp  learned  a  great  deal  about  how  federal  funding  is 
distributed  across  sources,  functipns,^  perfq^ing  organizations,  ■ 
subject  areaSi,  target,  populations ,  etc.  —  essential  information 
as  a  basis  for  considering  policy  implications  of  funding,  how  it 
affects  th^  functioning  of  the  educational  R/D&I  system,  ^n)l,  hov  it 
might  be  used  to  improve  R/D&I  functioning  in  the  future* 


:ion,  weJshall  attempt 


In  this  section,  weJshall  attempt  to  summarize  the  av^lable  data, 
both  from  the  R^fD  System  Support  Division  reports  and  articles  and 
from  other  sources  as  well.  We  shall  consider  what  the  available  Si 
data  tell  us  about: 


1/the  growth  of  funding  for  >educational  R/C&I'  ^ 

2.  the  'total  funding  level  for  educational  "R/D^tL^^rom  all  ' 
sources  (federal-agencies  and  other  sources);  and 

3.  ,how  federal  fCinding  of  educational  R/D&I  is  disjCributed 
across  , sources  (i^e:,  agencies),  functions,  project  "  . 
content  areas  j  target  groups  ,^  and  performer  oxgani^iatlons , 
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1^   I.  Growth  of  Eflucacional  R/P&I  Funding  *  ^  * 

Tables  6,1  -  6,4  ^and  Figure  6,1,  reproduced  from  the  1969  OE  status 

A6 
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report,^,    document  the  rapid  -g^rowth  of  'educational  R/D&I  funding  in 


the  late  '50s  and  the  '60s,  As  we  noted ^ earlier' in  this  chapter: 
the  first  annual  appropriation  ^or,  the  Cooperative  Research  Program 
,  ifl  1937  \^^s  only  ^1  million;  that  figure  ^re  than  doubles*  the.  foll- 
owing year;  by  FY  1960>  in^only  four  years'  cime>  oe  was  spending 
approximately  $10  million  f&r^research  and  dissemination  (appropriated 
under^CRP>  NDEA,  and  Dither  legislaAon);  by  FY  1964,  four  .years  later* 
that  figure  had  nearly_  douSled  to  $19  million;  the  very  next^ear,^ 
FY  1965,  the  funding  level  doubled  again -to  over  $36  million;  and  one 
year  later,  in  FY  1^966,  that  figure  nearly  tripled  to  over  $100  ^ 
millli>n,  '  .  '    -      *  ■  ^* 


Federal  agencies  other  than  OE,  NSF,  and  OEO  and  other  funding  sources 

were  also  spending  mo|jey  on  educational  R/D&I  during  these  years.  m 

"Table  6,5>  from  the  1969  status  report,      presents  documented  figures 

'froT9  other  educational  .R/D6fl  sponsors  a%  well.  As  shown  here,  the 

documented  total  (descj^^ibed  in  the  report  as  the' "documented  minimuar 

base  financial  support  for  educational  R6fD")  was  over  $192  million  for 

FY  19^68,  In  addition,  the  OB  analysts  judged  the  extent  of  under- 

*  reporting  in  these  figures  as  approxiioately  25%,  and  therefore 

estimated  that  conservative3,y  the  total  Amount  spent^,£u/ educational 
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R&D-in  this  country  in.  FY  1968  was  approximately  $250  million. 

Although  the  growth  rate  slowe<f*down  since  the  rapid  expansion  reported 
for  th^  period  betwees  1957  and  1968>  that  $250  million  total  figure 
has  clearly  more  than  doubled  over  the  past  decade.  Based  on  the 
analyses'  of  FY  1975  data  conducted  by  NIE's  R6fD  .System  Support  Division 
the  be§t  estimate  of  the  total  spent  on  educational  r/d&I  in  this 
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(In  thouMnctt  of  dollafi) 


Table  6,2 


iFiscai  Project  R5tO' \,Labora*  ^  Con-  -  , 

Dor.  *  *^  *  .1  ^f^^C    Tra^nmg  .  Total 

Year  RaD  Centers  torles  strtict*oo 

1969  (est J  $23,667  Slt).800  $23,600  $4,226     $6J50  $29.58t  $98,624  J 

J968  20,723  10,893  22,926    ,2.845      6.164  593  64,144 

1967  20,514  8,030  17,669     2^693      6.481  329  58,676 

1966  26,429  6^79^  8,658     1,064      7,189  1,311  51,230 

1965  13,672  2,168  -  _  15^40 

1964  10,500  998  -  t-  11,498 

1963  6,985  -  ^  f  .   ^  6,985  ^ 

1962  ^    4,644*  "  _           ^  _  4^644 

196t  .   3^56  ■  _  3,356  / 

^    ,  1960  '3J96  _  _  3^196 

1959  2,700  -  ^               ,  2,700 

195S    '  2,300  ^  -  ^   2;30a  " 

'   195  7  998  -  ...  998 


BureaOf  of  Research  ObXiga?ions  (for  Cooperative  Research  Only)  / 
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fiscal  „ 
Year                      <  Net  Obligations 
   (thousands) 


'  7955 
T956 
7957 
1958 
1S59 
1960 


9 
T7 

630" 
835 
6,030 


T96J     -  *'299 


6,41  T 
8,990 
12,632 


1962  ' 
1963 
1964 

1965  ^3,976 

1966  1^,552 

1967  ,  15,564 

1968  18,355 

1969  19,352 


23J00  (esttmate) 


Z 'Table  6.3  ■ 
y 
-  -  Cont-enf  ImprovifeCTJ 

Program  Obllgacions  for  Fisca^Jears 

'  .  1955-1969 


Fiscal  Year 


Head  Start      ^.  A 
Research  &  Demonstration      S^^Kl    $36  $41 
Evaluation  '  f^^j       23  19 


_^  1967     1968  1969 


23 

S^fiT      5.9  6.0 


Total 

Research  &  Demonstrttton  ^  


Evafuatton 
TotA\ 


Z5 
2.2  AJi 


CommiinUy  Action  Program 
(Education) 

Research  &  Demonstration         5:2       4  7       4  ^ 
Grand  Total  q      t2!8  U% 


Table  6.4 

OEO  Educational  R&D  Expenditures 
(In  Millions  of  Dollars)^ 
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56      57      58      59      60      61  62 


63      64.  65 


'  3f 


Figure  6-1 

Appropriations  for  "Research  and  Training' 
'.U.S.  Office  of  Education,  1957-1969 


•  69 
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TA^LE  3t.-00CUMENTEO  MINIMUM  BASE  FINAN- 
CIAL SUPPORT  FOR  EOUCATjONAL  RESEARCH 
AND  DEVELOPMENT  BY  SPONSORING  AGENCY 


United  SutH  Office  of  Education 
National  Science  Foundation 
National  Institute  of  Mental  Health 
National  Institute  of  Chtid  Health 

and  Human  Development 
Office  of  £conomrc  Opportunity 
Department  of  Defense 
Other  Federal  A^ncies  {Labor; 

Commerce;  Children's  Bureau; 

Agriculture;  Social  Rehabilitation 
.  Service;  Food  and  Drug  Administration; 

Interior;  and  Endowments  for  Arts 

end  Humanitres) 
Private  Foundations 
All  Other  {State  agencies;  higher 

education  institutions;  professiopd 

and  academic  associations;  etc.) 

Total 


FY  1968 

$101,967,000 
23,326^00 
11360.QOO 

8,377,000 
12.800,000 
6,046,000 


6J25,000_ 
7^44,000 


13,845,000* 
^192,290,000 


*TheSJE-3nd  DDC^Iect«d  maieHal  produced  a  figure  eom«^ 
what  lower  than  thj*.  To  it  been  wJded  amounu  etn*al  to 
aivaitabfe  NSF  figures  reprtfertting  th^  fitc^t  year  1965  c^btiga* 
Hottt  of  State  agenci^  dnd  Ukb)  year  1967  \oca\  Qovernmerjt 


Table  6.5 


Documented  Minimum  Base  Financial  Suppbrt 
for  Educational  Research  and  Development  by  Sponsoring  Agency 


409  ,  . 
country  by  all  sources  is  $613  tnillion,  ^ 

2,     DistrtbLitiojn  o£  Total  Educational  R/d^I  Funding  bv  Sources 

*"        ,  ^   « 

Tables  6.5  and  6,6  summerize  ^he  best  available  data  on  distribution 
of  total  educational  R/D^1  funding  by  sources>  for  n  1968  and  for 
FY  1975, 

A.     FV  1958  ^  \  . 

Table  6.5>  from  the  1969  OE  s^tatus  report  >  pi^esents  the  documented 

figures  for  FY  1968  totalling  over  $192  million.  The  double  ^ 

asterisks  we  have  adBed  to  the  table  indicate  the  funding 

sources  noted  by  tfie  OE  analysts  as  probably  underreported  in 
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this  table*  Based  on  the  extent  of  underreportlng>      as  noted 
above*>  the  OE  analysts  estimated  conservatively  that  around 
$*250  million  was  spent  by  all  sources  in  this*  country  in  FY 
1968  for  ^educational  R/DitI  activities* 

Although  the  items  in  this  tabl^can  be  used  to  gain  some  sense  r 
of  the  distributioti  of  the  total  by  funding  sources>  it  should 
i)e  emphasized  that  most  of  the  sponsors  the  OE  analysts  pinpointed 
as  underreported  were  non-federal  sources*  Therefore*  the  pro- 
portion  of  the  total  spent  by  private  foundations*  private  in- 
dustry* afnd  state  and  local  governniej^ts  is  Jikely  to  be  a 
subsfantially  larger  figure  than  is  suggested  by  this  table* 

Of  the  $192  million  documented^  total*  more  than  half  (approxima'tely 
$102  million)  came  from^OE*  ahother  $23  million  from  N'SF*  $13 
milll^^;l  from  0E6*  $20  million  from  the  National  Institutes  of  ^  , 
Mental  Health  and  of  €hild  Health  and  Human  Development*  another 
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•^^i  ^    TABLE  6.^ 

'  ^  (Dollars  in  Miliiocis)  " 

(fY  1975 

^e.e„.  cove^e.  .e.^.^e;.  ""^^'"-^ 
uepartmecit  of  HEW 
a-  Education  Division  (358.8)  ' 
;  '     -  OE  (264.5)  -  ■ 

-  NIE  (73.8)  \        ;  \ 

-  ASE  (20.6)  - 
b..  Public  Health  Service  (47.2)'  ■ 

Office  Of  Human  Developn,ent  (15;4) 

/■  Asst.  Secretary.  -.Planning  and  E^al    (1  3) 
--Social  Rehabilitation  Service  C2) 

B.  Department  of  Agriculture  " 

C.  Department  of  Defense 
D-  Depaftment  of  Interior 

Department  of  Labor  .    .  ' 

Department  of  State 

Indcpaendent  Agencies  '        .  ■ 

a-  Action  ;  . 

Appalachian  Regional  Commission  ^ 

c.  Community  Service  Administration 

d.  National  Endowment  for  the  Arts 

e.  National  Endowment  for  the  Hutnanitles  ^  ■" 


E. 
F. 


OA' 
'2U5 
'  1.2 
0.1 
1. 4 

■  0'.  0* 
1.3 
2.5 
0.0* 


f;  National  Science.  Foundation 
8-,  Smithsonian  IcisUtution  • 
State  GoVernment'Tunds  ' 

Local  Government  Funds  • 

Private  Pqundati-on^ 

Other  Private  Sector  Sources 


17  A 
39.9 
3.2 


/ 


/• 


40.0 
(39.0  -  60.0)** 

4.0 

(2.0  -  10. 0)^* 

57.0 
(57.0  -  65.0)** 

5.0  ■ 
(3-0  -  25.0)** 
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$6  million  from  the  Department  of  Defense  (likely  to  be  a 

f 

substantially  underestimated  figure) ,  and  around  $7  million  from 
other  federal  agencies.  ^ 

Base^  on  these  figures,  even  with  their  limitations,  it  seems 
clear  chat  in  FY  1968  the  federal  government  was  the  dominant 
st?bnpor  of  educational  R/D6I  activities  in  this  "country,  and 
that  within  the  fsderal  govejcTimeftt  half  or  core  w<is  spent  Lhroujh 

V 

B.    FY  1975 


table  5,6  suramarlzes  the  best  information  available  for  FY'i975, 

combirfing  estiMtes  for  non-federal  funding  sources  from  KIE^^  ' 

lj976  Databook    with  updated  information  on  FY  1975  federal  ■ 

obligations  for  educational  R/D&I  from  subsequent 'Analyses 
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prepared  by  NIE's  RStD  System  Support  Division,  ^ 
a.    Non-Feder^X  Sources 

Although  it  would  appear  from  this  table  that  we  know  a  bit 
tnore  abt^t  non-federal  sourc"^  of  educational  R/D&I  tunding 
fdr  FY  1975  than  we  did  for  FY  1968,  it  must  still  be 
underscored  that  the  Information  on  state,  local,  and  private 
sector  funding  represents  estimates  froni  highly  inadequate 
sources.  ^Thje  state  and  local  data,  for  instance,  cone  Irom 

N'SF*data  series  that  do  not  include  dissimlnatiort  and  , 
utilization  activities  (which  are  clearly  of  major  significance 
in  the    educational  R/dSiI' funding  p  rovidcd  on' the    s t^te 
and  local  levels).  Also,  the  1975  figures  are  extrapolated 
from  the  most  recent  data  available  —  i,c,,  1973  for  the 
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state  government  figures,  and  1969  for  the  local  governmeriT 
data.  There  is  reasonably  good  infomation  about  funding 
provided  by  private  foundations,  but  virtually  no  data  at 
all  about  other  private  sector  sources  of  educational  R/D&I 
funding. 

"  *  u 

b.    Federal  Sources  of  Fundin^^  Four  DajLa^ases^  and  NlE^s 
Composite  Estimate \ 

We  are  in  a  much  stronger  position  now,  though,  with  respect 
to  understanding  the  sources  and  distribution  of  f edergj, 
funding  for  educational  R/D&I,^  The  best  estimates  currently 
available  were  developed  by  NIE*s  R&D  System ^Support  Division, 

based  on  the  four  existing  data  bases  on  federal  funding 

53  .  '54 

of  educational  R&D       we  referred  to  earlier^ in  this  chapter; 

-  The  MSF  data  base:  These -data  are  collected  anually 
tronj'''^ederal  agencies  by  the  NSF  Division  of  Science 
Resource  Studies  and  are  published  annually  in 

An  Analysis  of  Federal  Funding  by  Function. 

-  The  0MB  data  bos^l  These  data  are  collected  anually  for 
the  Special  Analyses  submitted  to  Congress  with  the 
t*resident*s  ^proposed  budget  each  January.  The  data 

in  these  analyses  are  presented  in  aggregated ^orm, 
across  agencies,  to  provide  an  overview  of  how  federal 
funding  as  a  whole  is  affe&ting  specific  program  areas. 
Educational  R&D  is  one  of  these  program  areas. 

-  The  MAS  study  of  social  research:  this  one-time  study 
collected  program-level  data  in  15  mutually  exclusive 
social  policy  areas,  including  education  as  one  of 

%he  fiftee^n  areas*  ^ 

•Vj7 
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-  The  SRG  data  base:    This  project  -  level  'daca  base 
^  *  Is  maintained  by  Che  Social  Research  Group  of 

George  Washington  University  from  and  for  tho 
member  agencies  of  tbe  Interagency  'Panel-  for  Research 
i  and  Developtneat  on  Early  Childhood  and  Adolescence. 

^hese  four  daca*bases  differ  on  several  key  conceptual  and  pnocedural 
Issues-    The  differences  are  summarized  in  Figure  6,2>  reprodu<ied 


1 


froni  an  article  published^  by  Ward  Mason  and  Carnot  Kelson  of  NIE*s 
&D  System  Support  Division, 
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-  Research  functions :     The  four  data  bases  differ  signifi-  - 
cantly  ip  terms  of  which  research  functions  are  included 
and  thereforcTwhat  is  and  is  not  included  In  the  figures 
for  educational  R/D&I  fi^nding.    The  narrowest  definition 
is  used  in  the  NSF  data  base,  which  includes  data  for  only 


research  and  development.    Excluded  are  such         functions  _ 
j       as  dissemination  and  demonstrations.        The  broadest 
^  definition  is  provided  by  the  NAS  study  which  includes 
data  on  research*  development >  dissemination >  demonstra- 
^     tionSj  evaluation>  and  statistical. activities  as  well*  As 
can  be  seen  in  Figure  6,2>  the  0MB  and  SRG  data  bases  fall 
^etween  these  two  extremes  in  terms  of  the  research 
rune  t i ons  inc 1 uded , 

"  Definition  of  Education:    Assumptions  underlying  these  dat^ 
bases  differ  in  terms  of  the  extent  to  wh*cb  "education- 
relevant^  activities"  are  conceived  to  include  training  or 
infonnal  education  or  nOn-school  sources  of  learning  as 
well  as  formal  schooling.    The  definitional  issue  takes  on 
particular  significance  in  determining  which  areas  of 
fundamental  research  are  ''relevant  to  education*" 
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Comparisop  of  Data  Bases  with  Regard 
to  Various  Conceptual  anc!  Procedural  Issues 
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-  Pnimary  and  Secondary  Purposes:    -The  KSF"d^C;i  base  differs 
from  Che  oChers  in  that  it  includes  data  on  oaly'chose 
piTc^g^ams  for.whi^  edjicacioa  is  the  primary  purpo^K  ^  Tho^  * 

"^other  data  basefe  are*broader  in  that  they  also  include*  '^"^-.^ 
programs  that  have  education  as  a  secondary  pur|*bse  (e.g\: 
Sicieace  educatioa>  where  promoting  science  may  be  the 
^primary  purpose  but  educatioasTl  objectives  are  clearly  a 
secondary  purpose). 

-  Budget  Unit:     Fj^tnjdin^  data  are  repotted        the  literature  in 
j  '  terms  of  appropriations >  obligations  (i.e.>  funds  committed 

through  grants>  contracts^  etcO>  abd  outlays  (funds  actually 
%pent)*^   The-  0MB  data  base  describes  outlays .    All  the  other 
^  dat$  bases  are  in  terms  of  oblig^^tions.  ^ 

Unit  of-^  Analysis:    The  StC  data^base  is  the  only  one**  in  which 
data  are  collected  on  the  pro ject  leve}.     In  all  the  others> 
data  are  gathered  on  the  program  level* 

i 

.    -  Self-Report  vs*  Trained  'Coders:    In  the  case  of  both  the  IflSF 

^      and  0MB  data/series>  data  are  reported  by  agency  officials. 

Each  yeat>  a  different  official  wi?hin  ^he  agency  might 

provide  tj>tf  information.    And  ^ach  official  (and  each  agency) 

V     interprets  the  instructions^ and  definitions  in  terms  "of  his 

own  frame  of  reference.    The  NAS>.SRG>  and  NIE  data  bases 

have  the  advantage  of  being  developed  by  trained  coders > 

using  uniform  criteria  across  agencies  for  classifying 

prograns  and  projects^ 

*  * 

Agiancy  ^nclusivenessf    In  addl^ion^  the'diffei'ent  data  bases 
differ  in  their  range^f  Inclusiveness  of  agencies*    The  ^ 
MS^*wJata  base  on,  education>  for  instance*  is  gathered  fror 
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only  a  small  riaijber  of  federal  4^nplel^.  .-'^r^  SRG  data  base 
is  also  limiced  in  Chat  it  was  (^vd(x6|)ed'fif*wn  data  from 
t   only  the  member  agencies  of  the  T}n±er^^etii^'f*anels  for 
^-Research  and  Development  oA  Earl^'Chi^yh<Sq<Ji^nd  AdolescaAce, 
and  the  projects  reported  include  only  those  involving 
populations  in  the  two  age  groups  of  concern  to  these  agcncijes. 

As  the  MIE  analysts  reviewed  these*  data  bases>  it  became  clear  that 
none  of  thcra  was  adequate  to  cover  all  the  activities  .now  defined 
^uc^tional  KPU  funded  by  all  federal  agencies.    The  NSF  data  base 
was  ::oo  *Ximit.ed -in  its  coverage  of  ^federal  agencies^and  research 
functions,  and  it  was  furt>^  limited  in  validity  by  the  use  of 
agency  self-rep6rts  of  the^needed  data.    The  0MB  data  base  covered 
a 'larger  number  of  agencies,  but  the  data  provided  in  the  published 
reports  could  not  be  disaggregated  to  the  level  of , detail  desired. 
(For  instance>  the  funding  data  could  not  be  separated  by  function*) 
And  these  data>  like  the  ^SF  data>  suffered  from  their  reliance 
on  agency  self -reports . 

the  K'AS  data  had  ^^veral  advantages  over  the  NSF  apd  0MB  data  bases* 
The  ^AS  study  team  developed  a  *  taxonomy  of  R/D&I  functions  covering 
the  full  range  of  functions  and  specifying  definitions  of  terms. 
The 'data  could  be  disaggregated  Co  the  level  of  agencies-^  subunits 
of  agenciesj  and  programs^  as  well  as  functions.    The  data  were 
coded  by  a  trained  team  of  coders>  aPnd  suf f icient''backup  material 
was  gathered  on  e»ch  program  to  permi t  ^receding  if  additional 
i;rite^ia  were  developed*    And  most  important:  'for  tflp  purpos^  the 
data  W€y:e  available  in  a  form,  that  permitted  different  decisions 
to  be  mad£i  by  differenc  analysts  as  to  whether  to  include  or 

However>  the^NAS  data  also  had  some  limitations.     (a)  Data  were 
'collected  on  only^  f our  variable*^:    agency/program>  social  pblicy^ 
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area, ^  R^iD  .function,  anS  fiscal  year  (1975-77J,    Further  dfViaggre- 
Ration  "(by  target  group";  problem  area,  etc-)  is  not  possible, 
(b)  The  data  can  be  further  disaggregated  than  the  i^SF  or  0MB  data 
bases.    However,^  they  cannot  b^, disaggregated*  to  a  level  finer  than 
the  program  level*    Consequently,  Some  lai^ge  and  heterogeneous 
programs  had  to  be_  cocJed  ^into  single  categories.     If  project-level 
data  had  be^n  available,  this  would  have  pscmitted.  different 
components  of  these  large,  hetsroge^ieous  programs*  to  be  coded  in 
differen£  categories.  ,  (c)  The  diit^r  for  the  three  fiscal  years 
FY  1975-1977  have  different  iiean|ngs;     FY  1975  data  represent 
obligations*  FY  1976  data  represent  some  obligaticms  cind  some 
estim^'fes  based  on  known  appropriations;"  ^nd  FY  19.77  data  represent^ 

budget  requests.    Trend  artalyses/based  on  such*  different  kinds  of 
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data  mig'ht  be  somewhat  risky- 

The  SRG  data  overcome  some  of  these  problems,  but  suffer  from  other 
weaknesses,  '  It  is  the  only  d^ta  base  that  provides  project  level 
data^    It  share^  with  the  NAS  data  base  the  advantages  of  use  of  a 
detailed  classification  scheme  and  trained  coders".    However,  as 
described  by  the  NIE  analysts,  the  RG  data  base  is  '^both  larger 
and  smaller  than  ou^  domain  of  interest*'.    It  is^larger 

in  that  It  includes  niany  projects  outside  the  area  of  education 
(e.d,;  projects  in^the  areas  of-health  and  welfare  services).  It 
is  smaller  in  that  'the  .data  are  incomplete  in  terms  of  adequate 
representation  of  agencies,  functions,  topical  areas,  and  ^ge  , 
groups.    The,  data  come  from  only  those  agencies  whicrh  are  members* 
of  the-  Interagency  Panels  on  Early  Childhood  and  Adolescence 
Research  and  Development.    There  are  27  such  agencies,  but  excluded 
are  NSF,  the  Department  of  Defense,  and  the  National  Center 
for  Educational  Statistics,  all  of  which^ contribute  in  important 
ways  to /federal  support  of  educational  R/D&I.  ^Excluded  are  some 
dissel^ina tion  activities  and  all  general  purpose  statistical 
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activities;-  The  coverase  of  topical  areas  of  relevance  co  educ^itio^. 

is  severely  lini^ed:j^^ly  projects  focused  on  individual  learning 

and  dev^lopnient  a^  included*    And  the  age  groups  affected  by  the 

R/D&T  work  included  in  this  data  base  are  restricted  to  early 

childhood  and  adolescence.    No  work  of  relevance  to  posL-seconda^y 

58 

education  or  to  adults  is  included  in  this  data  base* 


Given  the  strengths  and  weaknesses  of  t;^se  various  data  basesj  the 


NTE  analysts  decided  "to  develop  a  conpo^te  estimate  that  would 

permit  naximum  use  of  the  inforr-ation  provided  \>y  all  the  data 

,  '  bases.    The  NAS  data  base  was  judged  ^o  be  the  most  complete  in 

,  terms  ^of  NIE  s  definition  tff  the  domain  of  interest,  and  therefore 

the  NASdata^were  used  as  the  starting  point  of  the  analysis*  NI-E 

^^^^   developed  its  own  analytical  fr^<iiewbrk  (which  we  shall  discuss 

below)  and  used  this  framework- as  a  basis^  for  examining  the  NAS 

data  and  backup  materials  dn  programs  to  decide  which  programs 

should  or  should  not  be  included  in  its  composite  data  base  and 

J 

^how  .the  data  should  be  regroLjped  and  interpreted*  In  addition,  the 
'       KTE  analysts  examined  the  other  data  bases  to  locate  adtiitipnal 

programs  that  fell  within  NIE's  definition  of  the  domain  of  interest 
but  had  not  been  included  in  the  NAS  data, base.    Where  relevant, 
information  from  the  other  data  bases  was  also  used  to  answer 
remaining  "questions  about  the  relevance  of  particular  programs 
that  might  be  included  or, excluded  frx>n  NTE*s  composite  data  base. 


We  shall  have  more  to  say  below  ab«^t  .  the  NIE  frameworkj  and  how 

and  why  the  HAS  scheme  was  modified  by  the  NIE  analysts.    For  our 

present  purposes,  we  ■su.TLTiarize  below  the  findir.gs  of  the  first  NIC 

.analysis*  designed  to  provide  a  '*best  estimate*'  of  total  federal 

funding  for  edttcatiohal  R/d&I*    These  findings  are'  suinmarized 

in  Table  6*  7,"  repfoduc^  from  publications  prepared  by  the 
59 

HIE  analysts. 
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Composite  Estimate  of  Federal  Obligations  for 
Education  Kno^/ledge  "Production  and  Utilization 
by  Department  or  Agency  and  Program,  Fiscal  Year  1975  (Thousands) 


O 

ERIC 


A20 


As  shc?vn  here/  the  cocal  figure  for  FY  1^75'  obligacions  was  * 
estimated'by  the  NIE- analysts-^to  be  $513  million-^^^    That  figure 
was  (JistribuCed  across  six'^federal  departments,  seven  indcpkende'nt 
agencies,  and  56  programs*    The  bulk  of  it,  however,  was  obligated 
through  the  Deparcmertt  of  Health,  Education  and  Welfare.  HEtf*s 
$422,9  mill-ion  Qbligation  represented  82*A%  of  the  total.    T^g  * 
Education  Division  of  HEW  alone  accounted  for  69,9%  of  'the  total 
federal  funding _ f igure  (84.8%  of  the  HEW  figure).    U'ithin  thc^ 
Education  Division*  Ot's  S264.4'  nilllon  obligation  accounted  for 
51*57  of         fc.:jrnl  fur^di-ni;  for  educational  R/Dil,  vhile  ::iE's 
$7>.8  million  accounted  for  14. 4X.    Clearly,  then*  despite  the  fact 
that  XIE  was  Established  as  the  lead  agency  for  educational  K&T>, 
it  controls  a  relatively  sniall  proportion  oi  federal  funding  for' 
educational  R/DSI  in  this  country.    OE  continues  to  be  not  only 
the  single  largest  source  of  educational-R/D&I  funding  but  also  the 
sponsor  of  more  than  half  of  all  the  federally  funded  educational 
R/D5[I  activity  in  this  country.  « 


3*      Federal  Funding  of  Educational  R&D  bv  Function 
A.      The  1:AS  Data  Base,  as  Modified  bv  ME 


'*To  detGrmiae  how  educational  R&D  funding  was  distributed  across 
61  - 

R£(D  functions,      the  \'IE  analysts  used  the  N'AS  data  base  as 

the  best  single  source  of  incormatiop  that  also  permitted 

^  t  .  *  62 

re^inalyses  tx>  be  carried  out*  with  a  minimum  of  difficulty. 

That  d^ta  base  covered  no^t  (88^)  of  the  programs  included 

in  S[£:'r  composite  d^ca  base.    These  data  had  the  further 

advajitagc  of  careful  coding  by  trained  coders  using  a  detailad 

scheme  for  classifying  programs  by  functions  and  ^ub-functions. 

In  addition,  the  backup  material  on  cach^ program  permitted  the 

NIE  analysts  to  recode 'iccmt.  where  nece?;j;ary  to  conform  to 

62       '  ' 
NIE's  analytical  framawork.  '  ^  ^ 


i 
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The  NIE  tea^i  cheated  a  new  data  base  for  their  analyses  by 

establishing^,  a  number  of  decision  rules  as  to  what  programs 

frcisi  the  KAS  data  base  would  or  would  nat  Be  considered 

felevant  to  education.     In  creating  this  new  data  base,  the/i 

examined  the  data  KAS  had  classified  as  falling  within  the, 

domain  of  education  (one  of  15  mutually  exclusive  social 

policy  areas  in^  the  NAS  schetB^)  .  ^  The  NIE  team  also  added 

to  this  data  base  some  programs  N/^  had  categorized  in  four 

63 

of  the  other  mutually  exclusive  policy  area^        (Due  to 
l'^-  ^'.tually  €xcl'isiveMiature  ^o^  tho  ^:AS  categories,  pro^^ran?^ 
were  classified  based  on  their'Primary  goals. only.    The  MIE - 
analysts  determined  that  this  was  too  restrictive  a  boundary 
for  the  domain  of  educational^R£(D  and  therefore  they  also 
e:;amined  data  froJn  four  sub-categories  having  primary  go^ls 
in  other  policy  areas  but  secondary  goals  that  placed  them 
within  the  domain  of  educational  R^D  —  science  education 
(^Irorn  the  policy  area  labelled  "science  and  technology"); 
'health  education  (from  the  "health"  policy  area);  selected 
programs  from  the  area  of  "cultural  affairs";  and  selected 
programs  from  the  area  of  "employment >  manpower,  and  training". 

The  NIE  analysts  then  modified  the  MAS  category  scheme  by 
omitting  some  categories  and  regourping  others.    The  decisions 
they  made  were  based  on  their  conceptions  of  the  most  use- 
,ful  ways  of  analyzing  the  data  for  the  domaif^  of  educational 
r/D^1-    Consequently >  the  KAS  categories  of  "prograin  and  , 
administrative  data"  and  "training  and  fellowships"  were 
excluded;  "evaluation  research"  was  classified  under 
"research"  rather  than  "evaluation  activities",  and 
"statistical  research*'  was  classified  under  "research" 
rather  than  "statistical  activities";  "social  experimenta- 
tion" and  "policy  formulation  demonstrations"  were  coj^bined 

/ 
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'in  a  single  category;  , and  MIE  was  somewhat  selective* in 
including  programs  in  the  MAS  category  labelled  "miscella^ieous 
demonstrations" .     (Fori  the  rationales  underlying  these 
decisions,  the  reader  is  referred  to  the  materials  prepared 
by  the  NIE  analysts,  cited  above.)  '  ^ 

Table  6.8,  reproduced  frcva^gn  article  V^^^P^^^^d  b,y  the  NIE 
64 

analysts,      shdws  the  classification  scheme  used  by  NIE 

*      '  65 

to  analyze  the  data  base  by  functions.        Under  the 
c*ategory  of  ''Knowledge  Production'*,  tbe  NIK  tear,  included 
all  research  and  statistical  activities.    The  category 
labelled  "Problem  Solution"  inC:ludes  all  evaluat^ton  activities, 
development  of  materials,  policy  formulation  deir^onstrations, 
and'selected  miscellaneous  demonstrations.    The  ^'Utilization" 
category  includes  all  dissemination  activities  ^nd  policy  ■ 
implementing  demonstrations. 


B>      Findings  on  Funding  Pjistribution  by  Function  ^ 

As  shown  in  Table  6^8,  nearly  60X  of  all  federal  funding  of 
education  KPU  in  FY  1975  was  obligated  to  problem  solution 
activities,  while  30%  went  to  utilizatip.n  activities,  and 
10%  (10,7%  to  be  more  precise)  went  to  what  NIE  has  labelled 
knowledge  production  (mostly  research).    Within  these  cate- 
gories >  the  functions  receiving  the  largest  share  of  total 
obli'feations  were:    development  of  materials  (21,2%)j  policy 
forpiilatidtt  denonstrations  (21,3^),  policy  implement ing 
demonstrations  (19, 1%) ,  and'  niscellanecJus  demonstrations 
(12,7^),    Research  and  dissemination  accounted  for  only  a 
little  more  than  10%  each.    Evaluation  activities  accoun"€ed 
for  only  4%,  but  the  actual  proprotion  spent  on  evaluations 
and  evaluacion-relatcd  activities  is  higher  since  evaluation 
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.    TABLE  1 

FEDERAL  OBLIGATIONS  FOf)  EDUCATIONAL  KNOWLEDGE  PflODUCTjON  ANO 
UTtUZATION  IN  FISCAL  VEAR  1975  BV  SUB^FUNCTION/ 


Function  and  Sot^unction 


Porceni 


I.  KNOWLEDGE  PftOOUCTlON  ' 

A.  R&saajch*  , 

1.  Geoef^  purpose  StBb3t>C9 

2  Davetopm«nt  of  sumsttcal  programs 
W  PROBLEM  SOLUTION  * 

3.  Evaluation  data  '  ' 
B  Px>hcf  f6rfhutat»on  ddmonstraljona 

C.  Dev^J^wil    mato'iati  ' 

D.  M,t»cdtta^eoii»  demoA)trabo^ 

III.  UTlLiZATiON 

B.  Oi»$«rTiinalioo 

1.  PubScation  &  di»tnbubon 

4.  Technical  a**htanc& 

5.  Conttf enc^  to  di^s^mtnate 

6  Cfeahon  c»i(ji»$«minahon  networks 
7.  Mi$ce{ian90ti» 


$452^5 


2.9&7 


2.57^ 
391 

269.4  ia 


19.663 


13,713 
2.366 
3,564 
06.462 
95.957 
57.324 

134.301 . 


86.036 
43.215 


2,424 
7.670 
4p949 
7.921 
10,060 
t0.903 
4^63 


100 


107 


J0,1 
.6 


5^6 


4.3 


3.0 

.7 
21  3^ 
21.2"^ 
1Z7 

300 


19,1 

ia7 


1.7 
22 


Sourer:  Nabonal  Acad«^  ^  Soenc«»,  Study  Prpj»ct  on  Social  R»»«afCh  and  Dev^^opm^L  as 
mM^fied  by  the  National  tnMtute  Educabon. 

^Sift^run^tiona  fot  iw^t^  ar«  nol  shown  b9C3UM»  for  t}>9*mo9t  part  they  are  admintstrativa 
oaiegonw 

^An  ufrfelennifted  amount  ol  "aiatislScal  fwaarch*"    induded  under  rweaich. 
*  'Evacuation  research  totaTtng  31.406 1%  indvded  undaf  r^ea/ch. 
*Le»9  than  .OSv*, 


Table  6,8 

Federal  Obligations  for  Educational  Knowledge  Production 
ancJ  Utilization  in  Fiscal  Year  1975  fay  Sub-Function* 
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funds  are  set  aside  within  'program  funding  <and  also  because 
evaLoation  research  has  been  classified  by  NIE  under  ''research*')  * 
Interesting  to  note/ 'all  c^r?egories  o£  demonstration  projects 
coEibir^ed  accounted  for  niore  than  half  of  cotal  education  KPU 
funding  (53%) . 

'If  recent  actions  taken  by  the  National  Council  on^'Educational 
Research  are  indicative  of  what  has  happened  since  FY  1975  in 
the  distribution  of  federal  funding  across  KPU  functions  -  (not 
\  only  irt  >:is:  but  Ln  other  federal  agenct-js  as  well>^  then  analyses 
of  current*  data  would  probably  show  an  increase  in  funding  for 
research  and  a  decrease  iri.  problem  soliition  activities  (notably 
development  of  materials),  while  utilizatiox^- activities  probably 
remain  at  about  the  same'^  level  as  in  FY  1975* 

\  66 
A.   .  Federal  FundlnR  of  Educational  R&D,  Bv  Agency      and  Function 

As  shovn  in  Tables  6.9  and  6.10  reproduced  from  on^  of  the  NIE 

analyses,      different  federal  agencies  emphasize  different  KPU  func- 

■  * 

tlons.  ^  ■  ,       '  ^ 

kj_  Agency  Emphases  in  Funding  of  Different  Functions 


Exe"iinlng  Table  6.9  first,  it  can  be  seen  that;    OE  emphasises  * 
dGuionstta tions  of  all  kinds  (nearly  693S  of  its  FY  1975  funds  were 
obligated  to  the  three  categories  of  demonstrations)*    NIE,  how- 
ever,^  emphasizes  only  one  kind  of  demonstraton  project,  and  does 
so  rather  fee^vily.    Policy  formulation  demonstrations  alone  ac- 
counted for  51*5%'^of  NIE  funding  in  Ti  1975,  *  In  addition,  develop- 

68 

ment  of  naterials  accounted  for  23-7/;  of  NIE  fundlftfi^  while 

69  V  ^ 

research  accounted  for  l5..8%-        The  much  smaller  sum  obligated 

by  tht?  Asslstfint  Secretary  of  Education  was  distributed  across 

development  of  materials>  miscellaneous  demons t rat  Ions »  and 
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*     OBUGAtlONS  POa  KNOWLEOGE  PflOOUCTION  AND  UTIUZATION  {H  FEDERAL  OEPARTMENTS 
AND  AGENCIES  BY  KPU  FUNCStjON.  PISCAL  YEAR  1975, 


Tot>l 

StJt. 

Form, 

Ofv 
»*L 

Totit 

Imp) 

D«(t>o 

1000 

10  7 

101 

0& 

43 

2U 

2t  2 

127 

13  0 

10  7 

lOOO 

110 

10  2 

oa 

52 

35  5 

12  0 

15  8 

214 

a£ 

lOOO 

101 

,  92 

09 

6i0 

53 

26.A 

no 

204 

ea 

1000 

SOS 

14 1 

4&2 

1,7 

2ta 

21  8 

33 

33 

1000 

49 

00 

57  a 

72 

20d 

&2 

3l.£ 

37  2 

3S2 

90 

Hlfi  Inst  ol  E<J 

100  0 

15« 

75* 

03 

237 

e« 

&5 

1000 

232 

1  7 

12^ 

17  1 

45 1 

2^9 

09 

to 

100  0 

31  2 

3t  2 

4ai 

32  5 

t5fi  r 

30  a 

1  1 

-272 

7/2 

13  0 

wa 

toco 

57  1 

*25 

42  » 

113 

31  6 

tooo 

1  1 

1  1 

e3£ 

ft35 

'  154 

15  4 

101 

1000 

25? 

25  2 

1T1 

7* 

*3 

£7  6 

-  ^6 

*  i  =  =  ^.  ■  :  


^able  6.9  ' 
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OBLIGATIONS  FOR  KNOWUOGE  PRODUCTION  AND  UTILIZATION  FUNCTIONS  SV  FEDERAL  DEPARTMENTS 

AND  AGENCIES,  FISCAL  yEAR-1975, 


or  Agt^tcy 

Tout 

T0U» 

>*>r«h 

S£>L 

Toisl 

Demo. 

Potior 
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30 
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at  s 
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13S7 
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1QQ0 

tooo 
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1000 

100  0 

tooo 

tooo 

1000 

tcoo 

1C00 

tCOO 

et  1 

1000 

790 

960 

sat 

400 

(000 

eo9 

90  2 

644 

7Sa 

'  ea.a 

tCOO 

^  7a9 

M7 

93  0 

44  1 

tooo 

733 

605 

604 

CWfic*  of  Aii^  Secr*taO' 

21  5 

16  5 

97* 

3S 

03 

49 

7.a 

05 

t  4 

54.3 

26a 

52.7 

ass 

6:^3 

2X0 

«ai 

605 

45  8 

»#r:  Jnst  of  Etf, 

24  1 

257 

207 

t2 

39  4 

t6  2 

47 

^  *3  1 

^.7 

10  3 

110  . 

25 

1« 

27 

36 

7.3 

92 

40 

04 
47 

1  3 

\.* 

0< 

34 

03 

03 

05 

00 
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13  a 

5a 

2» 

t3  4 

a4 

to 
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13  7 

52 
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04 

04 

53 

-\ 

t50 

20 

15 

32 

£2 

oa 

■^40 

to 

43 

4a 

39 

4 
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Table  6.10  < 
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research-^*^    Agencies  outside  o£  HEW  heavily  emphasized  develops 
ment  o:"  ^,^aterials*     (The  Department  of' Defense  obligated  ncjarly 
60%  of  its  educational  KPU  funds  to  development  work-    For  1^SF>  thti 
figure  was  nearly  55%*    The  highest  of  all>  83.5%>  was  obligated 
to  development  work  by  the  National  Endowment  for  the  Humanities.) 

B.      Dominant  Sources  o£  Funding  Per  Function  . 

Table  6^10  shows  how  nauch  of  the  federal  funding  for  each  function 
in  FY  1975  carne  from  each  agency.     Since  OE's  budget  accounts  for 
nore  :han  ha-f  of'all  the  federal  fundiaa  of  educational  R/D^fl> 
it  is  not  ^surprising  that  OE  is  the  main  source  of  funds  for  nlnost 
all  kinds  of  education  K?U  activities.    Only  in  the  cases  of  know- 
ledge production  (especially  statistical  activities)  and  develop- 
ment of  materials  do  we  fail  to  find  OE  as  the  dominant  sponsor. 

Despite  OE*s  predominant  role>  there  are  significant  differences 
Indicated  here  in  the  sources  of  founding  for  different  functions* 
Statistical  activities; >  for  instance,  are  the  virtual  monopoly 
(97.870  of  the  Office  of  the  Assistant  Secretary  of  Education 
(which  includes  the  National  Center  for  Educational  Statistics), 
Evaluation  activities  are  hearily  concentrated  in  OE  (89*5%)  as 
are  oolicy  implementing  demonstrations  (80*5%)  and  miscellaneous 
demonstrations  (92-2%)*    Policy  formulation  demonstrations  are 
funded  primarily  by  OE  (53*3%)  and  IJIE  (39-A%).     Sponsorship  of 
the  other  functions  is  dispersed  more  broadly  across  a  larger 
number  of  agencies.     Substantial  proportions  of  the  total  of 
educational  research  funding,  for  instance,  come  from  five  agencies 
0£  and  XIE  each  account  for  approximately  a  quarter  qi  the  total' 
(26.6%  and  25.7%  respectively)^  with  additional  large  chuaks  coming 
from  the  Office  of  the  Assistant  Secretary  <16o%),  the  Public 
Health  Service  (11.0%),  and  the  Department  of  Defense  (12.8%). 
Development  ot  materials  is  also  spread  across  five  different 
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agencies:    NSF  (22,7%  of  the  dCvelopmeat  fuading  total),  OE - 
(2l,0%)>  NIE  (l8-2%)>  the  NatioaalSiadowtnaftt  for/the  Humanities 
(15.0%)>  and  Che  Department  of  .Defense  (13,4%)-*  Dissemination 
finding  coTnes  primarily  from  three  agencies:    OE  (45.8%  of  the 
ciisseraination  totaf)>  ^JSF  (26.1%-)  and  NIE_(13il^.---^. 


,5.      Federal  Fundina  of  Educational  R&D:     By  Project  Content. 
Target  Group>  performer  Organizations >  and* Agencies 

71      *  ^  ' 

A.      The  SRG  Data  Base 

The  SAS"  data  basa\re  hav^e  been  considering  up  to  this  point  is  ' 
-the  most  complete  of  the  existing  data  bases  with  regai;d.to 
coverage  of  programs  falling  within  the  domain  MIE  has  defined 
,  as  educational  KPU*    However*  these  data  cannot  be  used  to  an- 
swer  questions  about  the  spetifics  of  federal  funding>  by 
problem  areas,  target  gSroups,  performing  orga^^ations,  etc. 
The  only  dat^  base  that^  can  shed  any  light^on  theae  issues 
is  th^^SRG  prof^ct-Ievel  data  base. 


a.  Limitations 

The  SRG  data  do  reveal  a  great  deal  about  the  funding  em-  ^ 
phases  of  different  agencies.    However,  before  we  summari'E^ 
some  of  the  more  important  findings  from  NlE's  analyses  of 
t^ese  data,  we  should  take  note  again,  of  the  limitations 
'  of  this  data  base  and  some  of  the  reasons  for  being  pautious  ^ 
about  attempting  to  generalise  from  theae  data  alone  'to 
stQtenentfi  ^^buut  ftjder^il  funding  of  educational  r/d&I  as  i 
a  whole  -  ^  • 

As  discussed  tarlier,  the  SRG  data  reflect  funding  from  only 
those  agencies  who  are  members  (if  the  Interagency  Panels  jpn 
Harly  Childhood  and  Adolescence  Research  and  Developinent 
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(and  therefore  no  data  are  inclQrded  from  such  important  ' 
,    educational  R^D  sponsors  as  NSF>  the  Department  of  Defense 
or  the  National  Center  for  Educal^onal  Statistics),  The 
projects  included  in  the  data-^asq  are  only  ones  dealing 
with  individual  learning  and  development  and  only  one,s 
dealing  with  the  early  childhood. and  adolescent  years.  The 
projects  in  ^he  SRG  data  base  account  for  only  58%  of  the 
$513  million  estimated  by  t5tE  to  have  been  spent' by  federal 

^    agencies  on  educational  K?U  -in  FY  1975.    In  agency-by-agency 
terraSj  that  means for  instance>  that  thjfc  SRG  (lata  include 
(jnly         of  the  .activities  funded  by  Of?im  FY  1975>  Only 
62%  of  those^fuoded  by  NIEj  and  none  of  those  funded  KSF . 
In  addition>  the  NIE  analysts  established"  various  decision 
rules  for  selecting  from  the  SRG  data  base  projec^ts  th^ 
iliet  their  criteria  as- "education  KPU  relevant",  ,  Only  2523 
of  the  3536  projects  in  the  data  ^base  met  the  NIE  criteria:. 
These 'ejiudation  KPU  relevant"  projects  totalled  $295  million 
in  oblig^tion^>  which  reprcS^ntad  80%  of  the  total  funds 
obligated  by  projects  Ih  the  SRG  data^  base.     In  short  >  the 
project  data  ^  summarized  below  describe  only  80%  of  the  SRG 

m    data  base>^nd  account  for  only  58%  of  total  ^deral  funding 
for  educational  R/D&I. 

■J  ^ 

bff      Classification  Scheme,'  as  Modified  by  NIE 

■  >  ,i  ~ ' 

The  SRG  da^a  were  coded  by  trained  coders  into  .£4ve  functions 
^  basic  iresearchj  applied  research>  evaluation  reft^arch*^  re- ■ 
search' support  and  utilization  "activitiesj*  and  policy  re- 
research.   .Applied  research  was  further  divided  into  four  sub 
categories:    pilot  study>  cJevelopment >  demonstration  anci/or 
replication>  and  other  applied  research.    The  NIE  analysts 


*  Research  support  and  utilization  activities  art;  .defined  as  "support 
T-for  t^he  planningj  implementation>  or  dissemination  of  research" 
I  (but  not  actual  data  collection  oj;  analysis)  "or  installation  of 
^  pTroven  models 
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then  regroufx  these  categories  an^  sub-categories-  make 

then:  consistent  with  the  NIE  three-way  classification  . 

scheme^    The  resultant  classification  scheme  is  sho^^n  in 

11  '  I 

Table  6.11  (reproduced  from  the  t?IE  report    ).  \  ^ 

The  skewed  nature  of  the  distribution  of  projects  in  the  SRG 
data  base  should  be  apTparent  from^  exanfination  of  this  table: 
■  according  to  these,  data,  problem-solving  activities  accounted 

for  92%  6£  obligated  KPU  funds,  while  NIE's  analysis  based 
'  on  the  NAS  data  ba&e  suggeSed  that  the  figure  should  be 
around  60%.    The  discrepancy  is  due  primai^ily  to  ^the  fa*;t 
'  ^that  most  utilization  activfties  'included  in  the  KAS  data 
base  are  not  included  among  the  SRG  projects^, 

B.      Distribution  of  Funding,  By  Primary  Focus- 

f 

The  SRG  category  scheme  for  coding  the  pfitnarx  focus    of  a  project 
is  shoxv*h  in  Table  6.12,^   Ther^e  a^re  eight  mutually  exclusive  cate- 
gories.   Ediicatiojrtfl  servic^re  is  only  one 'of  these  categories  but 
it  accounts  ^or  87%  of  the  projects  s^elected  by  the  NIE  analysts 
as  "edu'cation  KPU  relevant:  ^     (This  is  not  surprising  since  most- 
of  ,the  projects  in  most  of  the  other  categories  were  probably  ex- 
eluded  by  NiE's  selection  criteria.)    Within  the  category  of  edu' 
cational  services,  the'  emphasis  in  the  SRG  data  is  clear^Ton 
elementary  school  and  special  education*  - 

In  addition  to  the  codes  for  a  rpoject's  primary  ^^cus,  the  SRG 
codln^^  scheme  includ'^d  an  elaborate  heirarchy  of  categories  ?.nd 
s.ubcategories  describing  project  .content.    The  reader  is  referred 
to  t-he  full  report  for  a  description  of  the  various  codes.  U^at 
seems  most  relevant  hare^  i^^th^G  almost  all  <94%)  of  the  projects 
in  the  SRG  data*base^  selectGd\by  the  NIE  analysts  as  "education 
KPU  relevant"  were^  coded  by  tjie  5RG  analyst  as  "intervention  pro- 
grams and  activities,"  especially  interventions  involving  studies 
of  the  effects  of  various  education  curricula,  teaching 
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cs.*  j-j^                              i  Dollars 
-  Function                                                 J  \ 
^                                      j  (thousands) 

Percent  \  \ 

.Total 

Knowledge  P^pduction 
Basic  Research 

Problem  Solving 
Applied  Research 

Pilots  Demonstr*  s  Replic,  \ 
Development  " 
Policy  Rese^cb 
Evaluation  Research 

Utilization        "  ^ 
Res-  Sup.  &  Utiliz. 

295,041 

100 

17,216 

17,216 
270,577  ■ 

6 
92 

12,657 
|.  182,297 
50,656 
1,972 
22,995 

7,248 

4 
62 
17 

1 

8 

■ 

2 

7,248 

2 

<0  ^ 

I 

r 

*  Table  6.11  , 

Federal  Obligations  for  Early  Childhood  and  Adolescent 
'Education  KPU,  ,by  Type  of  KPU  Function,  Fiscal  Year  1975 
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Primary  Focus 


Dollars 
(thousands) 


Percent 


Total 

Oiild  or  Adolescent  Development 
_  Ptiysicai  -Development 
Csgnitive  Development 
Socibsmotional  Development 
Other  Development 


ily  \ 

'eighborhood  or  Conununity  Enviroi^- 
Broad  Social  Environment 
ScKly  of  Reseasch  Methods 


Health  or  Welfare  Services 
Day  C^e 
Health  Care 

Protective/Advocacy  Services 
Other  Services 

Educational  Services 
, Special  Education 
Early  Childhood  Education 
Elementary  School  Education 
'Secondary  Education 
.  Postsecondary"  Education 
Alternative  Education 
Other  Educational  Services 

Juvenile  Justice        ' ^  . 


295,041  , 


14,187 
*  1,949 
6,481 
4,640. 
1,117 

1,587 
33 
547 
2,285 

18,237 


3,788 
5,E:44 
5,293 
3,612 

257,531 
43,743 
5,636 
80,555 
18,671 
5,^48 
1,501 
101,877 

633 


100 


1 

2 
2 
* 

1 

1 


1 

2 
2 
1 

'87 


15 
2 

27 
6 
2 
1 

34 


*  Less  tl*ian  0.5  percent.  * 


Tablf  6.12 

Federal  Obligaclons  for.  Early  Childhood  and  Adolescent 
Education  KPU,  by  Primary  f'ocus.  Fiscal  Year  1975 


? 


techniques >  learning  conditions,  materials,  program  policies 
and  procedures,  '  ,  .  , 

When  one  aaaly2:^es  the  data  on  curriculum  projects  alone  (a  subset 
of  all  the  SRG  data)  some    intcrjesti^g  patterns  emerge.  Nearly 
three-quai*ters 'of  all  the  money  for  curriculum  projects  is  obli-* 
gated  for  pilot  or  demonstration  projects  or  replications^  Con- 
siderably less  of  the'  p.oney  is  spent  on  curriculum  development 
activities,    Reading  is  the  only  acSd^nic  subject  aVea  vrhere  at 
least  lOX  01  project  funds  are  spent  on  developiTtent  v-'ork.  Higher 
p?rc^:nrage^^  Jf^  f  unding  go  into  dev<i;lop:':ient  work  in  non-acadeniic 
areas  such  as  environmental  education>^ career  education>  voca- 
tional educartlon,  drug  abuse,  citizenship*  and  parenthood,  Voca- 
tional  education  -i^  the  only  curriculum  area  in  which  even  lOX  of 
the  funds  are  spent  specifically  on  evaluation  activities.  '  . 

Distribution  of 'Funding*  By  Target  Population 

The  projects  in  the  SKQ  data  base  were  also  coded  by  two  variables 

related  to  a  project's  target  population:    whether  or  not  the  * 

population  had  special  characteristics*  and  if  so,  what  these 

* 

characteristics  we>e  (e.g.*  bilingual,  physically  handicapped* 
mentally  retarded*  et9.);  and  whether  or  not  the  population  had 
speci^fic  demographic  characteristics  (by  ethnicity*  economic  status, 
or  residential  location)*  and  if  so,  what  these  characteristics 
were,         ^  f 

Table  6-13  and  tAh  (from  the  ^^IE  analysis)  present  the  SRG  cate- 
gories  and  distribution  of  projects  in  terms  of  these  categories^. 
Several  important  points  are  revealed. by  these  data.^_£!learly,  if 
these  data*  c**re  representative*  more  federal  education  KPU  funds  are 
spent  on  projects  targetted  at  children  with  special  characteristics 
(^♦77)  than  children  without  special  characteristics  (40%);  and  more 
federal  money  is  targetted  at  children  from  specified  demographic 


ERIC 


4      *  Note;  Mul  tlple  *codii;ig  of  projects  was  permitted. 
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Population  Studied 
(Special  Characteristics) 


Dollars 
(thousands) 


Percent 


'  Total 

Children  without  Special  Characteristics 
Population  Not  Specified^ 
Children  With  and  Without  Special 
Characteristics 

Cfiild^aii  with  Special, characteristics 
Bilingual 

Physically  handicapped 

Mentally  Retarded  ^ 

Learning  Disabled 

Dnotionally  111 

Academically  Slow 

School  Drbpout 

Abuse  d/Heg le  c  ted 

Drug  User 

Gifted 

Delir.quent 

Adolescent  Parent 

Runaway 


[ 

295,041 

100 

116,780 

40 

!  18,654 

6, 

i  ,21,571 

7 

138,036 

47 

1  76,480 

26 

29,045 

10 

16,025 

5 

1  12,616 

4 

i  11,794 

^  '4 

1  7,472 

3 

\  6,748 

2 

I     -  4,931 

2 

:     '  4,161 

1 

:  1,998 

1 

!    '  1,841 

1 

i  728 

♦ 

[  108 

♦ 

Note;    Sum  of  the  special  characteristics  of  the  population  studied 
adds  to  more  than  children^with  sfje^al  characteristics 
because  a  project  "could  be  classified  as  dealing  with  more 
than  one  special  population. 

*    I/ess  than  0.5  pe'rcent- 


V 


Table  6.13 

:  ^  ■  )  ' 

Federal  Obligatiojrs  for  Early  Childhood  and  Adolescent 

Education  KPU,  by  Social  Characteristics  of  Population 

Studied,  Fiscal  Year*i975. 

I  r  - 
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Population  Studied 
(Demographic  characteristics) 

I  Dollar^ 

j  (thousands)^ 
1 

Percent 

Total 

1 

!_  295,041 

loo 

Population  not  Specified 

118,928 

40 

Population  Specified 

■  176,113 

.  60 

Primarily  Poor 

Spanish^surnamsd 

Urb^n-^ 

Black 

American  Indian 
,  Rural 
White 

^   Indian  Ksservation 
Migrant 

Suburban 

t 

f  87,113 
!  78,195 
!.  58,500 
'   '         29, 57^ 
25,470 
21,963 
18,236  s 
:  8,332 
6,490 
4,917  . 

30 
26 
20 
10 
9 
7 
6 
3 
2 

fiotfe:    Sun  of  demographic  characteristics  of  the  population  studied 
adds  to  more  than  population  specified  because  a  project 
could  be  classified  as  dealing  with  more  than  one  population. 


Table  6,14  ^       "  - 

Federal  Obligations  for  Early  Childhood  and  Adolescent 
Education  i<PU,  by  Demographic  Characteristics  of  Population 
Studied,  Fiscal  Year  1975"^ 
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4^  ■ 

populacions  (60%)  than  children  in  general  i^OZ) .    Among  projects 

for  student's  with  special  characteristics,^  the  single  largtjsc 

category  is  targetted  at  bilingual  students  (26%)  5  followed  neict 

I 

in  size  by  students  who  are  physically  handicapped  (10^),    Only  IX  ^ 
of  the  funds  are  obligated  to  ptojects  for  the  gifted;  5%  to  pro*^^ 
jects  for  the  mentally  retarded;  A%  each  to  projects  for  learning 
disabled  and  emotionally  ill;*  3%  to  the  acadei?.ically  slow. 


In  terms  of  demographic  characteristics 5  more  'money  is  -spent  on^ 
projects,  targetted  at  urban  students  (20^)  than  on  rural  sttider>ts 
i7Z)  suburban  students  (2XJ  >  students  on  Indian  roser^/atioos  (37=)  > 
or  migrants  (2^).    More  money  i$  spent  on  projects  target  ted  pri- 
marily at  poor  students  (30%)  than  any  other  single  category.  And 
more  is  spent  on  Spanish-surnamed  students  ^26%) 5  essentially  phe 
same  category  as  the  bilingual  student^s  noted  above  >  than  all  the 
other  ethnic  categories  Con)bined>  ire.>  black  students  (10%)> 
American  Indian  students  (9%)  >  and  white  _st3tudents  (6%)  ^ 

73 

if  one  were  to  examine  the  data  for  curriculum  projects  only 
(rather  than  all  education  KPU  ^^evant  projects  in  the  SRG  data 
base)  J  some  differences  emerge  in  the  kinds  of  KTU  activities 
funded  for  curriculum  projects  targetted  at  different;  populations. 
For  instance>  the  projects  targetted  at  students  with  special 
characteristics  and  students  from  specific  demographic  groups  are 
far  more  likely  to  be  pilot  or  demonstration  projects "than  re- 
search or  development  or  evaluation>  etc.     The  cJata  on  proje<;ts  for 
students  who  are  bilidgual  or  physically  handicapped  or  f romn^specifi 
de^o^ra^hic  grottps,  for  insnance^  sho'^s  that  virtually  all  of  these 
are  pilot  or  demonstration  projects*    Among  the  groups  with  special 
characteristics*  a  signif ic^iit^^ount  of  development  ^'ork  (over 
23%  of  the  projects)  is  carried  outonly  for  the  'mentally  retarded 
and  the  gifted.    Among  specific  demographic  groups*  significant  ^ 
portions  of  funding  for  development  work  are  fo^jnd  only  for  rural* 

-suburban^*  and  mij^,rant  students.     SubSfcbntial  funding  for  applied 

J 

rcse,irch  fends  to  be  targetted  only  at  ^students  who  arc  drug  users* 
dr9pout^^,  abused  or  negleiteu. 

■IJi' 
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Distribution  of  FuadiaR»  By  Perfoming  Orgaals;at  ion 


Some  of  the  most  important  findings  o£  the  NIE*  analyses  relate 
to  funding  <lifferenccs  by  performing  organlza^Jions .    They  under- 
score the  fact  that  a  substantlCarVmount  of 'specialization  and 
division  of  labor  is  to  be  found  in  e^lucational  R/d^I,  ^despite 
the  system*s  relatively  immature  state  of  development*    ^s  stated 
by  the  NIE  analysts;  "Each  KPlf  function 'tends  to  be  supported 
largely  in  one  or  two  kinds  of  organizations,  and  each  type  of 
organization  tends  to  receive  a  majority  of  its  funds  for  only 
ona  or  Wo  functions/' 

Tables  6*15  -  6*17  (from  the  MIE  analysis)  provide  the  relevant 
data, 

As  shown  in  Table  6,15>  if  these  data  are  representative  then  42% 
of  federal  funding  of  education  KPU  activities  goes  to  LEAs, 
19%  ^%oes  to  academic  institutions  (including  RiD  Centers)  and  11% 
to  nonprofit  corporations  (including  regional  laboratories). 
Only  7%  goes  to  SEAs^  A%  to  other  state  and  local  agencies,  and 
5%  to  the  for-profit  corporations* 

The  specialization  of  performing^ organizations  by  function  is 
shown  in  Table  6-16<    The  LEAs^dferry  out  most  (66%)  of  the  demon^ 
stration  projects.    Academic  institutions  do  most  of  the  basic 
research  (71%)  and  over  a  third  (3A%)  of  all  the  applied* research. 
The  for-profit  corporation3s<^arry  out  nearly  half  (A9%)  of  the 
evaluation  research  and  one-fifth  (20%)  of  the  policy  research. 
The  least  specialisation  is  found  in  the  category  of  non-profit 
corporations  who  are  the  dominani:  performers  of  research  support 
and  utilization  activities  (52%)  t  development  evaluation  research 
f27%)  and, applied  research  29%). 
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Performing  Organization 

Dollars 

( thousands) 
- 

Percent 

Total 

295,041 

100 

i 

Academic 

/ 

54,912 

*  19 

Monprofit 

51,254 

.17 

Profit 

14,607 

5 

State  Education 

hgency 

20,776 

7 

Local  Education 

Agency 

123,628 

42 

Other  State  and 

Local  Agency 

11,097 

\  4 

Other 

13,768  ' 

6 

'} 

Table  6,15  ^ 

Fe'J-ral  Cbil^ations  for  Early  Childhoo'J  and  Adolescent 
Education  K?U,  by  Performing  Organi^atior.,  Fiscal  Year  1975 


_j  Perfomxng 
drganiz^ion  ' 


KPl]  Function 


Total 


Basic 
Res . 


Appl. 
Res . 


Pilot,  Den. 
G(  Replic. 


Devel 


Policy  Eval* 
Res .       Res . 


Re?.  Supp 
£ . Utiliz . 


Dollars  (thousands)!  295,041    ■  17,216    12,657  182,297 


50,655     ,  1,971      22,99(3  7,243 


Percent 

\ 

Total 

100 

■100 

100 

100 

100 

100 

100 

100 

Acad end  c 

19 

71 

34 

8 

33 

11 

21  ■ 

24 

Nonprofit 

14 

29 

8 

38 

34 

27 

52 

Profit 

5 

4 

2 

20 

49  / 

8 

SEA 

7 

4 

* 

8 

11 

2 

10  - 

LEA 

42 

0 

10 

66 

4 

17 

0 

Other  State 
£  Local 

4 

5 

14 

3 

4 

12 

1 

1 

"Other 

6 

5 

8 

7 

8 

5 

2 

5 

Percer.tages  based  on  data  appearing  in  appendix  2. 
*    Less  than  0.5  percent. 

Table  6.16 

■  Federal  Obligations  for  Early  Childhood 

and  Adolescent  Kducatrion: 

KPU  Function  by  Performing  Organization,  Fiscal  Year  1975 


ERIC 


Performing 
Organization 

Function  (percent) 

Dollars  1 
(thousands)  ;  Total 

Basic 
Res  . 

Appl 
Res . 

.    Pilot,  Dem. 
S  Replic. 

Devel . 

Policy 
Res . 

Eval. 
Res , 

Res.  Supp 
s  utiliz. 

Total 

295,041  ^ 

'  100 

6 

* 

4 

62 

17 

.  1 

8 

2 

Academic  - 

54,912* 

'  100 

22 

8 

27 

30  ' 

.  * 

9 

3 

Nonprofit^  ' 

51,254 

100 

5 

7 

28 

38 

1 

12 

7 

Profit 

14,607 

100 

5 

* 

4 

7 

2 

77 

4^ 

SEA 

20,776 

100 

* 

2 

67 

27 

* 

* 

3 

LEA 

123,628 

100 

0 

1 

97 

2 

0 

Other  State 
,      Local " 

11,097 

* 

100 

■ 

8 

16 

54 

18  • 

2 

L 

1 

Othef 

18,768 

■ 

100 

4 

6 

65 

21 

2 

2 

Percentages  based  on  data  appearing  In  appendix  2. 
*    Less  than  0.5  percent. 


r 

Table  6.17 

Federal  Obligations  for  Early  Childhood  and  Adolescent  Educiition: 
Performing  Organization  by  KPU  Function,  Fiscal  Yuar  19J5 


Table  ^*17  indicates  how  the  educational  R/D6(I  funds  received  by 
each  type  of  insciCutibn  are  distributed  by  functi<>n>  i*e,>  how 
dependent  each  type    of  institution  are  distributed  by  function> 
i*e,>  how  dependent  each  type  of  performing  organization  i?  on 
each  function  for  the  support  of  its  KPU  activities.    Not  sur- 
prisingly* given  what  we  have  'seen  above*  LEAs  are-almost  entirely 
dependent  on  demonstrations,    For-profic  corporations  are  largely 
dependent  (77%)    on  evaluations,     SEAs  are  heavily  dependent  on 
demonstracion  projects  C67%)>  but  also  receive  significant  su:as 
(27%)  for  development  work.    Mon-profit  corporations  receive  sub- 
stantial anounCi  of  their  support  for  dev^lopi:ienc  (38J!)  and  for  ' 
demonstrations  (2S%),    Academic  institutions  derive  federal  support 
for  their  education  KPU  activities  from  devleopment  work  (30%) > 
basic  research  (22%),  and  from  pilot  and  demonstration  projects 
or  replications  (27%). 

E,      A_^enc:5^  Differences 

a*      By  Function 

As  shown  in  Tables  6*18  an       19>  federal  agencies  differ  signi^ 
ficantly  in  their  emphases  on  different  education  KPU  activities^ 
The  Pu'bliq  Health  Service*  for  instance*  is  heavily  oriented  to^ 
ward  research:    53%  of  its  FY  1975  oblicagions  went  to  basic 
research  projects*  another  15%  to  applied  research  projects* 
and  an  additional  5%  to  evaluation  research*    More  than  78% 
of  all  the  education  KPU  relevant  basic  research  projects  in- 
cluded in  this  data  base  were  funded  by  the  Public  Health 
""Service;  30%  of  all  the  applied  research  projects  were  funded 
-    by  the  Public  Health  Service* 

0E>  by  way  of  contrast>  obligates  most  of  its  budget  (78%) 
to  pilot  and  demonstation  projects  nnd  replications;  the 
overwhelming  majority  (89%)  of  the  funding  for  work  in  this 


/ 

Function 

j  All 

1  agencies 

NIE        *  OE 

PHS 

Other 

Other 
Federal 

Obligations 

($000'S)  ; 

Total 

295,041  ; 

45,457 

207,889 

25,328 

14,828 

1,541  , 

Basic  Re^arch 

1 

17,216  i 

854 

1,167 

13.,295 

1,497 

404 

Applied  Research 

12,657 

5,662 

2,086 

3,756 

1,128 

25 

Pilo t.  Demonstra- 

tion, or  Replic* 

182,297 

7,649 

162, 866 

4,874 

6,502 

405 

Developcnen  fc  * 

50,656  . 

IS, 205 

28 , 28^" 

2,140 

2  ,001 

22 

Policy  Research 

1,972  . 

534 

" 1,151 

0 

216 

70 

KvSO-uation 

; 

Research 

22,995 

8,110 

9,660 

1,220 

3,448 

558 

ppsg^];-^h  Support 

arid  U til iza tion 

7,243- 

4,443' 

2,671 

43 

34 

57 

Percent  'Across^ 

Total 

100 

15 

7r 

9 

5 

1 

Basic  Research 

.  100 

7 

78 

9 

2 

100 

■  45- 

16 

30 

9 

.  * 

Pilot*  Demons tra— 

J 

tion,  or  Replic. 

100 

4 

* 

89 

3  ■ 

4 

100 

57 

4 

4 

It 

100 

27 

58 

0 

11 

T 

E"/alu£ition 

/  ' 

Research  ■ 

^      .  100 

35 

/42 

5 

15 

2 

and  Ufci  1  iZtX tion 

100 

61 

37 

1 

* 

'  1 

Percent  Jiciwi^^ 

Total 

io1r> 

100 

100 

100 

100 

100 

Basic  Research 

6 

2 

1 

53 

10 

26 

Applied  I^esearch 

4 

13  ' 

1 

15 

•  •  8 

-2 

Pil  ot ,  Demonstra- 

tion, or  Replic. 

62 

1  " 

78 

19 

44 

-26 

Development 

17 

39 

14 

8 

*^4 

1 

Policy  Research 

1 

!  1 

1 

0 

1 

5 

Evaluation 

3 

18 

5 

5 

2  3 

"ese<Trch  Support 

ai^d^Ufciliz^tion 

^2/ 

2 

* 

4 

Lc^^s  than  0.5  percent- 

^.  ' 

Table  6.18 

Federal  Obligacions  for  Early  Qtiilcihood  and  Adolescent 
Education,  KPU«  .Funding  Agency  and  Type  of-  KPU  Function, 

Fiscal  Yea*  1975 


ERIC 


Population  Studied  ; 
(sgecial  chacacteristtts)  ^ 


Cbli^a^iorts  f$ODO's) 

Total 

Pd^ulation  not  Specified  t 
rliildren  Wi':hout  Spedi^  Chara.cteristics 
Jotlv  Children  With  andAv'ithout  " 
Special  Characteristics i ; 

^lildren  with  5peci^l  Cnaracteristics 
Bilingual  \ 
i^hy,sically  Hanc^c^ped-^ 
Mentally  retarded^  ' 
^  Leaf'niS5-Disabled 
Emotion£flly  111 
Aca^mically  Slow  . 
School  Dropout  ' 
Abused/^'lg^ected 
Drug  User 
•  Gifted 
DeiinquGQt   '  - 
Adialescent  Parent 


All 

agencies 


Other 

NIE            OE          ?HS/N'IH    '  HEW 
 \  ^  


'  Other 
Federal 


Percent  Across 


*Total 


Population  ;iot  Specified 
Children  Witiiout  Special  Characteristics 
Both  Children  Wj.th  and  Without  ^ 
Sfpecial^  Characteristics         '  ^' 

(Continued) 


^Fed^M'.tl  Obligations  for  Earl 
Fundinp^  A>;t  itGy  and  Spec  in]  Chnrdct 


4 

^*295,041  ' 

4.5,457 

*\r\^       o  A 

2D7 , 889 

25 ,328 

14 ,826 

1 , 541 

18,654 

1,789 

10,722 

1 ,102 

"  214 

116,780 

35,712 

67,634 

4 , 297 

8,121 

1,015 

21,571 

1,990 

15,683 

3,655 

223  - 

19 

'  138,036 

5,966 

119,744 

6 ,654 

5,380 

/ 

292 

76,840    !  2,449 

73 ,454 

296 

640 

0 

29,045 

233 

27,527 

1 ,285 

0 

»  \ 

16,025  ' 

233 

13 ,424 

2 , 367 

1 

12,616 

0 

11',  291 

1 ,325 

0 

11,795 

0 

9,778 

1,751 

265 

0' 

7,473 

1,343 

5,220 

56 

234 

■■.6,748  ■ 

2,02^ 

4,068 

412 

0  . 

244 

4,931- 

■  ,  0 

4P662 

^    ■  0 

4,270 

0 

4, 161 

324 

3,837 

0 

6 

-1,998 

1,244 

0 

"  0 

0 

1,841^ 

194  . 

1,430 

217 

0 

■728  m  0 

336 

151 

^1«3 

58 

r 

108 

■  0 

108 

•0 

0 

0 

100  • 

15  ' 

70' 

.  9. 

4  4 

5, 

 f 

100'  1 

9 

26 

57 

■    6     .  1 

^  j 

31 

58 

.  4 

7  1 

100  ! 

73 
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d^nJi  Adolescent  Education,  KPU? 
s  of  PopltlatJ^SLmiiotK-  Fificn^  Yt^ir  1975 


Populntiofi  Studied 

^  All 

1 

Other 

.  other 

(special  characteristics) 

agencies 

oc 

PHS/NIH 

Federal 

 m  

Childlrcn  With  special  ciiaracteristics 

loo 

\  4 

87 

5 

4 

Bilingtial 

100 

i  3 

96 

1 

0 

Physically  Handicapped  * 

100 

i  * 

95 

4 

0 

0 

Mentally  Retarded 

100 

■  1 

.    ■  84 

15 

* 

0 

Learning  Disabled 

100 

■  0 

8^^ 

10 

*0 

0 

En^otioTjtally  III 

100 

1  0 

.  83 

■15 

2 

0  ' 

Academically  Slc^ 

100 

18 

70 

8 

'  1 

3 ' 

School  Dropout                                            ST*^  ^^P  ' 

30 

60 

6 

■  0 

4 

ADUsea/Necjiecteu      -  • 

0 

I 

13 

0 

87 

X  V  V 

1  0 

8 

■   .  92 

0 

Gifted                                           "  ■ 

1  38 

62 

0 

0 

0 

!  ^  0 

10 

78 

11 

0 

AdQlcscont  Parent 

100 

46 

21 

25 

8 

Runaway 

100 

i 

0 

100 

0 

0 

Percent  "Down  ■ 

1 

i 

I 

Total 

100 

:  loo 

100 

100 

100 

100 

PopulfiXtion  not  Specified 

'6 

I  4 

2 

42 

7 

'  14 

Children  Without  Special  Characteristics 

40 

1  78 

32 

17 

55 

66 

Both  Cnildren  With  and  Without 

f 

* 

*  ^Special,  Characteristics  ■ 

* 

7 

■  4 

8 

14 

Q 

.  2 

1  » 

Children  with  Speci'al  Characteristics 

47 

'  13 

58 

26 

36  ■ 

19 

Bilingual 

•  25 

5 

35 

1 

4 

0 

Phy*fica"lly  HandicafJpcd 

■   10  ■  ■ 

■  ■  1 

13 

5 

0 

0 

Mentally  Retarded 

5 

1 

r\ 
U 

^.Lcarnii^  Disabled  .                         ,  ^ 

4 

)■  0 

5 

5 

0 

0 

^^p(rtinued) 

f 

**  T 

Tnble  6.19  (Conti 

nued) 

ERIC 


Popul?.t;ion  Studied 
(special  characteristics) 


All 
agencies 


OS 


PHS/KIH 

 £  


Other 
HEW 


Other 
Federal 


Hinotionally  111 
Academically  Slow 
School  Dropout 
Abused/Neglecred 
Drug  User 
Gifted 
Delinquent 
Adolescent  Parent 
Runaway  ^ 


4 

0 

=  ^5"  . 

7 

2 

0 

2 

3 

■  2 

2. 

* 

15 

2 

•  4 

2' 

2 

!        ^  ' 

.   *  ' 

0 

1 

15 

0  ■ 

^  Q. 

1 

2  ■ 

.1 

'  0 

1 

0,  ■ 

6 

0 

0' 

1 

1 

4 

* 

a-- 

* 

^0 

■  0 

0 

Note;    Because  projects  could ^ifi^  classified  as  dealing  with  mor;e  ithsn  one  special  characteristic, 

the  columa  entries  do  not  add  to  the  total. -    ^  ' 
*    Less  than  0^5  percent.  ,  -  ^  ^  * 


Table  6t19  (Continued) 


4i  i 


ERIC 


ERIC 


■-.^(^T^.^v "^-However >  KIS  .Gontriitifies"  "a^  llgnlficint  s'hofe-'af  t:)i 


work 


fundi-ng'oi  these  ac-tiVt^^iea  '±n.  FY'  I975y  Nil*  obTa- 

gateiJ  27%  ;af  the  pplicy  .^sear<5h  funds,  353?^of  t'he  evaluation 
■   '  "fun^s*  and  31ffi\ot  t^«■^ve]^pl^ent.  funds. 


jNIt's;ri%  I9'?5j»tudget*ijas  di^ributed  abross  aXl  the  various 
funcHdtis,  ^  Tfie  larg;est  sijigfe'caiegoijy  was  d^j'velopment^  (39%), 
^ollowe^  by  evaluat;ion'>e&€arcb  (18%)  >  ^JLlot/demonscatl^f^  P^^P" 
jeccs'and  repricationf/ ^7%)  /  applied  researcli  (13%)  i^ps^^rch^  . 
suppt)rt.  and  ytiifzacion*  (10%)  >  baeic.  research  (2^),  and^ptrKcy 
research S IE  "was  the_  doaiin^at  sponsor  (61%)  of  research 
support:  and  utilrzation;  -OE  also  cotitribut^^d  'a  signifidant  ■ 
"share  (37%)   Co  this  type,  o£  activity.    The  only  other  function 
to'which  J^IE  contributed  the  dominant  share  was  applied     ,  vT, 
research:     in  FY  1975,>^f^IE  accounted  for  45%  of  federal  funding^ 
foi;  applied  research  in  education* 

b-      By  Target  Groups 


OE  is  the  dominant  sponsor  of  projects! targetted  at  populations 
j/ith  special  characteristics:   Jnore  than  Ralf  of  the  funds 
targetted  at  these  groups  comes  from  OE  alone-    More  than 
one-third  of  O^s  educational  KPU  budget  is  obligated  for 
bilingual  projects >  and  another  one-tenth  of  that  budget  goes 
<o  projects  for  ^Che  physically  handicapped, 

OE  is  also  th^  main  sponsor  for  projects  targetted  at  spi^cific 


demographic  populations:    mor^z-^mn  half  of  the  project  funding 
Tor  each  specific  demographic  group  comes  from  OE  ^^lone.    "  ^ 
Mo^t  of  OE's  education*KPU  funding  (70%)  is  committed  to  projects 
tfir^etted  at  specif ic  ^dcmo^raphic  groups;  this  compares  to'  only 
one^third  uf  NIE's  budget  so  committed.'  The  two  agpncies 


differ  not  only  in  their  extent  df  commitment  to  specific 
'demographic  groups^  but  alsq  which  specific  groups  are  the 
focus  of  each  agency's  attention.    OE  projects  emphasize 
the  poor  (37%  of  the  total  OE_.ubdget  for  education  KPU), 
Spanish-surnamed  (33%)>  and  urban  students'  (21%),    To  the 
extent  t^at  NIE  projects  emphasize  any  particular  ^emographic 
populations,  the  NIE  emphasis  is  on  students  in^  urban  areas 
(15%  of  the  obligated  funds)  and  rural  areas  C1A%), 

c.      By  Perfonning  Organization 

\ 

Fed{*ral  agencies  also  differ  in  the  degrees  to  which  the^r 
tend  to  fund  different  categories  of  perfo^min|  organizations. 
Since  OE's  share  of  the, total  federal  budget  ofr  education  ' 
KPU  is  so  large;  it  tends  to  be  the  dominant  source  of  funds 
for  all  types  of  institutions.     But  even  so ^  there  are  signi- 
ficant differences  in  the  patterns  that  emerge  in  the  data^on 
agency  funding  of  different  types  of^  education  KPU  perforr.ers. 

As  shown  in  Tables  6,20  end  6,21,  based  on  FY  1975  data,  LEAs 
received  almost  all  (97%)  of  their  KPU  "support  from  0E>  and 
nearly  three-fifths  (59%)  of  OE's  KPU  budget  went  to  LEAs. 
SirailaT^ly,  SEAs  received  almost>ll  (89%)  of  theli  federal 
■support  for  KPU  from  OE  lianother  11%  came  from  NIE)  .  ^ 

Academic  isntitfituions  rec^ved  nearly  helf  (44%)  of  their 
educational  R/Did  support  from  0E>  another  quarter'  22%  from 
NIE>  and  another  quarter  (26%)  from  the  Public  Health  Service, 
(/lore  than  half>  56%>  of  *tKe  Public  Health  Service  fc>udget  went 
to  academic  institutions.)  ^ 

^■an-profit  corpor^^tions  wtrc  funded  heavily  by  KIE  (^3%)  and 
OE  (38"<),     The  NIi:  figures  indicate  that  nea^rly  half  of  that 
ap^c-ncv's  FY  1973  budget  went  to  non-profit  corporations. 
But  it  must  bo  understood  tbnt  the  non-profit  category  includes 


Population  Studied 
(demographic  characteristics) 


j  AH 
*  I  agencies 


OS 


'?HS/ 


other 

HEW 


Obligations  (?WO's) 
Total 


PoDulation  r.ot 


Specified 
f 

5ulatio?N5pocified 
primarily  Vc^or 
Spanish-su^nameU 
Urba^i 
Black 

.American  Indian 
Rural 
white 

Indian  Reservation 
Migrant  * 
Suburban 

Percent  Across 

Total  ^  ^ 

Popula^on  not  Specified 

Population  Specified 
Primarily  Poor 
Spani^iLrsurnair.cci 

American^ Indian 


(Continued) 


f  < 


I    295.041      45,457     207,889  .    25,328   .  14,826  1,541 


118,928 

30,257 

62,972 

16,781 

8;42C 

r 

497 

* 

176,113 

15,200 

144,92.5 

8,547 

6,406 

1,044 

87,113 

3,298 

77,536 

2,76Cr^ 

2,838 

■  580 

78,195  - 

1,567 

72,501 

2,126 

1,878 

,  23 

53 , 500 

6,841 

43,353 

4,314 

3,724 

267 

29,574,- 

'l„041 

■  21,0^0  ■ 

3,918 

2,997 

588 

25,470 

1,085 

20,^36 

2,913 

975 

0 

21,963 

6,47^7 

13,242 

956 

1 ,153 

135 

18,236 

824 

"12,239 

2,324 

1,987 

3(>2 

8.332 

0 

7  ,513 

314 

404 

'  0 

*^  5,490 

0 

' 5,370 

■  0 

120  ' 

0 

4,917 

514 

2,908 

713 

782 

0 

100 

15 

70 

9 

5 

100 

25 

53 

■  14 

*  7 

100 

9 

82 

5 

4 

100 

.  4 

89 

3 

3 

.1 

100  ' 

-  2 

y3 

3 

2 

* 

100 

12 

74 

7 

6 

100 

4 

71 

13 

10 

2 

100 

4 

SO 

11 

,  4 

0 

■  '  Table  6,20 

*     Feder.^l  Obligations  for  E^JLy  Childhood  and  Adolescent  Education,  KPU: 
Funtiing  Aijcrrcv  and  Dcmof^raplilc  Ch<\racteristlcs  of  Pupulatrion  StuclKd,  Fiscdl  Year  ]975 


J. 


7 


Populacion  Studied 

j  All 

PSH/ 

Other 

Qtlier 

(demographic  characteristics)" 

1  aoencies 

■ 

OE 

NIH 

Federal 

Rural 

.>  :  1 

!      100       !  29 

,  6C 

4 

s 

1 

White  - 

i  ICO 

4 

67 

15 

11 

2 

Indian  Reservation 

i  100 

.9 

91 

'  4 

5 

0 

Migrant 

;  100 

0 

58 

0 

2 

0 

Suburban  ^ 

1 

10  ' 

59 

14 

16 

0 

Percent  Down 

. 

* 

Total 

E 

) 

100 

100 

100 

100 

100 

100 

PopulaticJh  not  Specified 

.  40 

6'7 

30 

66 

32 

Population  Specifiec? 

:  '60 

33 

70 

* 

34 

.  43 

68 

Primarily  Poor 

■  i  30- 

7 

37 

11 

19 

.  44 

Spani;^-surnar.ed 

-  .        26  ' 

3 

35 

8 

13 

■  1 

Urban 

:  ■ 

17  r 

*    25  T "  ^ 

17  - 

Black  - 

■  1  '10 

2 

10 

15 

13 

3S 

American  Indian 

2 

10 

12 

6 

-  0 

Rural  * 

i  7 

14 

6 

4 

8 

9^ 

V/hite 

2 

6 

I'l 

13 

23 

Indian  Reservation 

0 

4 

1 

3 

0 

Migrant  , 

:      2  , 

0 

3 

0 

0 

Suburban  -  - 

:       2  ■ 

i 

1 

3 

0  * 

^\>te;    Sum  of  der^ogra^^hic  characteristics  of  population  studied  adds  to  more  than  population 

specified  because  a^  project  could^  be  classified  as  dealing  with  more  than  ony  .population . 

Less  than  0^5  percent. 


Jable  6,20  (Qontinued) 


Vi 


Type  of  Performing  Organization 


All 
agencies 


NIE 


OE 


PHS/NIH 


0th  <3i 
HEW 


Obligations  ($OpO's) 
r 


(Continued) 


Total 

:  295.041! 

45,457 

207,839 

■25,328 

14,826 

1,541 

local  Educational  Agency 

I    123,628  j 

2,105 

120  ,'204 

1 ,307 

12 

Academic  Institt:::ion 

-  J      54.912  j 

li  ,913 

24 , 314 

14, "021 

4,078 " 

581 

Monprofit  Institution 

1      51.254  j 

22,225 

19 ,686 

4  ,247 

4,926 

170 

State  Educatiohal  Agency 

I      ^0,776  ' 

i  t 

2,241 

18 , 269 

20 

24S 

•  0 

Profit  Institution 

'     j      14.607  1 

2,160 

8  ,C35 

465 

2,623 

722 

Other  State  or  Local' Agency 

\    ;     11,097  1 

4  ,507 

3  ,434 

1,738 

1,417 

0 

Other 

]      18,768  j 

301 

13,347 

3,529 

1,525  * 

68 

Percept  Across  i 

i 

* 

'   ^  Total 

100  ■ 

15 

70 

9 

3 

* 

Local  Educational  Agency 

 r 

100  j 

:  2 

If   '  

97 

1 

0 

Academic.  Instit;ution 

*    ■ 100  ; 

22 

44 

26 

7 

1 

Nonprofit  institution 

100  1 

43 

38 

8 

10 

* 

State  Educational  A'^ncy 

100  ■ 

11 

88 

* 

1 

0 

piy^fit  Institution" 

100  1 

15 

S9 

3 

18 

5 

pther  State  or  Local  Agency 

,    100  ; 

41 

,  31 

16 

13 

0 

Other 

.   100  I 

2 

7X 

19 

8 

*     Table  6.21 

Federal  Obligations  for  Early  Childhood  and  Adolescent  Education 
y  Funding  Agency  ^tid  Type  o£  Performing  Organisation,  Fiscal  Year  1975 


Type  of  Performing  Organyation 

L 

!      All  f 

i  agencies  -  NIE 

02 

"Other 
'HEVf 

Other 
Federal 

Percent  torn 

Total 

■'     100  100 

ICO 

100 

100 

100 

Local  Sdijcational  Agency  fi* 

1       42       ■  5 

59 

5 

* 

0 

Academic  Institution 

i       19              26  ' 
)       17  49 

12 

56 

28 

38 

Nonprofit  Institufion 

9 

17 

33  ■ 

11 

State  Educational  Agency  / 

:         7       ■  5 

9 

2 

0. 

Profit  Institution       -         -  " 

;        5  *  "5 

2 

47 

Other  State  or  Loca^  Agency 
Other  ■  ^ 

4  .     '  10 

2 

7 

10 

D 

i         6       i         1  , 
! 

6 

14 

10 

4 

*    Less  than  0.5  percent. 

Table  6 

4 

,21  (Continued) 

- 

* 

'  ■ill-' 

'( 

ERIC 

• 

A  52 


the  regional  education  labora cor i'es  (just  as  the  "academic 
insplc^ytion'^  category  includes  the  R^D  centers)  >   to  which  ' 
KI£  has  been  (for  a  variety  of  reasons  we  shall  consider 
later)  hc?avily  committed.     The  for-profit  corporations  have 
received  nearly  three-fifths  of  their  support  (59%)  from  OZ 
and  another  15%  from  NIE. 

The  large  chunk  of  the  funding    of  for-profit  corporations 
coning"  frozi  0£  night  at  first  glance  seem  attributable  to  ^ 
the  fact  chat  TDOSt  evaluation  activity  is  funded  by  OE  and 
nost  e^al-jacions  are  carried  out  by  che  for-profic  corpora- 
tions.   HDvever>  even  when  the  type  of  KPL'  function  is  held 
constantj  the  data  show  significant  differences  amonglfedcral 
agencies  in  their  orientations  toward  different  categories 
df  perfo^rT^ing  organizations.     For  instance>  in  the  data  on 
funding  agency  of  basic  research  alone,  the  KIE  analysts 
found  that  73%  of  NIE's  basic  research  money  went  to  non- 
profit corporations;  no  other  agency  obligated  nore  than  14% 
of  its  basic  research  funds  to  non-profit  corporations. ^^n  ^  ^ 
applied  resoarchj  HIE  obligated  43%  of  its  funds  to  acaderiic 
institutions  while  OE  gave  onl^^J^r£''oT'Vt^ applied  research^ 

funds  to  academic  institutions  and  fu-iie  ne-fifth  of 

+  * 

its  apfilied  r^isearch  money  to  LEaI  and  SElAs,    The  pattern  of 
differences  continues  yithin  developn:^ent  funding>  with  NIE 
giving  nore  of  its  support  to  non-profit  corporations  while 
OE  support  was  oriented  toward  LEAs  and  SEAs .   ^Evaluation  funding 
sho'^s  agency  differences  as  well:     the  Public  Health  Service 
divided  its  evaluation  money  h^ilf  and  half  between  acaderilc 
iTi^lli     i'jT.ir  .inc  non-profl:  rorpor^t  iO:it^  Ni:.  bO^'^'  ^'^'^re  ti^an- 
f^o-thirds  of  its  evaluation  funding  to  non-profit  corporation^. 
As  one  final  example,   the  ^^If^  analysts  pointed  to  the  data  on 
sponsorship  of  demonstration  prpjects:    while  OE  obligated  Tz% 
of  this,  roTif^y  to  LEASj  Nl-f:  distributed  its  demonscration  funds 
over  s^/ver^il  types  of  orj|;.ini/ntions,  with  no  one  or^aniza tion^il 
typ^^  acCountln;^  for  more  than  a  qu^srtt^r  of  the  funds. 


■'■      ■  V    '  •.        ,,       •  ^ 

*  m 

Through  all  of  these  data>  we  find  (among  other  things)  cle.ir 
differences  between  ^the  funding  preferences  of  OS' and 
with  OE  oriented  toward  funding  KPU  activ^ljles  in  LEAs>  x/hile 
MIE  founding  is  channelled  heavily  to  non-profit  corporations 
especially*  and  also  to  academic  institutions.    It  would  be 
useful  to  have  the  data  on  regional  laboratories  and  on  the 
university-based  R&D  centers  separate  and  apart  from  the 
"data  on  oth^r  non-profit  corporations  and  other  academic 
institutions  J  s^nce  KIE's  special  relationship  to  the  labs 
and  centers  has  not  been  an  eatirely  voluntary  preference. 
(We  shall  returVi  to  this  point  later.)    However*   in  the 
absence  of  this  separate  data  we  must  simply  take  note  of 
N'IE*s  heavy  orientation  toward  the  non-profit  organ izaf?i.ons 
ingeneralj  and  leave  to  subsequent  analyses  a  puzzling  out 
of  the  meaniag  of  this  finding. 

d.  j^ummary 


To  sum  up  the  'rcey  differences,  between  OE  and  NIE  in  the  funding 
of  educational  R/D&I  activities>'  the  NIE  analyses  indicate 
that: 

NIE  primarily  suppoirts  developmentj  evaluation>  and 

applied  research  projects  directed  at  children  in 

general  performed  by  non-profit  and  academic  institutions. 

OE  primarily  supports  demonstration  projects  for  children* 
with  special  characteristics  performed  by  local  educa- 
tion agencies.  75 

Clearly,  then  there  are  ^ighificant  differences  In  federal 
agency  funding,  of- different  educational  R/D£fl  activities^ 
and  any  attempt  to  formulat'C  "federal"  futiding  policies  for 
education  K?U  —  on  a  coordinated  system-wide  basis  (as  one 
would  expectj  for  instancCj  from  a  lead  agency  or  a  coordina- 
ting body  ^".rh  as  the  Federal  Council  on  Educational  Research 
^and  Develop::ient        must  be  based  on  an  undersTand ing  of  all' 
of  th*^  sources  of  educational  R/O&I  funding,  and  their  impact 
on  total  system  functioning. 


ERJC  .}  J 


454 


6.      VundinR  Data  From  "bfae  Qrganigational  Survey  of  KIE's  Educatl,Oi:t 
KPU  Moninorin^  Program 

The  NIC  analyses  of  jche  KAS  and  SRG  data  bases  are  useful  primarily  to 
provide  an  understanding  of  federal  funding  of  education  KPU  activities. 

I  r 

These  data  bases  tell  us  nothing  ^about  data  from  non-federal  sources  of 
KPU  activities.    These  data  bayes  tell  ^s  nothing  about  data  from  non- 
federal sources  of  KPU  sponsorship.    Nor  do  these  ^ata  permit  us  po' re- 
late funding  data  ^t&^<ich  other  variables  as  organizational  histories, 
staffing,  number  oT  types  of  projects,  etc.    These  data  bases  do  not 
Lnclade  LrLforjtation    6n  any  of  these  other  variables. 

We  will  be  In  a  better  position  to  address  some  of  these  questions 

76 

shortly  uhen  the  data  from  J^IE's  organi2auional  survey  become  available 
ant]  when'researchers  are  able  , .to  car,ry  out  various  secondart  analyses 
^on  the  d<^ta.    Among  the  questions  that  can  be  examined  based  on' these- 
data  ^"^^  the  following; 

\\Tiat  are  the  distributions  of  fundSj  staff,  and  projects  among 
organizations,  and  how  are  these  distributions  related  to  each  other? 

To/,;hat  is  educational  Ri^D  concentrated  in  a  few  organizations?  To 
what  extent  ±s  it  concentrated  across,  and" .within,  individual  sectors 
(acadeinic,  non^profits,  for-profits,  SEAs,  LEAs)?'  What  are  these 
large  oi^ganiza  tions?    l^fhat    special  characteristics  do  they  share 
other  than  size? 

What  proportion  of  r^d  is  carried  out  in- organi-ations  ^^ho^e  pri- 
mary mission  is  education?    What  are  chj^  primary  missions  of  the 
bther  organizations  (e.g.,  urban  plan|riag>  health)?  ^ 

To  what  extent  is  educational  R&D  tarried  out  in  organizations  which 
/^specialize  in  R&D  and  consulting  uork?  *To  wlv^t  degree  do  these 
uri,^nii:ati^ns  focus  speciticuliy  ow  tjducational  uC^D,        co-^pare^  to 
R&D  focused  on  other  social  areas  and  R&D  in  science  and  technology? 

'      u  ^  * 

What  a^^e  the  major  sourctjs  of  £und5  for  the  syst<?m,  and  how.  does  their 
importr-inre  vary  among  sectors?    l^fhat  is  the  extent  of  diversification 
of  sources?    Are  there  groups  of  or;;anL^ations  or  portionb  of'  sectors 
-  whi^jh  are  highly.dependent  cm  particul/ir  ^sources?    If  yes,  which 
s-jC^o*"  oTgfiniza t to^i>  and  which  sources'' 
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To  whac  R£^  fonctions  are  funds  applied?    Are  there  sector 
''st^ecialtles'^?    Arc  some  functions  found  more  often  in  large  than 
in  small  organizations,  suggesting  perhaps  minimuni  size  reioirements 
for  sone  kinds  of  work?    Can  variations  be  detected  between  funds  - 
sources  and  types  of  functions  performed,  fap-&he  whole  system  or 
parts  of  it?  \  -  \ 

What  is  the  extent  to  which  organizations  span  many  R^tD  functions? 
lifhat  is  the  extent  to  which  organizations  specialize  in  particular 
functions? 

l^Tiat  proportion  of  total  funds  are  applied  to  different  education 
levels,  e-g*,  adolt  and  continuing  education?    To  wh^t  degree  is 
work  focusing  on  ^  particular  level  shared  among  sectors?  Can 
clusrering  by  funds  s'^ources  be  detected?    Are  there  noteworthy 
ci':v-'^-i<ii^-t^ies  upon  sirigle  source  of  funds? 

Unat  is  the  distribution  of  full-tine  and  part-time  staff?    Is  it 
congruent  with  what  would  be  e;<pencted  on  the  basis  of  distribution 
of  financial  resources?    Are  there  differences  by  major  sources  of 
funds  or  by  degree  of  dependency  on  a  single  source? 

Of  educational  R&D  professional,  how  many  are  from  inority  groups? 
How  Tnany  are  women?    Are  variations  in  proportions  of  professionals 
in  an  organization 'who  are  women  o£  ErOTn  minority  groups  related 
in  any  way  to  funding  source^? 

How  are  sfaff*  distributed  in  terras  of  primary  R£tD  functions? 
Is  thi^  congruent  with  the  distribution  of  funds?    \Jhat  implications 
can  be  dra'vn  about  different  relative  costs,  by  sjfctoy  and  organi- 
zational size,  for  various  types  of  work? 

.Wliat  is  the  distribution  of  doctorates  in  the  professional  work  force 
Are  there  variations  with  regard  to  substafntive  functional  R^tD  em- 
pba.^es  of  the  employing  organization^?    Are  there  systematic  varia^ 
tions  related  to  .funding  sources?  ^ 

IVhat  is  the  total  number  of  projects  reported  and  their  typical  size? 
Do  projects  tend  to  be  larger  in  some  sectors  than  in  others?  Dp 
large  .organizations  tend  bo  work  on  large  projects?    Can  patterns 
be  f ound^'link Ag  project^  sizes  and  funding  sources? 

'I    .  ■ 

Clearly,  tli<in,  we  are  well  on  the  way  to  an  understanding  of  the  funding 
of  educational  r/D&I  as  it  is  distributed  currently  —  who,  is  spending 
how  m-jch,  for  what  kindfj  of  work,  \:ari*ied  out  in  what  types  of  institution 
However,  these  data  are  of  relatively  little  help  in  guiding  our  thinking 
about  '^^^^'-^  fundLng  should  be  distribtited,  or  wh;it  the  ef Fe_cts  of  different 
funding  policies  have  been  Cor  mij^ht  be  In  thfi  Eiicure)  on  suscem  capa- 
cities, functioning,  and  outputs^    Questions  of  the  latter  kind  have 


been  the  subject  of  intense  debate  in  recent  years.   .We  turn  to  fiome  of 
these  hotly  debated  issu*:s  now,  so  as  to  develop  a  sense  of  d(ie  kinds  of 
questions  in  need  of  consideration  as  a  basis  of^policy  developmeat  and 
perhaps  i;oo  the  kinds  'of  information  we  need  to  collect  and  analyze  in 
the  future  to  provide  some  guidance  for  the  dcvelop.^.ent  of  funding 
policies  for  educational- R/D&I . 


s 

\ 
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IV.  ^i-'L':;DIXG  POUCY  TSSlTcS 


Funding  policies  o|  key  sponsc^s  are  of  critical  imporfcance  to 
any  R/D6tl  system,  for  determining  what  kind^  of  wofk  are  carried 


^ut  and whcHUt  what  capacifjgj^re  and^are  not  developed  ^nd 
yherfe,  and  often,  at  what/jrratesj^  development.     In  the  field  of 
educacio^j  fuviding  policies  taken  on  even  greater  ^mr^^rf^m^j- 
bfc^use  funding  is  virtually  the  only  strategy  used  by  sponsors  ^ 
to  affect  the  sy^cern.     Few  pther  potential  forms  of  leadership  are 
*exe.rcLSed.    I's  shall  have-  [r^ore  to  say'  aboiit  this  later. 

'We  have  selected  four- particirlar  funding  ^oli.cy  issues  to  focus  on 
herej  4s  illustrative  of  the  ways^unding  policy  decisions  can 
shape  syste^  development.     For  each^  we  examine  the  issue  that  was^ 
raised  ^and  why  and  hc^  it' was.  raised)  ^  "the  available  options  ^  and 
the  course  of  act^ipn  taken.     We  also  speculate  about  some  of  the 
contextiial  factors  that  affected  the  way  the  particular  issues  ^ 
were' raised  and  th§*  decisions  that  were^made. 

1.     Institutional  Support  vs.  Program  Purchase 

'     •  •  *  .  mi 

A.    The  Issue  -  * 

should  federat  agencies  maintain^a  special  relationship  q^^, 
;>uDport  fox  selected  ins  ti  tut  ions ,  so  ^s  to  insure  the  availa- 
bility  of  certain  needed  system  capacities?    Or*,  should  all 
per^rJaing  organizations  be  *eated  equally  by  federal  agencies, 
^  :>eiecting  desired  programs  a:id  services  for  purchase  from^'  ■ 

4^^^^  Xhese  pejrforming  organizations  on  the  E>asi3  of  open  competi- 
^    ^\'tion?  ^These'were  some  of  the  key  questions  tmderlying  the 
debate  ove^  ^^i^i3titutionalisupport"^vs.  "program^  purchase," 
the  focus  af  considerable  a  ttention '-fispm  t^^e  early  '70s  until  - 
only  around  three  years  ago.  -    ^  i  . 


^58 
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^     Historical  Eackfiround 

dRitral  Jio  Che*  circumstances  .out  of  which  Che  issue  arose 
^nd  tinder  which  it  wa^  eventually  laid  to  rest  (for  a  time 
at  least)  was  the  history  of  the  labs  and  centers  and  ger.eral 
dissatisfaction  with  the  quality       work  prcMuced  by  many  of 
these  institutions'.     Since  their  creation,  the  labs  and  cen- 
ters had  been  funded  by  OE  ^as  institutions.    K  single  budget 
was  requested  by  and  committed  to  each  institution,  to 
siiDport  work  proposed  by  3ach  Institution  at  ^ or  near)  a 
funding  level  requestad  by  each  instit?ucion.    The  funding 
provided  by  OE  paid  for  not  only  the  direct  costs  of  carry- 
ins  c>uc  the  specified  g^ograms  proposed  to  produce  spec^ified 
caputs,  but  also  the  indirect  institutional  costs  required 
ff9  establish  and  maintain  the  organizations  as  institutions. 
''There  was  some  variation  in  p^terns  since<:^he  R6<D  centets 
w^ra  subunits  of  academic  institutions  while  the  reigional 
laboratories  ware  autonomous  inst?itucions  with  no  other  - 


sources  of  institutional  support.    But  still,  in  both  cases, 
OE  was^provilding  institutional  support  and*^ot  simply  purchas* 
In^  particular  programs  or  services,) 


What  yas  unique  about  the  relationship  between  OE,  on  the  one 

hand,  and  the  labs  and  centers^  on  the  other,  was  :^  (a)  the 

assnimed  comtpitment  by  OE  to  maintaining  these  organizations 

as  insi:itution$;   (b)  OE''s  funding  of  the  institutional  agendas 

they  proposed;  and  (c)  the  funding  of  th^lr  work  under  non* 

(.o.np^l  L  tiva  jprooedurss  Chat  i^ept  cheSe  programs  Staparate  f  roni 

the  fundin^of  other  field-initiafed  proposal^,  and  derived  ' 

their  funding  fram^what  in  essence  amounted  (more  or  16ss  in 

different  years)  to  a  budget  set-as^de  for  Cha  labs  and  centers 
'  *        ■  {'  . 

No 'Other  eduC^ationaL  R/p6I  performing  organlMCLons  were  . 
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J  y  * 

croaced  Ln  this  unique  fashion.    B<.it^chen,  no  oche^r  educa- 
tional R/Di5cl  performers  had  been  created        the  federal^ 
r  _  government  co  provide  the  field  of  education  , with  specific*' 

capacities  that  wer^!  viewed  as  existing  in  insuf f icien^c 
quantity  ac  the  .tims  the  l^bs  and  centers  were  created. 

/ 

ft  has  been  assY^ed  when  che-labs  and  ^enters  were  created* 
■    '      that  federal  funding  for  educational  R/D6cl 'would  expand  in 

an  orderly  manner  and  that  yithin  a  few  years*the_re  would  be 
appro:<imately  SlOO  nui^on  available  in  federal  funding  to 
^      suppoW  these  institutions  at  a  level  sufficient  for  high 
level  ^ork  at  all  ^f  them*     However,  since  this  funding  ex- 
pansiipn  did  not  occur,  federal  education  policymakers  made 
a  series  of^d^cisions  between  1968  and^^J^W^that  brought  an 
ead  to  federal  support  for  some  of  these  inscitutioos  so  that 
'  "i  more  adequate  levela^of  ^funding  would  be^vailable  for  those 

^     regaining  institutions  -judged  to  be  stronger  and  better  able 

use  these  resources  co  produce  quality  work.  Consequently, 


nine  regional  laboratories  and  C^wcJ  E&D  centers  lost  their 
funding  durifig  these  years.     (Others  lost  their  funding  in 
^  su^isetjuent  years,  b\it  that  gets  ahead  of  our^story.) 

Tho  termination  decisions  created  enormous  problems  for  OE  as 
^  veil  as  for  the  labs  and  centers.     Each  decision  was.made'on 

an  3d  hoc  basis-,  with  no  comprehensive  ^policy  or  expj[^cit  set 
of  rtandard^  ifo  guide  decision  making.  *  Dissatisfaction  wi,th 
this  s  i  tuat  ion"  was  a  strong  impetus  for  tha  development  of  wh^t 
b^c*ur2  thi  r,ev  pro^ra^' p*^lrc*n?5^?  policy.     The  new  policy  va:; 
tracoabl^  jco -^th^  perception  of  other  dilemmas  as  well.  As 
deflcrib'eJ  in  Che  Oi?  document  formulating  the"  hew 'poHcy: 

^  The  orevious  jplicy  has  beerf  ch;yracteri?ced  by  many  as 

one  of  attrition  or,  worse,  de<>Lructivt  competition. 
The  survival  of  the  most  promi-srng  programs  has  required 
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&he  midcour^e  termination  of  otlfei:,  less  pronising 
ones.    The  resulting  attrition  has  led  to  a  lower- 
\         ing  of  morale,  decrease  in  prestige  and  insecurity 

among  remaining  institutions,  all  of  which  mus,t  be  re- 
versed if  the  program  is  to  be  strengthened  and  the- 
initial  investment  capitalized  upon. 

Also,  it  was  felt  that  the  time  had  come  for  such  a  policy, 
given  the-number  of' years  these  institutions  had  been  in 
^;:<l^Ciince,     T'r^e  ^'at^un□l  Institute  of  Child  Health  and 
hwnian  Development,  for  instance,  had  already  switched  over 

to  a  policy  for  the  12  research  centers  on  mental  retarda- 

'  **  "78 
tion  they  had  established  during  the  '60s. 

j 

Beyond  that^  it  was  felt  that  a  comprehenslve^^olicy  was 
needed  that  could"  provide  some  guidance  on  the  establish- 
mtint  cjf  nsu  Institut^ns  as  well  as  making  ^funding  decisions 
Q^i  ^xisting  dercision^' 

r 

C,    The  New  Policy,  as  Forp^ulated  by  Q£  in  1972 

The  ^ey  objectives  of  the  new  policy  werfe  to; 
^            provvd^'Eor  the  starting  of  new' tnsti  tut  L'ons  ^hen  ^ 
necessary;  '  '  ■   ^ 

-  alloV  a  greater  control  ovjer  federal  re Sj^y cgs  while 
^     *  at^^fe  same  time  .recognising  the  autonomy  of  those 

'  R£tD  xrsti£:utions  that  have  grown  to  maturity; 

-  Drovlde  programs  uith  t^^r^et  cor;ipletiOR_si«ces^^ 

V  assure  stal^ili  ty  for'  multi-year  fund  in'^^lock^^^nd 

-  delineate  a  mechanism  vhe'rcby- ins  ti  tutions  can 

.   -     .X''  -79     .  / 

l^roaden  their  bjase  of  support.    ,  , 

Th*.  policy  was  ^ntended'Tna  ccA'er  th^  full  r^J^ge  of  possibilities 
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frOL?  ^a)   the  iOLindLUg  of  new  institutions  to  attack  new  pcob- 
lem  areas  (or  to  replace  existing  institutions  judged  to  be 
doing  an  inadequate  job),  to  (b)  the  support  of  existing  in- 
stitutions assessed  as  either  '^developing'^  or,  "nature"  in 
status.     The  model  used  in  the  program  descriptions  empha* 
sized  the  concept  of  institutional  maturity.    -£ased  on 
assesSQients  of  an  institutix>n's  maturity  level,  an  institur 
tion  ^l^pported  under  this  policy  would  move  toward  greater 
and  greater  autonomy  from  monitoring  and  review  by  Washington 
;\nJ  ".."ith,  gre^ier  r^aturity,  zha  fi:nding  nrrangcTents  would 
shift  from  core  support  (i.e..,  institutional  support)  to 
pr^o^ram ^upport  (i.e.y  program  purchase), 

Thei  rationale  for  this,  policy  wds  that  new  institutions 

needed,   for  a  time  at  least,  a  certain  amount  of-  nurturance 

and  protection.  ^'They  would,  therefore,  be  supported  In 

"special  ways  for  a  few  years,  u'lfttil  more  mature  patterns  oJ^ 

functioning  and  support  could  reasonably  be  expet^ted  of  them. 

New  institutions  were  to  receive  '^core  support,"  (defined 

as  support  for  *'the  cost  of  operating  the  institution  irres** 

80 

pective  of  the  work  that  is  being  done"),-  Institutions 
whose  proposals  were  accepted  for  a  planning  grant  might  re- 
ceive such'a  grant  for  a  3  -  6  month  period,    li'poh  success^ 
ful  review  of  the  completed  plans,  a *new  Institution  was  ' 
recognized^and  the  Institution  proceeded  through  a  t^iree 
pfiase  "maturation"  process.     During  P^iase  I  (wh^ch  might  last 
up  to  a  maximum  of  two  years),  core  support  was  provided. 
If  at  least  one rof  the  program  plans  carried  Out  in  phase  I 
was. judged  by  an  external  review  panel  to  provide  evidence 
"that. the  institution  was  worthy  of  further  support,  the  insti 
tution  entered  into  Pha^e  II  and  again  received  core  support 
for  a  maximum  of  two'years^ 


I:  tite  *?hase  II  review  indicated  that  the 'ins  1 1  tut  ion 
^able  to  adequately  inanage  ics  program  plans,  it  passed  into 

Phase  III  ''mature*'  status,   Jphaae  III  differed  significantly 
*  f roKi  the  p^^evious  stages   in  that  a  phase  III  institution  was 
highly  autonOiTiOus  from  agency^direction  whereas  in  phses  I 
and  II  agency  staff  worked  closely  with  the  institutions  to 
guide  them  along  and  monitor  their  operations.  Institutions 
whjch  achieved  Phase  III  status  (some  might  be  so  designated 
from  the  outset,  some  might  achieve  it  only  after  passing 
tr.r^"-^h  Phases  I  and  II,  and  so^e  ni^ht  never  nchi^ve  it) 
h-^d  a  mor^l  cocmLtment  to,  mul  ti-year  funding  of  their  pro- 
gran  plans,  and  vere  h'bt  subjected  to  close  agency  monitor- 
ing.    If  a  mature  insticution  had  proposed  a  plan  for  a 
7-year  RiD  program,  let  us  ssy>  and  this  program  had  been 
accepted  for  funding,   the  institution  could  be  reasonably 
certain  that  it  i/ould  teceive  the  requested  funding  for  the 
7-year  period  so  long  as  tbe  quality  and  progress  of  work  in 
that  progr^am  was  judged  to  ie  Satisfactory.     ''Only  when,  there 
is  cause  to  suspect  that  the  pr^ogram  is  in  neftd  of  outside 
intervention  will  the  agency  take  the  initiative  f<Sr  assess- 
ment.   .    .   .  To-msintain  Phase  l\ll  status,  the  institution 


niust  rrainpain  its  reputation  forvjJo Lpa  quality  educational 
"^5.0  work.''^^ 


Phase  III  instiiruKions  t/ould  not  receive  core  support,  but  i^^ 
stead  received  program  silpport,  i.e.,  support  for  the  conduct 
of  specific  programs.  '  in  addition,  mature  ins  ;1  tu  tlons  j^ere  , 
eligible  to  Veceive^Pwo  additional  budget  lin^s  items:-  -f ndepen^ 
dent  re&e;^rc^  funding  9n  a  cost-reimbursable  basils  (up  to  a 
maximum  of  8*',  of  direct  pro^^ram  costs),  and manageruent  fee 
''generally  up  to^-o  maximum  of  37  of  direct  program  costs)  to 
cover  bijsiness  expenses  not  gen^;raily  covered  bv  direct  pro- 
W^rant  ^osit^  nvA  to  permit  a  cash  reserve  to  accumulate  *'to 
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provi(|l&  operational  stability  during  LeTiporary  fluctuations 

8  2 

In^contracc  support  and  while  contracts  are  being  renewed." 

In  essence^  then^  the  new  policy  see^^ed  to  provide  3  nechan- 
iSTTi  for  selecting  quality  R&D  pe5^for;ner5'(lal>3  and  centers, 
or  otier  existing  or  newly^reated  institutions)  to  have  a 
"special  rel^ationship"  to  OE  (and  then  KIE)  ^  assured  of 
mlti-^year  connit^ents  to  accepted  program  plans  and  auton- 
Cfniy  In  operation  tjlthout  ^close  nonitoring  from  Washington, 
so  Ion*!'  as  chs  quality  of  /their  work  continued  high.  The 
policy  also  S2err,ed  to  prcryide  specific  o^ision  points  and 
critsri^i  for  terminatir.g  funding  Co  Institutions  riot  able  to 
provide  sufficient  evidence  of  a  potential  for  quality  work, 

^er,  inherent  in  this  new  policy  were  a  number  of  signi- 
fic6nt  iseues  on  which  ther^  were  likely  to  be  signlflcant_ 
disagreements  between  the  agency  and  "he  performing  organiza- 
:ions,  and  sone  significant  impleQentation  problecns.     Many  of 

theSiS  y&re  pointed  out  in  an|internal  document  prepared  by 

S3 

Ward  Mason,      who  had  placed  a  key  role  in  managing  05*s  RctD 
Center  Prograoi  ai\d  later  becanie  the  lead  of  KIE's  R^tO  System 
Support  Division.    We  ta'<e  note  .here  of  sor^^^of  the  issues 
raised  :n  that  interna^  document. 

D".     Questions  Raised  About  the  Policy  and  Its  Implementation 
a.     Implementatiofh  Problens 

\lard  Mason's  ajialytis  pointed  out  a  hosl  of  'impleeenta- 
tion  pfroblems  likely  t^  be  encountered  if  the  policy  were 
to  be  put  Into  effect  for  the  FY  1973  budget  cycle  as 
proposed.    These  problems  included  such  matters  as:  the 
-  timing  of  i^iie  jis.^^essmen.  of  instiUvio'is  in  relation  to 
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the  FV  L973  budget  cycle;  che  essential  {rather  than 
optional)  nature  of  the  proposed  management^  fee  and  in- 
dependent research^  funding  if  the  regional  laboratories 
were  to  remain  financially  viable  institutions;^"*  the 
difficulties  laboratories  would  h^ve  in  carrying  out 
"cost-: reimbursable"  iadependenc  r^esearch  since  they  had 
no  independent  source  of  funds  to  use  while  waiting  to 
be  reimbursed;  the  increased  costs  of  the  new  policy, 
many  of  which  did  not  seem  to  be  taken  into  account  in 
t>l^.e  FY  19/'3"budget  planriiiig  (e.g-  ,  the  costs  of  ph-asing 
OLt  programs  and  institutions  to  be  terD^nated,  and  the 
costs  q:  providing  the  proposed  management  fees  and  in- 
dependent research  funding  to  the  labs  and  centers); 
and  the  lack  of  attention  in  the'  proposed  palicy  to  the 
need,  for  an  NIE  unit  to  be  concerned  about  the  labs  and 
centers  3S  inscitutionSj  to  coordinate  the  functioning 
of  progra^n  rionitors  located  in  different  program  units 
ot  NIE  and  to,  b^  concerned  with  the  impact  of  individual 
program:!  decisions  on  the  functioning  of  these  organiza- 
t  ions  as  ins  ti  tut  ions  - 

Inadditioaj  and  of  more  central  interest  to  us,  the 
Ma^n  document  raised  questions  about  the  reasonablenaSnS 
of  so^ne  01  the  fundamental  ^ssunptions  underlying  the 
new  policy- 

#**  ■■ 

b-    Assti^pribns  About  How  Long;  It  Should  Take  for 
Tnsti:tir.ion3  to  *'y.-^.i-iry'' 

Th$  nev  policy  assumed  that  after  seven  or  eight  years 
of  operation  the  various  labs  and  ,centers  were  (with  a 
roupte  of  possible  exceptions)  ready  fo  be  judged  as 
r"''^:urc  t  ?3 1  i  tut  ions  ,     Howe  /er ,   r  rve  prel  irninary  rer^ul  rs 
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con>lng  in  fron  the  panels  reviewing  the  plans  of  these 
institutions  were  suggesting  most  strongly  that  they 
were  generally  not  r^.eetlag  the  established  criteria  of 
maturity.     Therefore,  the  ne'j  policy  was  creating  a 
decision  situation       which  many  of  the  labs  and  caters 
vould  probably  be  terniinated  despite  the  significant 
past  investr.ent:  In  then,  or  else*  a  tentative  cotumlttr^ent 
would  have  to  be  ir^ade  to  try  to  nurture  chem  and  bring 
then  alon^  ^o  the  point  of  maturity  so  as  to  fulfill  the 
rover-^.'^^n*  '^andare  tc  bi  lid  an  ed-.-'pa^i  :>r>al  p.^vD  Irfra*  . 
structure.    The  only  other  possibili:y  would  be  to 
terninate  rany  of  the  existing  labs  and  tenters  and  to 
tr5'  to  build  che  niandaced  infrastructure  by  starting 
over  again  with  new  institutions. 

perhaps,  given  the  scace  of  development  of  educational 
R/Diilj   the  wealt  knowledge  and  technology  base  , on  which 
It  i^ested,  and  the  inadequately  developed  institutional? 
and  person.'iel  base  through  which  it  had  to  function,  the 
new  policy  was  Wsed  on  unrealistic  expectations.  Perhaps 
in  ocher  fields  after  seven  or  eight, years  of  existence 
R5cD  institutions  should  be  teady  to  be  judged  on  the  cri* 
teria  established  for  "mature**  status.     In  education,  bow- 
ever,  this  may  Simply  have  been  naive,  end  a  bit  unfair. 


The  Need  for  In-Place  Capability: .Balancing 
Flejcibitity  and  Coatinuity 


One  advantage  of  the  program  purchase  policy  was  assumed 
to  be  the  flexibility  it  could  provide  in  shifting  funds 
as  priorities  changed.     Instead  of  committing  funds  to 
the  r:^a  Intenance  of  institutions  with  specific  areas  of 
expertise,  even  after  these  art;as  of  expertise  were  required 


> 
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V    CO  carry  O'^i  work  desir^id  by  funding  agenci<2^,  the 

funds  could  be  shifted  to  institutions  with  other  areas 
of  specialization  and  expertise  required  by  the  agency's 
,new  priorities. 

However,  the  price' of  this  flexibility  night  ba  a  loss 
of  coatinuity,-  and  especially  a  Toss  of  specialized 
capabilities  thac  inight  be  needed  ac  some  future  tifr.e, 
Vpfiat  happenSj  Mason 'a^ked,  to'  the  institucions  who 
successfully  conpl*^te  their  work  and  chert  lose  cheir 
funding  CO  other  institutions  oriented  tovard  the  newer 
priorities  of  the  agency?     In  all  likelihood^  they 
would  lose  theijT  staff,  and  go  out  of  existence,  and 
their  specialized  capabilities  oould  be  lose  and  unavail 
able  for  future  use  when  they  might  be  needed  again. 

The  '-^ey  question,  then,  beconeg:   "Is  V.IZ  -^^lling  to  .  ^ 

pay  anything  for  the  maintenance  of  in-place  capability 

*  85 
in  major  ^iiission  areas  of  educatTLonal  RcfD?"        If  thi's 

is  answered  in  the  affirmative,  it  would  suggest  the 

need  for  so^-e  alternative  (or  supplement)  to  the  program 

purchase  approach. 

E -     The  Prog^ran:  P^urchase  PolicV:  Adopted,  Then  Reversed 

When  NIE  car^e  into  existence,   "he  program  purchase  policy  had 
already  beea  put  info  effect  by  OF!,  and  i:IE  continued  the 
poli^cy,    As  a  ^oiisHqii^^nce I  ba^^ween  1972  and  VjI^  f^ur  labora^ 
torier^  and  two  KicD  carriers  went  out  of  existence-  However, 
within  the  next  two  yearb,   the  labs  and  centers  i/ere  able  to 
dt;uV&!op  SuC&iclent  lobbying  strength  through  ZtT>^K  (the 
Co^mcil  for  Educational  D^v^rJopmenEf  and  Researf^h)  to  get  the 
proi^raTt  purchase  poU'cy  reversed  <or  at  leaS"  nodifiedj  by 
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Con-;ress  iona  I  accion,  and  to  insure  that  the  labs-  and  cen- 
ters would  be  funded  through  a  set-aside  in  t^IE's  budget. 
In  pare,   this  has  n^ant  funding  of  program  plans  proposed,  by 
thcije  institutions;  in  part  it  has  meant  that  certain^pro- 
grauS  desired  by  NIE  have  been  funded  through  competitions 
open  (at  least  in  their  initial  phases)  to  labs  aflft*-Gem:ers 
only  ^e.g,,  NIE's  R^Jj^^tchange  Program).     Sut  clearly>  what- 
ever the  funding  r^echanism^  the  "special  relationship'^  between 
Ni£  and^  che  labs  and  centers  has  been  acknowledged >  even  if 
N'TE:  nad  to  be^  dragged  kicking;  and  screaming  Into  this  special 
relarionship  to  maintain  certain  in-place  capabilities. 

F.     The  Program  Purchase  Policy  and  the  Context  of 
Education  R^D&I  Policymaking 

What  the  history  "of  this  issue  seems  to  underscore  is:   (a)  the 
potency  of  the  political  process  in  key  areas  of  educational 
R^DSI  funding;  (b)  the  pow'arful  constraining  role  of  history 
or;  policy  options  open  to  even  the  lead  agency  in  a  given "s'&e-t:^ 
tor;   ''c)  th^  extent  to  which  funding  policy  decisions  must 
take  into  account  questions  of  institutional  capacities  and 
the  impact  funding  decisions  are  likely  to  have  on  institution- 
al capacities  that  will  or^rwill  not  be  develpped,  and  will  or 
will  not  be  available  for  future  use;  and  (d)  the  extent  to 
which .  capacity  iTUSt  be  understood  in  terms  not  only  of  insti- 
tutional capacity  but  sys tetn  capacity  as  well.    We  shall 
have  Ttore  to  say  about  all  of  these  points. 

The  Ca-npbell  Report 


The  l^snes 


Toe.  '.afr.pb^ill  Report  addressed  itself  ^.o  several  interrelattyJ 
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issues:     Sho-alti  Xlf:  pftfeincain  a  "special  relationship''  to 
cercaiC-B^D  perforrri^s?     If' so,  should  che^  ini^itutlons 
be  the  labs  and  csncers?   ,How  should  NIE  select  the  R£tD 
performers  yho  carry  out  its  work,  through  open  competition 
or  through  sorne  form  of  sole  source  procurement?    l-^hat  are 
likely  to  be  the  effects  of  chesfe  alternative  procurement 
approaches  on  the  available  supply  o£  system  capacity'for 
high  qitatity  vork?    Ho^^  should  NIE  carry  outfits  role  as 
Uad  agency  for  educational  R^D? 

B,     Historical  Sack^round 

The  Campbell  Report  was  produced  js  the  result  of  a  three- 
m^nth  review  by  an  impressive  panel  o£^  consultants  chaired 
by  Roaid  Canpbel'l,     The  panel  was  asked  by  NIE's  then-Acting 
Direecor,  person  Elliott,  to  examine  MIE's  funding  poli^ 
cies,.  with  "special  attention"  to  the  labs  and  centers.  The 
!<ey  concept  in  the  charge  to  the  panel  was  that  o£  needed 
capac !  ty  to  do  high  quality  work.     The  panel  was  asked  to 
assess  existing  capaci'ty  for  high  quality  work>  how  the  e:xist- 
ing  level  of  capacity  night  have  been  affected  by  past  funding 
policies,  and  hov;  it  might  be  affected  (especially  how  it  ^ 
might  .be  improved  and  expanded)  by  alternative  funding  poli- 
cies in  the  future,     Elli ott ' s -charge  to  the  panel  also  took 
nor_G  of  NIH's  \egis lative -mandate  to  build  an  effective  R^cD 
systcn,  and  therefore  indifcated  that  the  funding  policy  ques- 
tion;; being  raisec?  were  to  be  considered  in  terps  of  their 


The  appointmenc  of  the  Campbell  panel  was  a  r^^spon^feLtp  intense 
pressirres  on  ?JIE  to  clarify  its  stand  on  the  labs  aSpcenters 
and  the  prop.rjirn  purchase  policy  it  had  intjen'ced  from  OE,  I-^ 
w^'^  widely  Vr^'j-rfthat  sone  ME  staff  and  key  <nc!v[sers  wert' 
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L^^appy  with  the  general  quality  of  work  producedrby  most 
of  these  insticutions  and  would  have  liked  very  much  to     ^  » 
terninate  the  e:y:istence  of  many  of  the  weaker  institution^,^ 
Kovaverj  CEDaR,  the  lobbying  arm  of  the  labs  and  centers, 
vas  making  headway  with  Congress  and  it  appeared  likely  that 
1:1?:  might  have  to  deal  with  them  in  terms  of  a  ''special 
relacianship,**  whether  or  not  this  was  what  the  Institute 
■Kiued  as  appropriate.    The  question  of  concern,  as  posed' 
■n  Elliott's  charge  to  the  pan^I,  ^^as  as  follows:  Given  the 
^Cir.^lty  of  fnndln;;.   it  wa3  llkoly  that  th;  labs  aad  "centers 

will  not  receive  ME  funds  equal  to  past  levels'  of  Fed-' 
t    -   eral  support  (i.e.,  their  capacity  will  be  under^  / 
utilised  by  NIE) .   .   ,Th^  question  then  arises  whether 
capacity  not  now  being  utilised  by  NIE  and  other  ^ 
funding  sources  unde,r' their  current  priorities  is -of 


such  value  to  cTTe-  education  community  that  it  needs 

\  86 
.to  be  preserved  through  extraordinary  efforts. 

■  7  • 

C,    The  Panel^s  Assessment  and  Recommendations 

The  CampbeM  panel's  review  and  recommendations  covered  four 
areas  of  interest  to  us:   (I)  their  assessment  of  existing 
RotD  capacities;  <2}  their  recommendations  with  regard  to  the 
Jj^^^Tss^nd  -centers-;  (3^  the  procurenient  strategies  they  recom-* 
rendsd  ^^IE  u§e  toj  identify  and  contract  with  the  R&D  per- 
forndrs  best  able  to  do  quality  work;  and  '4)  their  recom- 
r^.endations  as  to  the  manner  in  which  NIE  should  carry  out 
its  role  as  lead  agency  for  educational  R6tD.  _  ■  , 

a.     Existing  Capacity, 

The  OE  fornulation  of  tne  new  program  purch^^se  policy 
>  w^s  premised  ot  thfe  assumption  that  an  adeqirate  dcTj^ree  of  ' 

O  \  •      ■  ■ 
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inst^tutionaL  capacity  existed,  for  the  sysit^ni  to  carry 
out  needed  work.  However,  the  Campbell  panel  assessed 
e:<isting  capacity  as  inadequate  an  quantity  arid.uneveri 
in  quality.  .  "    .  ' .  "  ~        '  " 

The^existing  personnel  base  was  de?scribed  as  inadequate 

f  w 

in  ^heer  numberSj  in  comparison  to  other  field,  in  re- 
lation to  the  federal  R^D  a^^enda  that  h^d  been  projected, 
and  in  light  of  the  large,  decentralized,  fragmented  - 

onor^^tin^  svstem  to  be  i-^r/acted.  ^  The  panel  also  sv,^,g^3l:ed 

P 

.chat  there  were  some  deficiencies  in  qualify  as  well,  and 
therefore  calle^  for  incentives  to  attraoit  ^'the-  v^ry  best 
quality  qf  people"  to  educational  K&D.  -      -  '* 


Their  exac^nation  of  the  distribution  of  personne^P  by 
■functions  suggested  the  need  for  greaJfer  balance  of  ^ 
personnel  across  functipnal  a^eas,  especially  laore  dis- 
*  ^        seuiin^tion  specialists  and  a  better  distribution  of  devel- 
opers into  SEAs/and  LEAs  as  well  as  specialised  R6iD 

at 

organizations.  ^ 

The  panel's  assessment  of  the  institutional  base  of 
educational  R/DoriTlncluded  some  interesting  observations 
on  the  strengths  and  weaknesses  of  .the  various  types  of 
perEori^iing  organizations  carryLag  out  educational  ,R/D6iI 
activities.     Ue  shall  rettirn  to  this  shortiy*     Of  parti- 
cular  interest  to  us  was  their  appraisal  of  the  extent^ 
to  which  there  was  an  in^^errelaleji^^jducatioaal  R/Oo<I 
"system.      The  fragmented,  di'sorga^ized^-  nebulous  nature 
of  the  configuration  that  they  found  was  a  caus^  o"f  sone 
concern  to  the  panel,  and  we  shall  con^id'er  this  poinf  . 
below.  '\ 
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The  Labs  and  Centers 


The  rrrosc  controversial  .portion*  of  the  Campbell  R^6rt  - 
was  the  pane^l*s  sornevhat  negative  assessnJ^nf  "of  the  quali- 
py  of  the  labs  and  centers  and  ^^^^  r^^omTnendations  with 
regard*  to' redut^ing  the  number  of^uch 'rtns t i  tu tions  to  be 
supported  and  traris forming  those  that  ^we re  to  receive  * 
future s,\jpport  tro6  regional  into  "national"  laboratories. 

.'vt^  i^'ccr^coria^,  ■  :q  parclcuiar,  w^C^  crLtlci£:ed  ,as 

p-'^rchvorl:  of  capacities  ani  interes ts^  .   .of  very 
verse  quality  witt^  respect  to  any^  specj^ic  Capacity," 
weak-iiS  need  identificfatlon,  I^^^^^^P^  market: ihg^'weak  in 
qdaiity  control,  producing  products  that  are  "jjllf 'demon- 
strably better 'than  the  range  of  cqminercial'ly-developed 
m^terialrSj  and^frequently  more  expensive,"  generally 
"pe'rceived  by  Inportant  practitioner  grpups."  .  :as  dis-^^ 
Cant,  unhelpful,"    Though. still  irpressed'by  the  labg|^a^^P| 
tory  concept  as  a  sounjl  one,  ^^we  nus^: .hasten' to  add  that- 
at  present  the  concept  Is  out  of  control  and  being  im- 
plement:ec?*ln  unsatisfactory  ways,  ^nd  that  there  a^e 
stlj.!  tjo  many.  Institutions  (-given  Jrhe  shortage, of 

qua4.LDy  R6(D  per3ofr?¥et^)  to  Insure  th^ini fortnly  hi&h 

87 

quality^of  work  originally  hoped  for/*  ,  "  ^ 


The  group*s  recommendatl6iis  revolved  arouuO  ctieir  prefer* 
enco- f ;>r  '^a  smaller  5iet  of -high  q^uallt^^  iri^itttutL^n'?''  con- 
ceived of  as.  "national  laboratSr ies"  ---few  In  number 
^no  mor.e  ,than  si5^>,  oriented  to;/ard  0  national  rather 

an .  regional*  reseafch  a^gfendas,  organi^d  ar^i^nd  clear^^' 
nifesions  related  to  Nile's  priorities,  provicf^  with  stable 
tiiree  to  fivd  year  ^funding  of  aporoximatei  y  $3  million 
to      ^^Tiiljion  a,  yearv.p^^  in6 1  i  Cut  ion,  largely  from  a 
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^sini;le  source  (N3^)  ,  ^5i*th%iLlni ts  on  the  e:<tGnt  to  ^ 
which  the>r  could  seek  funding  from,  other  sources  (to 
laatce  certain  that  cheir  mission,  focu^^  was  not  -cJiluted)  ,  ^ 
wich  close  ties  to  the,  world  of  practice  but  protected 
against  having  to  provide  services  to: LEA s  ox  SEAs  un^ 
Less  these  were  cloesely  tied      ^  gtven  institution's 
uiLss^on  rocus. 

^      ft  ^ 

c .     Procurement  Strate^^les :  Sole  Source  vs.  Open  Cor^aeti-^ 
tion  to  Identify  and  Fund  '^Those  V.ho        3est  Dq 

iTi  recent  years,  strong  pressures  have  been  exerteiT  by 
Congress  and  oth^er  sources  to  insure  that  (as  much  as  . 
possible)  gov^nnment  contracts  are-awarded  on  the  basis 
of  dpen  competijtion.    The  motivation  behind  this,  clearly, 
is  to-aA70id  the  kinds  of  abuses  thatihave  at  times    ^  ^  ' 
-Cropped  up  in  the^w^rding  of  government  contracts.  How- 
ever  J  the  use  of  open  co:7ipeti  tion  for  pro^cure^ient 
assurr.es  tha^  there  is  an^adequate  supply^  of  quality 
perforrr.ers  out  in  the  rjarketplace  for  .g^overnnient  con- 
tracts and  that  If         were,  simply  to  make  known  its 
needs  foJI^particular  kinds  iof  work  it  wpiild  receive  pro'--^ 
posals  and  bids  from  among  a  large  supply  of  qualified 
contractor's,  ^ 


Theisi^nilLcancfe  of  this  issue,  at^'the  tiine  tjie  .Campbell 

*    .  ^         b  ' 

D^an^  1- .wa^=* 'at  vork  w^ta  twfold.     First*         htid  already 

b^een  planning,  to  "diyerj^ify  the  performers  of  NIE's^ 
R&D-^act^ivity'^  through  open  competitions,  notT  restricted 
to  the  l^bs  and  center^  or  necessarily  to  any  other 
particl^lar  types  of  performer  organi  2a^ions  ,    And  ^second  , 
if  the  C^^mpbeU  Report's  recommendati-ons  for  "national 
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lab6ratyries^*  was  accepted  and  If  the  corpc;tii:l ort  for 
desLgrtati ort  as  a  rtatlonal  laboratory  was  open  do  pll 
cypes  or  institudlons  artd  not  ^resdrlccecl  co  existing 
laboratories  or         center^,  then  the  procurement 
ap5/roa<;h  used  to  identify  an^  select  the  new  national 
laboratories  would  have  far-reaching  imolica tions- 


) 


The  panel'criticized  the  use  af  open  competiiions  in  response  to 

It.ds  not  a^lways  4rue.  th«?^^gen£y  staff  can  write  clear  and 
us^iCl  specif fcations  for  what  is  wanted,  particularly  If  ' 
f  the  work  stens  from  a  planning  process  where  the  agenda 
drawn  up  by  national  ei^oerts  from  outside  the  Institute* 


The  costs^of  bidding  are^ventually  added  to  the  government' 
^ost  l]^ft)uti:re  procurenencs >  so  a  high  rate  of  biddin'j;*  and 
th^^t^^P^pSi^yi^g  high  rate  of  unsuccessful  proposals  is 
th^s  Ion:;  r.^r.  dr:i^'in^  fur.ds  ^'^o.y  from  ptirforE^dnce  of  .thc^  \-or;. 
UTiere  there  are  only  a  fe^  good  perf ormers^^or  a  given  fyp^: 
of,  work,  the  rest  of  the  competitors  JiWe  little  ^hance* 
and  their  costs  of  failure  are  a  drain  on  ^nergy  and  time 
that  might  have  been  avoided*    Furthetj  the  cost  to  th^ 
■government  of  -reviewing  a  great  many  proposals  is  not 
alvays  reflected  in  superiority  of  the  fii)al  produ<;t  as 
compared  %:izh  the  qublity  obt^iinable  under  more  limited 
competition.  -^L. 

extensive  co-petitj'onvamong  a  small  number  of  organisations 
^apabl€  o'f  large-scale  work  in  education  R&p  may  tend  to 
pron^ote  dLfiintegration  and  professional  secrecy  withi/\  the  - 
group —  nfegati^e  result;s  to  be  avoided  if  possible*   ^  , 

'fnere  proposals  are  judged"  by  Institute  sta^S|  the  current 
'      procedure  pre-vents  them  from  working  with  propofc^rs  to 
Ibok  at 'ideals  ox  to  revieu^  ad^;ance  Qopies  of  proposals  so 
as  to  nvoitt  submission  of^^viously  unresponsive  oggUnq^^li- 
'    fied  oneSj  or  better^  to  iSrengthen  marginal  ones^  ^ 

-  Researcher^  who  e?:amined  the  competitive -process  in  a  ^ 
slightly  different  fielt!, -sociral  program  ev^^luation  research 
commented  hbw  cor>{;etitipVCTjaile         p];oduce  quality,  and  i,n 
fact  quite  tne  contrarvv^         '        '  "  \ 

T^iey  further  note:!  how  poor  the  coVjnuhidaXion  channels  have  been 
betv^-een  HIE  and  Dotentx^l  con:>ractors  —  ho:^  little  advance  intor 

cation  is  available  to  potential  contra<:t>ors  about  competitions,. 

/  '  '  '  '  I 

iifA  bow  poor  Nlt^^  information  i.s  ^boi^t.petential  contractors.,^  ' 

t^.'.'^n        the  h^/ic  fleve^l  of  ad^qua^^-  mai^J^  lists-  ■  In  addition, 

,t:ie/  pointed  to*  the  fact  that  a  nu:::lSer  of  fv^tentially  bUh"lv  ^ 

^  /  >  * 


Htinber  of  institutions  (rach^fs^^Han  ;:elyin^  on  piece- 
meal conp^i  tions'*) ;  aad  of  the/aeed  for  ^It  to  '^take 
ort- vigorous  analysis  and  leaaership*tasks  with  respect 
t<y  the  overall  educa         RSD  effort  in*  the  nation-. 


It  vas  the  initial  intention,  and  we  think  a  very 
good  one,  that  NI£  be  the  agency  of  the  Federal 
_'govern:T^ent  not  orcily  for  s'upporti ng  programs,  but 
^  cilso  for  developing  ooli-cy  wi t>h  *respec t  to  eduja-  ' 
tional  r&search  and  developm^jnt.     MIE  does  not, 
and  n^^i  not,  have  ins^  its  hvidget  all  the  Fedf^rctl 
^o/ern*ie;nt's  dollars  spent  in  support  of  education 
RiD.     But  it  should  have  enough  of  the  "total  arnount 
,    to  be  a  bajlancerv  to  bring  ^about  coordinations  and 
iote^ration  among  the  Federal  progra-ns . , .  ♦ 

However,  NIE  seens  at  present  to  give  practically 
no  attention  to  the  planning  and  coordination  of 
the  entire^  national , effort  in  education  R&D..,, 
!^IE  should  h^ve  sufficient  staff  at  a  suf f icien£l>^ 

^^feigh  lev^'^  that  it. can  develop  both  an  informational 
and*  an  analytic  overview  and  liViderstanding  of  what 

'    is  going^on  in  the  Federal  governrent  and  outside, 
what  the  key  issues  and  accomplishments  are,  what 
the  key  problems  and  failures  ar^.     Its  role  in 
nhese 'respe^ ts  should- be  intellectual  and  its 
approach  should  be  to  I'ead.by  force  of  analysis 
and  intelligence  rather  than  to  lead  by  dictating.^ 
I^sf influence  over  policy  in  the  Federal  government 
would^cone  prlmarilySf'rom  the  depths  of  its  knov- 
^  ledg^  and  the  inaginatiorT  'of '  its  proposals^  rather 
thtin  from',  bureaucratic  power.    Its  inpact  on'  " 
researci^elsewhere  will  sir^ilarly  depend  on  ilie 
q-ja'iicy  of  data,  insight,  and  analysis,  but  alsd 
<^n  a^ressive  pubJ  icatfon-s,  and  professional  pon- 
tac;s  by  credible  ne-nber?^  of  NIE  staff..,, 

limited  as  i^-'e  tlhink  it  is^^  every  Ifit  o^ntolli- 
gcnce  used  In  thinking  throu^.h  how  to  use  it  best 
will  be  well-speiic.     In  the  political  arena,  too, 
a  wpll-"thoui;ht-out  position  comm^mds  r^-?;pect,  even 
if  kot.  agree^^^nt ,  NI^  c'*in  lead*  the  Con^^ress  much  ^ 
rore  forcefully  thin  it  hif;,  with  strong  data  on 


Htinber  of  institutions  (rach^fs^^Han  ;:elyin^  on  piece- 
meal conp^i  tions'*) ;  aad  of  the/aeed  for  ^It  to  '^take 
ort- vigorous  analysis  and  leaaership*tasks  with  respect 
t<y  the  overall  educa         RSD  effort  in*  the  nation-. 


It  vas  the  initial  intention,  and  we  think  a  very 
good  one,  that  NI£  be  the  agency  of  the  Federal 
_'govern:T^ent  not  orcily  for  s'upporti ng  programs,  but 
^  cilso  for  developing  ooli-cy  wi t>h  *respec t  to  eduja-  ' 
tional  r&search  and  developm^jnt.     MIE  does  not, 
and  n^^i  not,  have  ins^  its  hvidget  all  the  Fedf^rctl 
^o/ern*ie;nt's  dollars  spent  in  support  of  education 
RiD.     But  it  should  have  enough  of  the  "total  arnount 
,    to  be  a  bajlancerv  to  bring  ^about  coordinations  and 
iote^ration  among  the  Federal  progra-ns . , .  ♦ 

However,  NIE  seens  at  present  to  give  practically 
no  attention  to  the  planning  and  coordination  of 
the  entire^  national , effort  in  education  R&D..,, 
!^IE  should  h^ve  sufficient  staff  at  a  suf f icien£l>^ 

^^feigh  lev^'^  that  it. can  develop  both  an  informational 
and*  an  analytic  overview  and  liViderstanding  of  what 

'    is  going^on  in  the  Federal  governrent  and  outside, 
what  the  key  issues  and  accomplishments  are,  what 
the  key  problems  and  failures  ar^.     Its  role  in 
nhese 'respe^ ts  should- be  intellectual  and  its 
approach  should  be  to  I'ead.by  force  of  analysis 
and  intelligence  rather  than  to  lead  by  dictating.^ 
I^sf influence  over  policy  in  the  Federal  government 
would^cone  prlmarilySf'rom  the  depths  of  its  knov- 
^  ledg^  and  the  inaginatiorT  'of '  its  proposals^  rather 
thtin  from',  bureaucratic  power.    Its  inpact  on'  " 
researci^elsewhere  will  sir^ilarly  depend  on  ilie 
q-ja'iicy  of  data,  insight,  and  analysis,  but  alsd 
<^n  a^ressive  pubJ  icatfon-s,  and  professional  pon- 
tac;s  by  credible  ne-nber?^  of  NIE  staff..,, 

limited  as  i^-'e  tlhink  it  is^^  every  Ifit  o^ntolli- 
gcnce  used  In  thinking  throu^.h  how  to  use  it  best 
will  be  well-speiic.     In  the  political  arena,  too, 
a  wpll-"thoui;ht-out  position  comm^mds  r^-?;pect,  even 
if  kot.  agree^^^nt ,  NI^  c'*in  lead*  the  Con^^ress  much  ^ 
rore  forcefully  thin  it  hif;,  with  strong  data  on 


i77. 


gaps  -cind  needs  in  educacional  research  and 
cfevelopnent . .  .  .  " 

doncludo  that  NIE  bay  not  yct^^iken  on  its  ^ 
rightful  roliii^;>  intellectual  leader  of  edjcat^oa 


pemit  NIE  to  pl^y  such  a  leadership  role  >  cj^ 


To 

^  panel  viewed  as^  ^s'SSentidi  ''a  very  sophisticated 

research  and  analysis  ►init  at  J:4^,c  v fry  top  of  NI£*'?-viih 

active  involve'^ent  in  che  snort-cerA  ar.d  lon;;^tefn 

planning"  and  decision  i^ak^ng  carried  out  by  the 

Director's  Office.    As  envisiqned  by  the  panel,  this 

unit  wo'^jld  have  sufficient  resources  to  pexffiic  theirrTcr " 

qonitor  and  analyze  system  functioning  and  to  provid^e 

the  data  base  tor  **infon?ed  choice'\r    (The  panel  charao^ 

terized  the  current  RoD  Syst^tn  S^i'pport  Diyision*s  effort 

to  function  ir^  fftis  r^anner  as  inadeq^iately  funded  and 

insufficient!/  involved  in  top  KIE  planning  and  decision  ■ 

95 

making  --through  no  fault  of  their  own^  we  might  add.) 

* 

In  additlrin,  .the  p^jnel^suggGSted  the  creation  of  a  sp*icial 

■■         *  ^ 

advisory  groua  of  "experts  on  science  and  R£(D"  to  assist 

;       .    .  /  ■  .        ■  , 

the*  NCiiR  In  policy  naking  and  to  provide  additional  in- 

^  put  on  the  work  c^rriea^b^t  by  the  R£^Df^^ste^n  Mpnitoring" 

^  /      '    \         '       \       .  ^ 

,  "and^ Analysis.  Unit  "theV 'had  r^icommended. 


-  Spcti  ra.dou^e  itiput  would  give  Vhe  Cdunc:^l  bosh 
'^^^k^fd'^  s^f*>  yid  ^nalys  is  '  and  \\so  so'ie 

tf^f lection i7^|;iea^liffg  for  poiic;^  by  a  srnall 
^roijp  which-cC^vSt'^fi  btiild  up' s6bst;antfal  insight  if 

sevens^l 


'Cil-VtK^ed^a^vd-^enc^rSfiag^^  tb  ^i^rsis^t  ov^r 
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^st:t?  i;»  saut^  detail 


below  ln»  our.  discussion  of  the  CISST  policy  analysis 


'    on  A^encv-Fl^ld  R&latiQnshl;js  ■ 

D-      The  Can?bfel1r^portV-«  .Debated  ar.d ^^elved 

Tht;  CaT.pbell  Report  was  ^ubr^itteG  in  August  1975  and  imme- 
diately becace  the  focus  of  *debdte  over  a  niinber  of 
Interrelated  issues:     the^^Z^gional"  xs  ^V.atiunal'^  labora- 
tory c;nreptj  trs  Ic^^-s  o:  in:;?^ tuci^r.'-  i/ith  *'sp^c  Lai 
reliiCionships"  to  *^:tEj  and  the  question  of  whether  such 
institutions  with  ^'special  reiarionships"  shbu>ld  be  re- 

^strictcd  to  the  labs  and  centers  orlf\ether  i-nstead  their  * 
selection  should  be  ooened  ^^Idl^ly  :o  "diversifv"  the  R^O    /  ^ 
perf  orr.ors  receivinr^;;  substant  ial  "'iE  support .     To  a  lesser 
extcgitj   there  was  so-ne  discussion  of  the  degree  to  which 
ageniy  procureneri:  sh^ia  reflect  "he  sole  source  approach 
or  rore  open  corpetitlon  via  the  Rr?  route.    Odcfly  enough, 
the  active  '*lead  agency^'  role  calied  for  by  the  panel  * 

'received  little  i:  any  attention  in  the,  debate  that  ensued 
over  thQ  Canpbell  f^eport.    ^  . 

As  v^s  to,  be-^^cpected , ■  the  labs  and  centers  were  po^t  concerned 
aMbt  the  panel^s  re^OTr^ndatlor^St  ^or  they  foresaw  another 
rr>und  of  cuts  paring  down  their  nii*^bet"s  to  fever  still. 
CEDii^  continued  actively  to  lobby  on  behalf  of  the  existing 

and  C'ltnter^j  ^.nd  espec     i  l^LiO  insure  their  ^'spoci^l 
rf  liit  ion:^hlp*'  to  the  Institute  throu;;h  an  NIK  budge:  -c-t- 
a^l^c-     And  ^CEDa^  lobbying;  ef  fccti-veness  was  beconlng 
i nr re^s.i n;5ly  eviden:. 
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.vit:.:n  a  \-^a^  oTthc  subrussion  of  the^lrr-port,  it>  the  issues 
it  nad  raised,  and  the  recormerydatlonfe^  it  included,  appeared 
to  -y^  :icad  and  burieci,    CEDaR  and  the  organization's  Con^res^ 
sior.al  allies  had  von  the  battle  of  the  FY  1976  budget 
appror^riatiori  for  NIE.    The  majority  of  furyds  appropriated 
for  V-IK  that  year  were  earmarked  b-/  Congress,  for  the  labs 
and  :€;".tors  and  for  specific  projects  of  interest  to  Congress, 

relatively  sr.ill  sur.^  to  ^lE's  discretion. y  A  s^fcoryd 
fac::r  at  wor\  here  vas  the  apoointnent  of  a  new  ^lE  Director,, 
\  *^  '  [  ''v'! Jr::?^r^i,  ".^h^  :;as  -*ore  ^y^i^Pthe:;c  to  the  poinr  of 
vL^    c:  the  Icibs  aaci  centers,  h^vir.^  co^.e  fro":  one  of  these 
institutions  hi-^self.    The  word  was  passed  down  that  the 
Car.^^-^^ll  Report  had  been  shelved*  and  with  it  the  notion  of 
"n^:ior:ar*  laboratories-    The  security  of  the  labs  and 
con:^;rs  /*as  assured,  alan^  yith  their  budget  set-aside. 

■  + 

So^^e  ti"^^  later  it  becare  clear  that  the  "special  relation- 
ship'^  notion  had  cor^e  to  be  shelved  too,  along  with  the 
rec -"r^endat  ion  that  there  be  less  open  corrrpetition  among 
poter.tial  contractors  and  more  sole  source  procurement  of 
the  Services  of  "those  who  can  best  do  laE's  work/*  Although 
interest  In  assessing  .''organizational  capability*'  to  carry^ 
outV.^^0  continued  for  sone 'short  tine  longer,  as  evidenced 
by  a^Lhoughtful  paper      and  an  Exploratory  study,  both* 

roTiriseibned  by^i^^E's  Rfi^D 'System  Support  Division/ this 

S>    ,  99 

interest,  too,  was  shelved  a  short  time  later. 


^'>r  a^whijw!^  there  see;ned  to  be  some  support  for  strengthening 
:h*r  functioning  of  the  R^^D;  Systei¥T  Support  Division  and  'its 
pi'^.-^-^ed  Education 'KPU  Monitoring  Progranirf  so  that,  j>erhaps, 
dt  loLiLd  carry  O'jt  the  role  of  the  research  and  analysis  ^ 
unit  en7i:-iioncd  by  the  Campbell  pan^]  .     This  Division  hnri 
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evon  been  given  chc  go-^tjad  to  issue  an  "R£.E)  Source  Sought" 
call  for  the*  creation  of  a  Center  for  Eduf^cion  ?,^D  Systc:TE\ 
S;:udiei>  and  proposals  wero  received  -fron  R^^D  performer 
or'^^nizations  with  an  interest  and  some  capabilities  in  this 
are-i*^^*^^    However^  no  such  center  was  created^  the  Education 
K?l  Monitoring  Prograi^i  has  not  received  funding  for  any  data- 
gathering  activities  beyor.d  the  organizational  survey  begun 
in  1976>  and  the  RiD  Systen  Support  Division  reriains  a  small, 
:'^d?r3':^r:):>r:e^i ,  rel^iively  is'.ilaled  qroup  yJlthin  the  NIE. 
c;Lr\:ccureT    .^fid,  NIH!_  is  no  noroj  active  as  a  lead  a^eqcy  for 
edu^^tlon  RiD  than  It^as  irn  1^975  before;  the  Campbell  Repot;t 
vas.  sub'-yitt^d.     It  even  appears  to  us,  as  we  shall  note 
s'^^ortly  T>;h£n  we  discuss  the  CTlSST  Agency-Field  ^Relatipnsh Lps 
analysi'Sj  that  the  Institute^  3  leadership  has  sefe7:ed  unco"i- 
fortable:  with  the  idea  of  assuming  an  active  lead  ag|pcy 
rolfe'and  urwilling  to  reorient  *  the' agertcv ^ s  style  to  take  on 
s^Lch  an  active.'  position  in  the  workings  of  educational  R/DGT 
LTi  this  cour.tryi  ^  '  \ 

E-  The  Ca-^pbell  Report  and  the  Conts:>:t  of  Educational  PJT)iil 

Polic^yriaklni^ 

noted  etirlier  in  our  discussion  of  what  happened  to  the 
oro^r^i-^  pjrchase  policy  of  OE^and  then  ML  that  the  political 
pr:jCess  h^d  powtrrtul  roles  to'  play  in  determining  the  outcome 
of  a  syste'^policy  debat'?.'  .^£leaj:ly>  we  have  here^  an^th^r 
if.;>t;iricv  of  tiie  j:}Li^ncy  o.   Ln^  pi:i,ltiL<il  :jro^vS>^  —  :or  tli^; 
e  r"  fectiv-nes^  of  CHDaR  ioi>byin^  vas  as  powerful  a  force  in 
c^hf^lving  Lne  Ca-^i^bfeil  Report's  recon-TiftPfda t ions  as*  in  cever^- 
In;^  tlie  pr'b^ra-^  purch.-^se  poVicj^. 
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The  fate  of  th^  C*i'^pbell  p^^nel^s  recomrrLendations  Illustrates 
soire  other  ir^portanc  elenencs  in  the  conteKt  of  educational 
X/D^I  policymaking  as  well,  for  instance:     (a>  the  "s.tup-and- 
5tart-arLGw"  effect  on  policy  development  of  changing  MXE 
Directors  and  leadership  (a  problem  which  has  Continued); 
and  (h)  the  tendency  to  connlssion  analyses^  and  reports  by 
ipdivlduali  or    ^roup;s  selected,  for  their  .srjeciali^ed  ^ 
c;<:5f rtise,  and  then  to  ii^nor e^heir  recorrnendations  and  even 
tj   j^ry  the  anaiysiiS  on  whi<,h  tht:  recorni^ndations  w^r^s  based- 
:V>  ^^T-rsult  of  these  circur.^tances,  there  appeals  to  be  little 
:hat  coald  be  characterized  as  an  ongoing  debate  info'rmed  by 
an  "institutiona)  r^.eiriory . Rather,  what  we  seem  to  see  over 
aod  ovor  ag^in  is  a  continuing  recycling  oi  the  same  debates 
over  the  sa^^e  issues  every  few  years^  without  even  much  of 
an  elevation  of  the  level  on  which  the  debate  is  carried 
ou!i<^^^    l^'e  shall  have  T^ore  to,  say  about  thJ&  imjuediately 
below  as  we  turn  to  consider  the  CXSST  analysis  on.  Agency- 
Field  Relationships  in  the  Fducational  R/Pj^I  System,^  ^ 


3t     i^'^ency-Fleld  Relationships  in  the  Educational  R/D&l  Systen 
A*    The  Issues  fu 


-  \<h£it  is  the  proper  hal^ince  between  field-initiated 
and  NIE-dire(;ted  work? 

-  ShoTild  a  specific  percentage  ofi^?LF/s  budge^  be  set 
'    a?iule  fpr  the  funding  oP^'TreTd-inltiated  work  (and 

'if  r^Oy  what  percenta:;fi)? 

-  'fJhat  are         r.(^s^  a:>r^r.>p r in te  nc^Ji.jnis'ii^  for  prorur- 
in;;  f  leU)- : ni  t  intod  ml  NTF-din^cf'e'J  work? 
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-  Hu'.v  ishoulf  NTE  relate  to  the  field?    How  should  KIF 
relate  to  other  agenMes  which  sponsor  educational 

»  R£(D,  those  who  carry  out  educational  R*^D  activities, 

and  those  who  use  the  outputs  of  educational  R£fD? 

-  What  are  NIE's  responsib^i t les  coward  U.S.  education 

in  general  and  educational  R^D  in  particular?  How 

narrowly  or  "broadly  shovild  the  Instijtute  construe  its 

mission  as  the  "lead  agency"  for  educational  R£fD  in 

this  Country? . 
■  r 

1  ■         '  * 

-  How  can  NIF^utilize  a  very  limited  budger  for  the  best 

shortr  and  long-tern  effects? 

■/ 

B.    Historical  Background 

a.    Cor^plaints  froni  the  Research  Community 

3y  t[;e  suTner  of  1976,         had  been  receiving  intense 
criticism  £ron  a  nuiTiber  of  quarters  —  not  only  the 
labs  and^^nters  who  felt  their  existence  threatened, 
or  Congressional  critics  who  were  disappointedj^in  NIE's 
leadership  and  accomplishn=nts  to  date  and  in  educationa^ 
Fc*D  /dVe  broadly*     In  ad>iition,  NIE  had  been  attacked 
severely  by  the  research  ^omnunity,  who  felt  betraye<J 
by  the  Ln^cicution  they  hac  expected  co  runcty^  in 
:'^'"*r  ;n:-.r'j-  "i,  ^h.-n^i,^!  ■       ^f>nds  to  q-i-iKty  rv^s^-r^h 
^r\i\  el'^va t in>.-,"  the  prc^sci^t*  of  the  field.     Tnstond,  ^'lE'^ 
'Hidgct  ■-J.JC'=5  "lecT  tlie  Tnqtitute's  leTufSrship  to  eli-ninatG 
fundLr.g  f  or'^  ic-ld- In  1 1  i.j       resc^arcti  entirely  in  FY 
107')  ind  to  provide  rc  U^L ; vcly  ins  i^ni  T leant  sum^  for 
rfj^earch  ro"^nMnU#in  ^^th-*r  yt^rs.  'C(>rftrnry  to  NTK 


A83 


btcOTiin^  Lhii  NSF  ortNLH  for  re.^'jarch  reKn^^at  to  education 
the  research  co.TinunityMoqjjd  itself  ^fat  worse  oJPf  under 
I^IE  than  it  ^had  been  wh^n  OE  uas  dispensing  educational 
research  funds  under         Cooperative  Reseofcrch  PrograT). 

The  sev^iroly*  limited  amount  MfE  macle  available  for  fieid- 
inLtiate4  research  was  only  part  of  Che  proBletn  as 
perceived  by  ch^;  research  community.    Researchers  had 
asr^u'ied  th^y  wr;ald  hav^  an  ac^ure  role  in  developing 
tno^^^sti tutf- ' s  research  agenda  and  planning  research 
progranis,  and  that  they  would  be  actively  involved  in 
the  project/program  selection  and  review  process 
through  appointments  to  advisory  and  review  panels 
(as  had  been  the  case  to"a  considerable  degree  under 
OE) .    The  research  community  also  assumed  that  esteemed 
recibers  of  their  r,anks  would  likely  be  represented  on 
top  levels  of  the  Institute's  staff j  ih  temporary 
^ppointnients  as  staff  fellows^  and  through  aft^intments 
to  the  National  Council  on  Educational  R^searchj  ,KI£'s 
polic>Tiaking  body.     Instead*  they  found  tlie^mselves -^ui th 
a  few  exceptions)  not  only  outside  the  ranks  of  the 
chosen  few  advi^rs  with  whom  NIE  ^taff  did  seem  to 
consult,  but  >  /'^en  worse,  appalledat;^  tKe  calibre  of 
the  researchers  and  supposed  experts  who  were  app^yinted^ 
to  these  various  groups. 

?t;rhap3  DOSt  gjtliin;^  of  a^l  t  -  zh?  research  corrjriunily ,  ^ 
an  increasingly  sifieablo^Ghun'k  of  NtE*s  work  seemed  to 
be  procured  by  rean^  of  RFPs  which  tended  to  make  many 
of  the  more  capable  researchers  rather  tinha^py.  Although 
thf.*  caricature^s  probably  not  entirely  faii;^  to  all  RFPs 
issued  by  the  ri^uncy  {and  po^^iibly  not  even  to  mofit  of 


therO^.che  RFPs  werti  characceriKed  as:     (a)  written 
largely  by  young>  inexperienced  NIE  staff,  witli  few 
credentials  fbr  the  planning  oC  vast  research  or  K^b 
pro^rADS  and  with  relatively  little  iTU>ut  from  th^  * 
leaderifhlp  of  the  research  comnuQity;  and  (b)  the  RFPs^ 
themselves  tended  to  be  highly  specific,  not  only"  in 
defining  t^.e  questions  to  be  addressed  but  also  the 
designs,  nethodSj  andfpcocedureij  to  be  used  and  even  ^ 
the  cor.tents  of  the  reports  to  be  subi^ltt^d*  The 
<;ompiaini:        the  field  ::as  that  such  RFPs  turned 
creative  researchers  into  mer^, technicians  to  carry 
out  work  designed  by  relatively  inexperienced  NIE  staff 
moTTibers*     Even  worse,  according"*to  the  complaints,  at 
least  sor.e  of  the  work  was  poorly  conceived  and/or  poorly 
desif^ned*    Although  the  RFP  process  permitted  the 
proposal  writer  tc^ubmit  an  alternative  design  viewed 
as* more  adequate,  there  was  a  good  chance  that  the 
aiternatlvf^  proposal  would  be  viewed' as  ^exciting  and 
interesting^  but  unrc^onnsive  to  the  RFP.    As  If  this 
were '.not  bad^enoughj  yprestiglous^choiars  were  "turned 
off'^  by  the  responses  required  by  the  RFP,  demanding 
.an  oft^en  huge  investtr^ent  in  time  and  resoiirces  o^r  a 
v<>ry  brief  period  (perhaps  two  t^j^hree  weeks  or  even 
less  from  th^i^time  tho  documents  were  reveived  un&ii^^v 
th^;  proposals  had  to  be  >typed,  signed^  of  f"  by  levels  anru 
levels  0 f  "tmiverslty  bureaucrats,  and  received  in       '  - 

:n;t;!j  iii  t'lt.*  ;.:i.id,^  o^  3  L^rop:>^^il  clcarlr/;ho ^s:* 
of  nicer  wno*  t  Lme-sLinp^fid  then  on  rec^elpt  and  turped  - 
away  any  rereivet}  even  five  ;iilT(Utes  after  the^officxnl 
deadl  ine )  -        '    *^         '  / 
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The  complf^ncs  from'  Che  research  coirmunicy,   chcn  focused 

* 

on  two  issues.    On^  was  the  level  of  fanding  for  fielcj- 
initiated  research^  a  level  which  resea^rchers  viewed 
as  inadecjuate  but'S'eemed  to  be  on  the  increase  to  meet 
those  complaints.    More  intensely  felt  was  the  issiue  of 
developing  a  more  appropriate  methani^sm  for  procuring 
workj  which,  ^from  the  perspective  of  £he.  research  - 
comfliunity>  was  not  r>pcessarily  the  RFP,  ^and  certainly 
wasn't  the  RFP  used  as  extensively  as  it  had  been  by  NIE 
in  its  few  brief  years  of  operation.  ,  .  ' 


Data  gathered  by  NIE  staff  tend  to  confirm  someof  the  * 
general  impressions  held  by'  the  field  on  what  was 
happening  to  the  funding  of  research  and         under  KIE, 
The  two  mechanisms  through  which  f ield"initiated  (or 
largely  f ield-ini tia ted)  activity,  has  been  funded  by 
KIE  have  been  competitive  grants  ^nd  unsolicited 
proposals. 


Examining  first  the  data  on  competitive  grants,  in  FY 
1973  NIE  awarded  206  research  grants  amounting  to  a 
total  of  over  $11,000>000.    In  rY\974>  only  73  grants 
^iffre  awarded  under  the  same  "Grants  "for  Research  in 
Education"  prograTTi>  totalling  nearly.  $4, 000>000.  In 
addition  9  grants  were  awarded  to  schoq^^ystems  devel- 
opin^  local  problerti-solvitig  strategies  (total  value 
appror^lmately  $1  j"OOQjOOO)  and"9  grants  were  awarded  for 
interpretive  studies  in  educationa]  RSrD  (total  value> 
nearly  $^50,JOOO),^  In  short,  the  total  sum  awarded  fpr 
research  grants  of  aU  kinds  by  NIE  in  FY*197^t  was  1  * 
than  half  of  what  it  had  been  the  previous  year.  And 
evftn  wors&.   In  FY  1975,  no  research  grants  were  awarded. 
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The  onl>'  grants  giVfen  in        1975  were  awards  to  sEfite 
education  agencies  co  build  their  capacity  for  carry- 
'ing  oat  dissemination  activities,    Addxcional  Statc^ 
Dissemination  Graqts  were  awarded  in  FY  1976*  Beyond 
thatj  an  estimated  S2j'750>000  in  research  grants  was  to 

be  awarded  in  the  remainder  of  1976,  in  the  MIE  program 

*   '  102 
area  of  Sasic  Skills  ^nd  Education  and*  Uork<  "The 

*tTeitd>  then>  excluding  the  SEA  grants  for  dissemination 

Cepacia/  bjlldingi  v.ao  Tor  an^Sll  r  :ullion  si^n  for 

research  grant^s  in  FY  1973  to  be  cut  in  half  '^or  FY 

1974,  and^  to  be  elimiEiated  aUogether  tor  FY  1^75> 

with  an  estimated  suri  ^Approximately -half  of  the  FY  ' 

1974  figure  to  be  awarded  in  the  remainder  of  FY  197fr* 

The  picture  was  even  more  bleak  fpr  unsolicited  pro- 
posals.   In  1973  and  1974  together  >  a  total  of  611 
unsolicited  proposals  were  received',  vof  which  only  13 
(2%)  were  funded>  totaling  slightly  over  $1,000,000  in 
value*     In  FY  1975>  no  un^licited  proposals  were  even 
accepted*    AIT  were  mailed  back*    In  FY  1976>  prior  to 
the  January  31  >  |976  deadline  for  the  first  cycle  of 
awards >  155  unsolicited^ proposals  were  received,  of 
i/hich  7  wer^>  funded>  and  another  172  wfere  received 
prior  to  the  May  31,  1976  deadline,  which  had  not  yet 
been  acted  on  at  the  time  these  data  vere  gathered* 
Clearly>  hundre<is  of  researchers  were  b^ing^turned 
down  by  NIE,  possibly  in  part  because  of  the  quality 
of  the  proposals  submitted,  but  also  no  doubt  because 
of  thfe  sevetely  reetricce^sums^  mad^  available  to  fund 
wiirk  through  this  prot^ureraent  mechanism,.    It  is  no  * 
wonder*  then,  that  the  research  com^nunity  came  to 
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perceive  tho  message  being  sent  out  by  NIE^  as  *'No  ^* 
researchers  need  apply  here/^ 

Tablfe  6-22  underscores  *soi?e  of  these  points  —  the 

decline  in  funding  of  research 'gratits>  from  11-4%  of 

the  Institute's  program  budget  in  FY  1973  to  2*7%  in 

FY'1975  (iv'ith  the  FY  1975  and  1976  entries  accounted  for 

entirely  by  the  State  Dissemination  Grants  Prograji)  ; 

the  lack  of  funding  for  unsolicited  proposals  in  FX 

I?75  and  7V  an^l  th^  ^.ever^^y  li^nit^^d  fuvidi^g  for 

104 

thes^  proposals  in,  even  the  FY  1973-1974  period; 
and  the  attempt  to' be  responsive  to  the  complaint  of 
inadequate  funding,  for  f^iold-initiated  research  by 
providing  what  were,  estimated  to  be  substantially  *^ 
larger  outlays  for^cotnpetitive  grants  and  unsolicited 
^proposals  in  the  subsequent  budget  cycles*^*^^ 

\^ 

'^bles  6\23/^6.24j  and  6/2S  confirm  the  impression  of  - 
t\e  field  that  NIE  was  relying  increasingly  on  RFPs 
calling  for  NIE::iJ.irected^work,  and  decreasing  the  award-* 
ing  of  grants  (which  generally  permitted  researchers^^ 
gte^t  deal  niore  autonomy  in  both  the  planning  and' eondiict 
of  \tiie  i^rkO^*^^ 

^    "  .      0  /  ^' 

In  Table  6<23,  column  C  data  are-  for  contracts  and^ 
coluqifi%G  data  are  for  grants,    "tfie  data  suggest  that 
the  overwhelming  majority  of  funding  is'  of  the  MIE- 
directed  type  and  ithat  there  wap  an  increa*se  in  NIJ*> 
directed  procurements  fro:n  70.5-%  oE  program  funds  .ln« 
Fy  1973  to  37^  in  FY  1976. 
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CoDpetitive 

Unsolicitcds 

Program 
-  Funds  . 

% 

11.400.000 
.11.4 

0 

100,500,000 

FY  74  . 

 1 

5. 135. 323 
8.3 

1^010.055 
1.6 

 1  

62.171,156 

FY  75 

1 .713, S30 
2.7 

0 

62.890.841 

FV  76 

5.965. 530 
6.4      -     .  . 

* 

0 

.  62.290,949 

IS'EDGE 

i  550  000* 
20.5  ' 

526.445* 
5.4 

17,300.000 

FY  77 

\ 

7.010.000*' 
9.0 

1. 000.000*' 

i.3  ' 

78  300'  000* 

FY  78 

14. 311. 000 
11.7 

L:  5.400.000* 
'  4.4 

.  122,000.000*  y 
f  . 

FY  73  * 

i 

14.626.000* 
10.5 

H:  6,000,000* 
4.3 

-    ik. 900.000* 

* 

1 

*  Estimat^d^ 

% 

,"1  ,  . 

1 

1 

'Figures  incliade  cor^tinuations. 


It  should  b9  Tioted  that  the  figures  on  do  not  include  all  awards 

made  through  grants  competitions  since  cbatracts  hbto  awarded  to^ 
for-profir  organization's  which  xODpeted  successfully  in  these^^^oisjietitions. 


Table  6.22 


■V 


/  - 
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Contracts  vs .  Grants  ,  * 


C 

G  -*  

Total 

FY 
% 

73  * 

70,500,000  ■ 
70.5 

29,800,000 
29.5 

* 

100,300,000 

FY 
% 

74 

47,496;000 
76.4 

14,675,000 
23. '6 

.^2,171,000 

FY 
% 

75 

54,820,000 
87.2 

8,071,000  • 
12.8 

62,891,000  *  , 

FY 

76 

. 

54,177,796  - 
87.0 

  . 

8,113,153 
13.0 

•  62,290,949 

\     ^  ' 

* 

1 

TnbU'  ft, 23 
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Competitive 
Contracts* 

Competitive 
Grants 

■   —  ■  

N'on-CcDpetitivc 
Contracts 
(sole^  source) 

Moi'.-Conpctitive^ 
Grants** 

rotal  . 

FY  76 

%  of  Progra.-n 
Fui^ds 

-20,892,789  ^ 
33.S   '  ' 

3,963,330 
6.4 

33,285,007' 
5  3.-4,  ' 

4,1^9,823 
6.7 

'I          '  — 
52,230,949 

FV  75 

%  of  Progran 
Funds 

13,024,146 
20.7 

1,713,830 
2.7 

41,793,629 
66.4 

6,357,236 
10.1  - 

r>2,830,841  ■■ 

FY  74  , 

%  of  Prograr. 

10,493,  570 
16.9  ■ 

5,135,323 
8.2 

36,997,213 
S9.S 

9,5'10,050 
15.3 

52,171,156  4 

FY  73 
of  Prog  ran 
Funds 

1,800^000  J 
1.8 

11,400,000 
11.4 

68,700,000 
68.5 

13,400,000  . 
18.3 

100,300,000 

All  figures  Include  continuations* 


/ 


includes  RPPSj  awards  to  for-profit  organizations  under  grants^ cojigxjtitions 
includes^nsoliciteds  (in  74  and  76)  and  solicited  non-conipetitive  grants' 

f  ■-     -  • 


Table-  6.2^ 


1 

New  Starts  . 

Competitive 
ContTficts 

Coinpetitive 
Grants 

^Non-Competlt 
Contracts  - 

ive  Kon-CoKipetitive 
Grants 

Continuations 

Modification 
of  Ongoing 
Contracts  5  Grants 

Total 

%  of  Program 

Budget 
%  of  New 

Starts 

6,657,674 

10.7 

32.9 

332,173  . 

1.3 

4.1 

12,011,892 
.  19/3 
59.4 

721,309  ■■ 

ft 

1.2 

-  3.4 

■  ^  1 

^42,067,901 
67. S 

02^:^90,949 

* 

*- 

FY  75  ^ 

%  o£  Progran 

Budget 

of  Now 

Starts 

7,469,072 

n.9 

53.1 

1^115,525 
1.8 

2,655,064 
4.2 
18. & 

2,830,488 
4.5 

20.1  '  i 

48,820,692 
77.6  y-.' 

62,890841 

FY  74 

H  *of  Program 

Budget 
^  of  Nei/ 

Starts 

6,155,000- 

9.9 

41.2 

5,118,000 

8.2 

34.2 

~2',015,957 
3.2 

13.S      ■  ^ 

■1,057,043 
2.7 

^  ....  ■ 

1 

4*7,227,000 
76.0 

1 

% 

O2,!71,'OO0 

A  '    '        Budget  Figures  on  this  detail 

are  not  available  for  any  other 
years. 

'Breakdo^'Hi  according  to  Kew  Starts  vs^  Continuations 


Table  6.25 


TabJ.e  shows  the*  increase  in  usc  of  (co  lunm  1, 

"competitive  contracts**^)  from  1.8%' of  the  FY  1973 
program  funds  to  33^5%  of  FV  1976  program  funds,  with 
an  accompanying  d'^clina  in  cOT^.petitive  grants  fron  FY 
1973  to  FY  1975  (and  then  an  increase  in  FY  1976).  One 
of  the  particularly  interesting  points  underscored  by 
this  table  is  the  huge  chunk  of  NIE*s  budget  allocate<l 
through  sole  source  procurement,  ranging  fron  a  high  of 
87^  in  FY  1973  to  a  lo«\of  60?:  in  FY  1976.    This  category 
includes  th-^  budg^it  St^t^asides  for  th^  I^Lj:.  3.pA  CLiiVtii"-; 
and  other  funds  earmarked  by  Congress  for  special 
programs.     It  also  includes  continuation  funding  for 
programs  already  in  progress.    This  was  particularly 
important  in  FY  1973  wh^n  ^>rograms  w^re  transferred  in 
toto  from  0E>  with  their  continuation  funding  mandated 
■by  previous  OE  decisions  and  contractual  obligations* 
NIE  succeeded  in  wittllng  down  this  sum  somewhat  over 
the  next  few  years>  and  a  number  of  programs  were  either 
completed  or  terminated  by  NIE  within  a  year  or  so> 
freeing  up  larger  sums  for  NIE  discretionary  use* 

However>  ^even  when^  the  dataware  analysed  separately^ 
for  continuatioi^  funding  vs.  new  starts>  as  in  Table 
6.25,  we  find  in  FY  1976  heavy  reliance  on  non-coippe t i-  , 
tive  (i.e.j  sole  source) 'contracts  >  even  among  the  new 
startSj  and  decreasing  use  of  the  competitive  contract 
(I.e.,  RF?1  approach'     Tt  is  not, clear >  however >  to 
wliat  extend  these  FY  1976  data  reflect  an  e-ifort  by 
■  NIE  to  be  responsive  to  the  complaints  against  KFPs> 
or  simply  heavy  Congressional  earmarking  if  the  FY 
1976  budget  >  including  new  starts  as  well  as  continua- 
tions.   We  assu:ne  the  latter*  \ 


A93 


b.    NCER  CaII_Cgr  Staff  U'brk  to  Su^ort  Policy  Develop  - 
ment  on  FIS  ^ 

By  micI-1976,  che  NCER  had  decided  that  the  time  had 

come  to  develop  a  policy  on  f ielci-iniciated  Research 

and  on  appropriate  mechanisms  for  procuring  NIE*S 

work.     In  addition  to  its  desire  to  be  responsive  to 

co:nplaints  froni  the  research  community  about  the^ 

specificity  of  RF?s>  CouncilMnambers  were  aware  of 

'criticisns  of  overly  directive  procurement  in  two 

analyses  that  had  just  becpipe  public  —  one,  ap  KAS 

report  assessing  Social  and  Behavioral  Science  Progrants 

in  the  National  Science  Fpuhdation,'^^^    the  other  a 

paper  produced' as  part  of  (the  ongoing  NAS  study  on  social 

R&D  calling, for  maximum  frJtedom  for  the  field  in  con- 

\  108 

ceptuallsing  arid  designing  ^research*         There  were  other 
-factors  at  work  as  wall:,    cbuncil  members  had  b^en  e."<- 
prcssing  30^^s  concern  about 


\ 


spent  on  researching  and  wri. 


the  amount  of  NIE  staff  time 
ting  RFPs  given  the  fact 
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that  the  field  could  probably  do  the  required  conceptual 
and  design  work  as  well  or  better.    And  beyond  that, 
given  ^e  Congressional  earmarking  of  more  than  25%  of 
NIE's  budget  for  the  labs  and  centers  and  tfte  specifica- 
^ion  of  field-initiated  program  planiftng  by  these 
.  institutionSj  the  developmfenc  of -an  Institute  policy  on 
field-initiated  studies  and  procurement  strategies  for  ■ 
this  work  Cfine  to  be  se^n  increasingly  as  a  matter  of 
consider  Able  inporcanct^ . 

c>    NIE  Staff  Work^         '   '    4  '  "  ^ 

Staff  members  of  the  NIE  pllinning  anit  had  been  working 
for  some  months  on  an  analysis  of  the  field-initiatod 
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studies  C!^IS)  issue  and  had  proJucod  a  number  or^hi/'.hly 

109       '    '  '  * 

useful  draft:  documents.         Of  particular  value  in  tht^be 

ma^terials  were:     the  definitions  they  provided  of  the 

range  of  types  of  functioning  included  \inder  the  FiS 

rubric;  the  arguments  they  summarized  for  find  against 

YlSy  for  and  against  NIE-directed  work;  their  analysis 

of  ho'.N?  NIK  p^b^dures  ^oriented  the  st^ifE  toward  the 

ready  use  of  P^FPs,  in.  rt^rt  ^because  of  the  cuuibersone 

nacure  of  the  procedirres  required  to  establish  a  grants 

competition;  informacion  they  gathered  about  strategies 

in  u^e  to  involve  the  field  in  NIE  planning  and  progi^ni 

functioning;  and  data  they  gat;hered  on  NIE  funding 

through  grants  and  contracts*  'We  have  already  co^nsider- 

ed  the  funding  data*    Before  continuing,  it  night  be 

useful  to  summarize  some  of  the  other  points  in  the 

«  _  ' 

staff  analysis . 

1.    Definition  of  FIS  • 

The  MTE  planning  staff  defined  FIS  in  terims  of  the 

extent  of  control  exercised  by  each  of  three  groups 

in  the  conceptualization  and  design  of  work  carried  , 

out  under  agencj^  funding-    These  three  groups  were; 

'  (a)  the  NIE  straff;  (b)  the  principal  investigators 

who  actually  executed  particular  pieces  of  work; 
I* 

and  Xc)  the  'Afield"  more^broadly  conceived,  i.o^,  , 

Lnrjiudin^/f^actitiunt^rs,  puJ>l  Lc  intereiit  groups  , 

I  J  ^       n  110  ' 

etc.v  as  weYl  as  researchers.        .  * 


They  then  described  tvo  ways  In  which  the  FIS  Issue 

could  (and  probably  should)  be  understood:  (a) 

* 

"narrow  FIS*',  whiich  Ls  how  jFIS  is  i^enerally  conceived, 
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'focusiilg  on  the  rolu  of  the  priacipal  investigator 
in  conceptualising  and  designing  a  pieces  of-  research; 
and  (b)  "broad  F1S'\  in  which  attention  is  focused 
on  the  role  of  ^he  'Afield'*  (4>roadly  conceived)  in 

'  the  planning  and  Review  of  NIE-\un<^d  work. 

In  their  analysis-  pf  narrow  FlS>  they  provided 
particularly  u*ful  description  of  *the  ways  in 
which  the  role  of  the  principal  investigator  cah  S 
vary  "frort  total  control  over  the  concepcudlization 
and  executicTn  of  the  project  to  very  little."    (a-)  ^ 
Unsolicited  proposals  pro^tido  the  purest  form  of 
FIS>  'allowing  maximum  autonomy  to  the  prihcipaf 
investigator    who  conceptualises  the'projec*?> 
detettnines  v^liat  she,  questions  axSf  to  be  studied> 
designs  the'vork>  and  executes  it.     jtb)  Grants 
competitions  within  NIE-definecf  program  areas  * 
provide  a  considerable  amount  of  autbr^my  'to  the 
principal  inVeStigator>  Jbut  plac^  one  iimita tion 
on  ^he  proposed  vork  in  that  it  must  fall  within 
the  NIi:-def^ned  set  of  problem  areas  to  be  'fundecl 
under  the  specific  competition,     (c)  RP?  d£^sign  ^ 
competitions  restrict  the  principal  'investigator 
somewhat  further  in  that  ths  RFP  issued  by  MIE  * 
defines  not  pnly  the  problem  area  but  al,so  tfTe 
specific  qxtestions  to  be  studied.  Tt^^^incipal 
investigator  doos>   thou^>>  havf?  ^^Jg^^\^|^^**''?'^^^'^y 
in  the  design  of  ii^  project  to  an;^uer  th^^^^e 
questions,     (d)  Highly  specific  RFPs  represent  the 
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far  end  ^of  the  continuunif  offering  little  if  any 
creative  freedom  bo  tlio  principal  investigat;(ir , 
Such  i4JF?F5 'may  spcoLfy  sample  si^ic'j  instruner<ts  to* 


bo  used,  etc.    Tiiey-rtfay,  rapgc  in  sptjcif  Lcrtyj^  from 
only  n  few  particular  design  requirements,  to  *'a 
^^Joint  where  ^theoretically)  no  aspects  of  the  clesiga 
are  left  up  td^  the  principal  investigator  PIS 
traditionallV^is  understood  to  include  only  (a)  and 

*  »  *  4  J 

(b)  above,  i*G,,  unsolicited  proposals  and  grants 
coTTipetitions*  ,  ^ 

In  considering  "bro^d  PtS",-  the  focus  of  attention 

is  #n  what  points  in  the  planning'  and  project 

execucion  cycle  the  broad  "field"  should  be  invol- 

*  _^ 

ved  and  the.  nature  of  the  inputs  to  be  provided 

Ci*e,,  how  much  cloat*the  field  s  inputs  should 

carry)/   The  field  might  te  inyolVed  kt  such  stages 

as:     (a)  general  policy  development  and  long- 

range  planTiing;   (b)  general  program  planning;  (c) 

'planning  specific  procurements*;^ C^)  review^of 

proposals;  (e)  execution  of  projects  (through  regies 

on  advisory  committees,  fijr  instance);  and  (f) 
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evaluation  of  results*       '  The  issue  the  NIE  staff 
was  ^truggltng  with  he^,  was  hoiJ^the  agency  might 
l^etter  relate  to  the  field,  appoint  we  sljall  cou- 
sider  more  fully  below.  '  ^ 


ii  A^Arp;uTnents  Tor  arid  Afiainst  FIS  and  HIE-Directed 
,  Work  :  ^         V     ^  ^  ' 

The  staff  analysis  summarized  some  of  the  arguments, 
mad^  for  -and  "against  each  mode  of  procurement* 


The  key  arguments  in,  favor  of*  PIS  ihclude  the 
following;     (a)  The  best  minds  in  the  field  "are  not 


likely  to  rgspond  Co.RFPSj  ^nSy  therefqfre>  without 

FIS  Ch^ir  talents  would  be  list  to  NIE,     (bj)  J'h^ 

NIE  priority  program  areas  represent  only  some  of 

the  educational  problems  an  agency  might  want  to  ■ 

attack.    Since  all  other  procurement  is  carried 

out  within  these  ^program  areas,.  FIS  is  necessary 

to  nak^  .certain  that  good  ideas  and  strategies  ^ 
* 

outside  thes^  areas  are  not  excluded  from  the 
possibility  of  sufJport.     (c)  Basic  reFiear-ch  questions 
by  their  very  nature,  are  most  likely  to  come  from 
work  in  the  field,  and  basic  research  has  been  the 
source  of  many  of  the  most  significant  influences  on 
education  in  the  past  fifty  years*    Such  work^  alsoj 
should  not  be  excluded  from  the  possibility  of  NIE 
support*     (d)^  Similarly,  nhe  field  is  most  likely 
to  be  in  the  bes't  position  to  judge  the  directions 
in  whi^h  the  growth  of  the  field  sl^ould  go-  And 
(e)>  *a  side-effect  of  .funding  basic  research  by  top 
scholars  p,in  the  universities  is  that  a  portion  of'  ■ 
this  money  is  likely  to  be  chann^lle^  to  the  support- 
and  training  of  graduate  students  who  will  assist 
their  professors  in  the  research  and  then  be  able  to 
carry  out  additicfnal  research  of  their  own  in  the 
future.  ^ 

»  I 
There  are  a  number  of  other  arguments , -though,  to  be' 

Mde  a^^i[nst*^IIE  Investing  troo  heavily  in  FIS,  ti'^pc^ci 

ally  when  FIS  funding  is  equated  with  Che  funding  of 

basic  research  (as  was  generally  the  case  in  the 

thinki'^of  the  basic  research  community)^     (a)  Ba'sic 

research  entails  a  high  degree  of  uncertainty.  It 

is  difficult  to  knoAwhich.  areas  of  basic  res*^Jirch  ^ 


^ 


will  have  a  payoff,  antl  ^ittle  of  th^  basic  research 
is  funded  is  likely  to  produce  visible  payoff* 
^  (b)  KSF>  NIH>  and  NIMH  alreac^y  fund^uch  basic 

^  ,  research  that  is. relevant  to  education.    And  <c) 

educational  problems  are  generally  interdisciplinary 
1       in  nature  while  basic  rese^irch  tends  to  be  carried 
'  out 'within  individual  disciplings>  focused  op.  ques- 
tions derived  frop  the  internd^pl  logic  and  needs  of 
individu£tl  disciplines*    One  fnight  question>  then> 
^        ■  whether  or  not'  the  funding  *o£  discipltne-based^ 

research  is  the  most  effective  v&y  to,  attack  educa- 
tional  problems*  which  are  derived  from  the  cJemands 
^  of  operational  reality  and  ar^  generally  interdis- 

^tiplinarv  in  nature. 

The  arguments  against  FIS  would  ^eem  to  suggest  the 
advisability  pf  investing  more  heavily  i^NlE-direc- 
ted  workj  and  a  number  of  other  argument's  have  been 
made  in  favor  of  this  mode  of  procurement:  *  (a)  NIE  ^ 
is  an  agency  with  a  Congressionally  mandated  set  pf 
^lissionsj  accountable  to  Congress'in  terms  of  those 
missions.    Most  *basic    research  is  not  specifically 
directed  toward  those  missions*     (b)  It  mdy  be  that 
one  of  the  key  roles  to  be  played  by  the  field  is 
to  facilitate  and  refine  problem    definition  in  a 
manner  that  satisfactorily  reflects  the  diverse  * 
perspeC(£ives  of -different  constituencies  in  the 
iroad  field-  *This  requires.^  according  to  this 
.         .  argumentj  a  degree  of_. orchestration  by  a  central 

agency,  and  therefore  can  probably  best  be  done  by 
^  NIE  staff>  who  are  least  likely  to  have  a  stake  in 

•  any  one  perspective  and  who  can  therefore  best 

'  : .      I  ■■  '    ■    ■  ■  ■  - . 


synthesize  the  diverse- inputs  from  the  fiel-d  in 
reasonably  unbiased  solicitation  RFPis*     (This  latter 
argument  se^s  .somewhat  weak  to  us  because  of  its 
tie  to  the  drafting  of  REPs,  but  we  shall  have  more 
to  say  in  favor  of  th^  orchestration  notion  below). 

There  are  sone  obvi'ous  .arguments  against  N'lE-direc- 
ted  work  through  RFPs>  and  we  have  noted  these 
already,     (a)  RFPs  tend  to  "turn  off"  the  best  minds 
in  the  research  cofiznunity  and  turn  them  away  from 
doing  NIE  s  \^rk-    And  (b)  the  researching  and 
drafting  of  -RPPs  tjerid  to  absorb  enormous  amounts  of 
staff  tlme>  vhi'ch  seeuis  especially  ^inefficient  since 
the  required  tasks  could  prjjbaBly  be  done  as  well, or 
better  by  the  field^ 

In  determining  whether  the  FIS  or.  RFP  approach 
should  bemused  for*  a  specific  procur^iaent,  an  ex- 
celltent  recommendation  was  included  in  the  staff^ 
analysis/  For  niore  I'outin^'tasks,  where  the  prob-^ 
lem  is^clearly.  understood>  the  TOSt  effective 
strategies  for  tackling  it  already  known^etc,  an 
might  be  the  appropriate  approach  to  procure- 
ment/'  However^  for  work  in  areas  where  the  problem 
is  least  well  understood  >  where  there  ^S'^lack  of 
conceptual  clarity  and^lack  of  a  clear  understanding 


o-f  what  strategies  .will  or  will  not"work>  a  larger 
role  for  creative  thinking  from  the  fjleld  would 
seen  to  be  essential* 


iii.    H'lE  Prnred^res 


The 'staff  analysis  nottid  sevv^ral  internal  NIK    .  ' 

♦  problems  chat  might  account  for  thti  lou  level  of 
funding  of  field- initiated  ™rk.    There  ua^  no 
separate  office  handling  grants  or  unsolior-fe^^  , 
proposals*    Therefore  the  awarding  of  funds  r^- 

^  quired  the  approval  of  personnel  from  a  prograrn 
area,  and  program  personnel  could  be  expected  to 
be  somewhat  reluctant  to  part  witlv^nds  they  had 
anticipated  spending  on  work  they  harl  pl-i^*npd  in 
order*  to  fund  proposals  coning  from  outside  the 
Institute.    The  procedures  for  establishing  grants 
competit:yDns  were  so  cumbersome  and  the  RFP  pro- 
cedures so  much  easier  that  the  staff  tended  oft^n 
to  use  th&  RFP  even  when  they  r^ognized  that,  a 
grants  competition  might  be  more  suitable  for  a 
particular  procurement.    And  finally,  the  contracts 
officers  tended  tp  pressure  the  prqgram  staff  for 
maximum  specii^icity  in  procurements,  with  highly  * 
specifit  RFPs  receiving  the  nrost  sympathetic  hear-- 
ing*    The  staff  *  suggested  a  number  of  steps  to 
overcome  th^se  difficulties  —  set^-aside  fiends  for 
grants  and  unsolicited  proposals,  establishing 
^erparate  NiE  units  t<J.  ^dminist^r.  these  funds^,  having 

these  proposals  reviewed  by  advisers  from  outJfeide 

M '  114 

,  tTie  agency, ^tc-         We  need  not  be  concerned  with  , 

these  matters  here/     ^     ^      '  ,      ^  / 


Iv,    Approaches  to  Involving  the  Broad  Field 

The  NIE  staff  described  a  ^urnber  of  approaches 
currently  being  used' (or  planned  for  fu&ure  use)  to 
iCivOlve  the  broad  field  in  NIE  planning  and  work- 
These  included:     (n)  hold\ng  agenda-^building 
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conferences  to  establish  priorities  wj.thin  program 
areas;  ^b)  establishing. advisory  panels;  (c)  sending 
KIE  program  officers  on  trips  afound  the  country  to 
talk  to  "people  in  the  field;  "(d)  convening  conferen- 
ces  to  enable  invited  participants  to  react  to  issues 
papers  detailing  planrved  RFPs;  (e)  nailing  out  a 
draft  RFP  for  comments  by  the  labs  and  centers  who 
would  be  involved  in  this  d'osecJ  conipetition;  (f) 
esCibiishin^  peer  review  panels  to  review  proposals 


received  for  grants  competitions;  (g)  requiring  # 
^       contractors  awarded  particular  pieces  of  wotk  to 

consult  wltli  the  field  and/or  set  up  and  use  advis- 
ory parfels  throughout  ttte  life  of  a  project;  and 
(h)  bringing  together  a  grout?' of  consultants  to 
evaluate  a  design  produced  by-fl' sole  source  con- 
tractor, and  to  suggest  improv^ents  in  the  design* 

J-     The  Commi-RSioninR.  of  CISST's  Policy  Analysis 
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.At  the  tine  th^  is'IE  straff  work  was  b^ing  carried  out, 

our  group  was  under  contract  to  NIE*s  R&D  SyscW  Support 

Division  to:  -  (a)  develop  an  analytical  framework  that 

couW  facilitate  identification  and  analysis  of  R6D  - 

syste^  issues;  and  (b)  illirstrate  the  utility  of  this 

framework  by  carrying  out  two  short'-termt  (60  days  each)  . 

policy  analyses  on  issues  selected  jointly  by  NIE  and 

CtSST.    The  NIE  planning  unit  suggested  V^o  policy 

issues  which  were  of  particularly  vital  and  pressing 

concern  to  its  staff,  and  these  were  agreed  to  as  the 

issues  to  be  tackled.  ^  Tlte  FIS  question"  \^as  one  of 
116    '  ■ 

these  issues.  The  analysis  we  produced  was  des/:rlbed' 
at  great  length  in  a  document  entitled  Afioncv-Field 
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felationshlps  in  the  Kducatlonal  Syste 


mi  A 

^  Policy  Analysis  for  the  National  Institute  of  Educ.i- 

~  117 

Eion>  % 

■ "  » 

The  two  speciric  issues  of  concern  were  described  as: 
(a)  deterrr^ining  the  appropriate  balance  between  field- 
initiated  and  XIE-directed  work;  and  (b)  determining 
the  most  appropriate  mechan^sj/s  for  procuring  field- 
initiated  and  NIE-directed  work. 


In  chinking  about  these  questions>  we  werestruck  by 
the  rather  fundamental  and  broad- ranging  implications 
of  the  questions  raised>  especially  when  viewed  from 
the  perspective  of  R^tD  system  requirements*     In  order 
to  deal  wich  the  procureinent  questions 'KIE  had  raised  > 
^  ,in  a  way  that  seemed  meaningful  to  us>  it  seemed  to  us 

that  there  were  some  critical  prior  questions  to  be 
[     addressed  and  clarified.    Thereforc>  we  proceeded  to 
refortnulate  the  questions  of  interest  to  the  Institute 
in  a  rWiner  that  Vre  felt  would  best  permit  us  to  shed  ^ 
some  light  and  suggest  soae  directions'f or  policy 
development  ♦ 

Ttie  analysis^proceedsd  from  recognition  of  two  defining 
^       features  of  NIE's  character  as  a  sponsor  of  educational 
R/D£tl  activity;     (a)  NIE  is  a  ml^sjk>n-oriented  R&D 
agency;  and  C^'^)  is  the  laad  n^'SncV  for  fed^^rdl 

activity  in  educational  RfirD.    Given  that  role,  NIE*s  / 
funding  policies  should  be  ^understood  in  terms  of  the 
agency's  purposes  as  these  impact  on  the  total  educa- 
tional  r/D&I  system* 
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We  were  aware  that  many  researchers  unhappy  with  the 
current  pattern  of  "NIE  procurements  were  suggesting  that 
the  Insti*tute  should  commit  itself  to  a  predetermined 
percentage  of  NIE^s  budget  for  field-initiated  work. 
The  expec^a'tion  was  that  such  a  predetermined  set- 
aside  formula^ would  create  a  larger  flow  of  ^unds  into 
field-initiated  work  (especially  basic  research)  clian 
had^reviously  been  the  ca.'^e* 

iVcr^ever,  our  perspective  suggested  that  predetermined 
set-aside  formulas  were  not  the  most  reasonable  approach  ^ 
'  to  the  problem/  What  the  balance  of  different  types  of 
funding  should  be  anfl  how  an  agency  should  relate  to  the 
Eiald  with  which  it  worked  would  depend  on  ^he  purposes 
the  agency  was  trying  to  achieve.    The  agency*^  behavior 

r 

would  have  to  be  fitted  to  whatever  it  was  necessary  for 
the  agency  to  do  i-f  it  were  to  achieve  its  various  pur- 
posesj  in  a  particular  field>  with  particular  needs; 
operating  at  a  particular  level  of  ifiaturity^and  readi- 
ness to  take-<y  certain  kinds  of  work.  ^ 

There  were,  then  a  number       prior  questions  to  be  con^ 
sideredj  involving  clarification  of  the  agency's  purppses 
alftd  the  extent  to,  which  it  wa&  prepared  to  carry  out  all 
f>r  only  some  of  its  l^egislative  mandate.    As  we  saw  its 
what  NIE  acts  cjn  as  its  mission  will  determine  its 
budgetary  priorities  and  al^.o  bow  it  xshoulcl  .md  nould 
relate  to  the  field. 


The  essence  of  the  *issue>  as  reformulated  by  the  CISST 
team>  was:     How  does  mie  achieve  its  purposes>  through 
procurements  and  other  agency  act  ions  >  ta^ken  in  con- 
sort, wi\h  and  as  part  of  the  field?  ,  * 
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In  a  second  meeting  with  staff>  we  sketched  olir  re- 
formulation of  the  polUcy  issue  >  our  rationale  for  this 
reforniilation>  and  the  analytical  franework  we  intended 
to  use  to  carry  out  the- analysis .  With  a  go-ahead  frorn 
the  NIE  staff  >  we  proceeded  to  develop  and  dra/t^ur  ' 
analysis*    We  summarizes  some  of  the  key  points  belo\^. 

The  CISST  Analysis  ^ 

'  I 

a ■    Systems  Perspective 


A  key  premise  of  the-CISST  analysis  is  that  the  insti- 
tutions and  personnel  involved  in  the  production  and 
utilization. of  educational  K/D&I  outputs  form  a  "systeh" 
and>XLOt  just  an  ^unconnected  "configuration'*  of  entities. 
Despite  the  looseness  and  inadequacies  .of  the  educational 
r/d&I  systerrij  yh^t  is  done  in  one  area  or  in  relation  to" 
one  issue  will  ii^kely  have  impact  on  other 'areas  and 

_haye  impact  on  other  issues.    Acceptance  of  this  premise 
does  not  deny  that  there  is  only  a  weak  XiAk  or  integra- 
tion  betwaen  institutions  which  should  be  more  closely 
rjeiated  and  whose  goals  might  show  iitore  coherence.  Kor 
does  the  ^'system"  usage  need  tb  imply  a  nK>nolithic>  cen- 
tralize network.    But  there  are  .very  significant  impli- 
cations'for  ^long-term  planning  and  monitoring  and  for 
the  development  of  initiatives  by'a  federal  agency  that 

.do  con*:  fro:^.  ^  '"^yaten!^"  psfrspoctWe.    Most  particularly, 
the  perspective  permits  a  proper  concern  for  system 
capacity  building  an5  maturation. 

The  mission  context  from  whid;h  Nlfe  Dperates>  thfe  func- 
tion^j  which  constitute  R/DfJ  systems,   the  Current 
developmftnta^l  state  af  educational  R&D,  antj  the  socio- 
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political  environment  of  education  and  educational 'R£[D 
are  central,  analytical  elements  on  which  this  systems? 
perspective  focuses.    N'lE's  mission,  and  its  various 
activities  are  viewed  in  terms  of  their  impact. on  the 
educational.  R/D&I  system's  healt^i,  functioning,  ancf^ 
outputs. 

b-     Immaturity  of  the  Educational  R/B&I  System 

A  J;ey  assumption  of  the.  ana-lysis  is  t-Hat  the  educational 
R/DStl  system  at  pre^senf  is  i^n  an  immatfLire  state  of" 
development.    Symptoms  of  the  immaturity  of  the  system 
are  evident  in;     (a)  the  significant  gaps  in  functional 
specialization;  (b)  the  weakness. of  the  existing  insti- 
tutional  and  personnel  base; * tc)- the  weakness  of  the 
field's  technology  base;  (d)  the' underdevelofied  state 
of  mechanisms  for  information  "flow  and  quality  .control; 
(e")  the  lack  o"f  conseVisus  on  standards  for  judging  "the 
quality  of  educational  R/D&I  outputs;  ^nd  (£)  the  poor 
quality  of  much -of  the  work  carried  oufand  the  outputs 
produced.    A  central  task  of  the  analysis  is  to  deter- 
mine what  this  suggests  about,  th^  appropriate  roles  to 
be^played  by  a  lead  agency  with  a  legislative'*  manda,tG 
to^buxld  '^an  effective  KLD  systemV  and  what"  changes  in 
*  agency  behavior  might  be  called  for  over  time  as  the 
system  matures  and  eapabilities  in  the  field  are  better. 
develoDed -  .  -    *  ^ 

c.  '  Vulnerability  of  the  System  to  Environmental  In^ 
,  f  luences  *  ■ 

MIE's  approac!i  to  carrying  out  Its.  s^stom-oriti^tecl 
re5ponsib*iliti&s  must  take  into  account  not  only  thfe 
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state^of  matufity  of  the  educatiional 'r/D£<I  syst^^m  buL^^ 
also  the  political,  value-laden,  social-scleuco-ba^tfd 
nature  of  educatioa.    As  we  have  aoted  in^  other  chapters 
in  this  volume,         education  is  liighiy_  vulnerable  to 
/Social  and  political  influence.     It  tends  to  have  dif- 
fuse goals  that  are  subject  to  value  judgments  and 
controversy.    Tliese  goals  are  difficult  to  specify,  to  , 
measure>  or  to  use  as'standards  against  which  to  evaluate 
school  system  performance*    The  level  of  public  concern  ' 
about. schoji  system  f jiiccionin*;  is  hi^lt  an^  educi^tors 
tend  to  have  more  proble;!is  t^an  other  prof es:sionals  in 
claiming  the^jjid^^f  specialized  expertise  that  might 
legitimate'xheir  actions  and  insulate  them  from  public 
scrutiny.    Therefore,  substantial  clarity  about  NIE's 
missions  and  purposes  ^is  essential,  and  agency  actions 
should  be  oriented  toward  improving  the  environment  in  ■ 
which  educational  R/D&I  functions  as  wej.1  as  .supporting 
the  functioning  and  healthy  deyelopnient  of  the  educa-: 
tional  r/D&I  systetnT 

d>    Multiplicity  of  Purposed 

Central  in  determining  NIE's  proper  modes  of  behavior 
must  be  the  mission-derived  purposes  the  agency  is 
trying  to  achieve.     From  a  systems  perspective,  the 
agency^s  purposes  can  be  grouped  into  three  categories; 
(^)  supporting  the  production  of  s_ubstan_tive  outputs  ^  ^  ■ 
(i.e.,  knowledge,  products services ,  etc);  (b)  system  . 
capacity  building  (i.e.,  strengthening  the  field's 
institutional  and  personnel  base  and  required  linkages_ 
among  institutions,  functions ,  etc) ;  and  (c)  affecting 
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the  svfitem's  envir6nment  (i . e enhancing  its  support> 
presj ige >  legit imcyj  etc.)  . 

Procurements  tend  to  be  thought  of  primarily  in  terms 
of  .these  categories,  l.e:*  the  direct  purchase  of -R/D^iI 
activities  to  generate  knowledge>  produce  programs  or 
productSj  or  provide  services.    Occasionally jiagenffes 
procure  capability-building  activities  dir^e^ly^  as  in 
the  provision  of  institutional  support*  or  the  funding 
of  training  programs  or  fellowships.     But  for  the  raost^ 
part,  procurements  are  designed  and  managed  by  agency 
personnel  as  individual  projects  or  program.*^  designed 
to  produce  specific  outputs. 

\Jhat  tends  to  be  overlooked  is  the*  extent  to  which  Jihese 
manifestly  single-purpose  procurensents  tend  to  h^ive 
multi-purpose  implications.     In  almost  every  procurement 
(or  other*  agen5:y>^havior)  >  more^than  one  of '  these  pur- 
poses will  be  involvedj  whether  implicitly  or  expiicitly, 
ThuSj  the  award  of  a  grant  to  an  R&D  institution  to 
support  a  specific  project  i^y  also  have  an  impact  on 
that  institution's  capaci^  to  perform  in  the  future 
(e.g.  J  by  permitting  it  to  hire  additional  personnel> 
by  prDvid;Lng  more  experience  to  personnel  ^nd  more 
,  opportunity  for  the  sharpening ■ of  skills  and  the 
accumulation  of  relevant  knowledge). 

Consequently,  it  becomes  essential  for  an  agency  to  be 
very  clear  about  its  purposes>  those  entailing  system 
building  and  affectijK  the  system  environment  as  well 
as  the  use  of  sys^j^  capaci ty  to  produce  substantivf^ 
o^jtputs.    And  too*  it  seem?;  important  to  develop  some 
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recognition  of  the  lG?;Ltinacy  o£  lacent  as  well  as 
manifest  purposes  for  procurements  as  well  as  other 
agency  "actions. 

1>    Manifest  and  Lament  Purposes  ^ 

The  legitimacy  of  latent  as  well  as"  ir^anif est  pur- 
poses of  agency  actions  is  a  point  that  merits  some 
elaborati-on.     The  manifest  reason  for  supporting  a 
particular  project  nuiy  havt;  liccle  relevance  to  Lt\e 
real  reason>  which  is  laE:ent>  implicit,  and  infre-  - 
qucntly  made  clear  to  members  of  the  R&D  conimuni'ty 
and/or  relevant  publics.^   A  particular  project  may 
receive  funding  not  so  much  'because  of  ttie  Immediate 
payoff  expected  fro.^  the  project  Itself  but  rather 
because  of  the  support  it  is  providing  far  a  certain 
tyjpe  oT  group  of  graduate  students,  or '|^|^ause  it  is 
expected  that  if  a  certain  particularly  talented 
researcher  is  supported  long  enough  he  is  bound  to 
make  very  substantial  contributions  to  the  field- 
In  such  caseSj  defending  a  project  In  terms  of  its 
manifest  purpose  may  be  difficult,  but  justifying 
it  In  terms  of  long-term  capability-building  needs 
may  b^  much^less  of  a  problem.    Or  to  consider  a  m 
somewhat  different  example,  an ^agency  may  be  sub- 
jected *to    considerable  pressure  to  support  a 
particular  kind  of  program,  and  the' pressure  may  be 
substantial  enough  to  jeopardize  achievement  of 
important  objectives._    In  such  a  case^  an  agency 
_m/iy  have  little  interest  in  the  manifest  purpoj^e 
of  a  project,  but  may  j^uppocc  it  for  the  latent 
purpose  of  relieving  undue  stress  on  the  system. 
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The  essential  pt^inC  here  is  chaC  procure*ment:s  n)ay 
provide  Che^reaCost  long-range  payoff  if  they  are 
designed  with  multi-purposes  in  lulnd,  ^ind  if  agency 
personnel  can  dtisign  them  creativtily  to  *serve 
latent  as  well  as  manifest  purposed.    Wliac  would 
seem  to  be  needed,  then,  are  deliberate  agency 
strritegles '  to- capitalize  ^on  the  multiplicity  ,o£  . 
consequences  from  specif ic^ag^ncy  actions,   to.^  ^ 
ihaximize  possibly  gaiTis  aiid  minimize  pQSsible  costs 
from  potential  multiple  and  interaction  effects 
across  the  latent  and  manifest  purposes  of  given 
procurements . 


±t/   Interaction  Effects 


The  Issue  of  interaction  effects  is  one  of  the  most 
critical  points  overlooked  in  the  development  of 
agency  policies.    Once  an  agency  comes  to  view  its 
behavior  in  terms  of  interactJ,ons  among  seemingly 
discrete  acjtion.^,  an  entirely  different  kind  of^ 
understanding  emergfe^  of  the?  potentially  ^far-reach- 
ing systemic  implications  of  "^indivi^dual "  decisions 
and  policies/  Different    purposes  can  interact 
with  one  anot^her,  with  procurem^^^ntechanisms ,  or 
with  the  "conditions  characterizing  the  state  of 
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development  of  a  "particular  R£f^  system-  ,  For  in- 
stni^cej"  usT-  of  an  RF?  vr>.  ^  j^rants  co^iiperir: inn  vs. 
funding  unsolicited  propoaaLs  can^  have  major  itftpli- 
cations  for  long-term  system  cinpacity-buildin?, 
.    attracting  certain  -researchers  nnd  institutions 
and  turning  off  others.    Or,  to  consider  the 
maturity  of  a  sy.sccn  ac      particular  time,  n 

•    ,  .  ( 

9^-  .  .  .'  r-, 
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strate-gy  tha^t  .ni^y  have  been  ineEfective  a  decade 
ago  might  M'tri'ghiy  successful  in  achieving  c^r-t^in 
purposes  nou  or  ten  year&  Erom  now,  Assuming  cer- 
tain  aspects  oE  system  functioning  have  been 
strengthened  < 

*      *  ^  ■ 

The  poiat  is  perhaps  nade  most  clearly  by  examirting 
potential  interaction  effects  among  purposes,  both  ' 
within  a  Single  i>rocureF^erTt  and  across  all  the^ 
procurements  made  by  an  agency*    A  procurenien^  can 
lead  to  the  development  of  a  5et  of  product-s  that 
a^e  so  well  received  that  they  hav^  the  side^effect 
of  improving  the    system's'^environment.    Or,  the 
products  might  be  j*^ged  to  b.e  so  paor  (or  so  offen-* 
sive  to  particular  seg;,ments  of  th^  envlronment)j  that* 
the  sjfee-effect  is  a  further  deterioration  of  the* 
system's  environment^* .  Or,  to  take  another  example, 
a  seVies  of  procurements  could  either  expand  or 
constrict  certain  types  of  system  capacity,  depend- 
^  ing  on  which  institutions  are  and  are  not  funded  to 
carry  out  what  types  of  work,  (Fdr-  instance,  the 
iini^^r^ities  have  been  complaining  that  the  large 
proportion  of  funding  going  to  the  non-profit  and 
for-profit  corporations  is  destroying  some  of  ^he 
academic  sector's  capacity  to  function  Effectively 
in  carrying  out  educational  K/O^l  activities). 


\^ei\  one  examines  patt^?ns  of  agency  actions  across' 
^ocurements  —  i.e*,  when  one  considers  potential 
Interactions  among  jthe  discrete  procurements  that 
make  up- an  agency's  '^portfolio"  —  inteiractions  of 
0       an  even  less  obvious  nature  become  apparent*  Across 
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programs,  the  outputs  may  i(^Mdioe^  e^o^  other 
Csyiigrg^stic  e£  f  ectsj  .    "Or ,  i^,eyV,^a3t'^5^^iritcrac;t  ^ 
each  ofeTier  in  the  maimer  o fW'haij/inigl|43^e  called   ,  rf' 
"antipurposes*'  —  i.e.,  talcing  a' specific  acT:ion  in 
pursuit  of  one  purpose  may^  make  more  difficult  the 
achi^ement  of  another  pulrpose*.   (The  use  of  RFPs 
to  procure  certaki  kinds  of  research,  for  instance, 
might  well  have  anti-purpose  effects  if  a, by-product 
is  turning  off  the  best  research  talents,  suggesting 
CO  them  thac  research  funding  in  the  field  of  oduca-^ 
tion  is  unlikely  to  he  forthcoming  with  untenable 
constraints).    Such  effects  may  be  immediate  in  / 
their  interaction  or  observable  only  in  lagged  and  ^ 
in  secQnd-  or  third-order  manifestations*    If  an 
agency  decides  to  design  procurements  that  «re 

r 

deliberately  mul ci-purpose  in  nature>  it  becomes 
essential  for_  agency  personnel  to  have  a  clear 
understanding  of  the  "kinds  of  procurement  **arfd-ons*' 
that  tend  to  tfe  congruent  vs.  .incongr^ient ,  functional 
vs.  dysfunctional**  . 

Portforio  effects  may  be  discernible  within  insti- 
tutions as  well  as  across  inistltutions.    It  is  , 

common  to  observe  how  -RiiD  institutions  become  shaped 

* 

by  the  patterns  of  funding  that  become  available  to 
them.    If  a  single  agency  provides^  a , particul^^y 
large  share  of  an  organization's  total  funding, 
agency  actions  can  have' the  effect  of  molJ^yi^ng  or 
changing  the  very  cha^cter  of  such  organizations 
Cas,  for  instance,  th^Pl^nner       vhi^h  OE  reoriented 
the  labs  into  development  organizations  through 
f uncling  mtiSsages  sent  out  around  1968)*      /  ' 


^     ^   la  siifTLnary;  then>  interaction  effects  need  to  be 
t         cbnsidered  .la  terms  of  th^ir  synergis tic , effects , 
their ^ongru^ncy  or  ^ncongruency  with'eacb  other, 
their  lagged  (and_.dLidirec  t  second- ^and  third- 
order)  ^ffects^,  and  the  cuniilative  C^portfolio^^^^ 
effects  wi'thin  and  across  institutions  and  per^son-\ 
nel-^ 

_  *.    ;  \  •  .  '  . 

^  the  essentia^  poir\t  is  that  multi-purpose  effects 
are  inevitable.    The  i^sue  is  not  vfteci^er  <here  ' 
V        should       miilti-piirposes  but' rather  whether  they 

"^are  to  be  recognized  or  ignored,  apd  if  recognized, 
whethe/  they  are  to-be  capitalised  upon  and  treated 
itv  a^tuanner  that  miniriizes  the  po$|jj||^ility  of^^^ntl- 
purpose  "effects.  '     ■       .  ^ 

■■      :  .  :       '  . .  { 

e.    Agency  Conception  of  Broad  O'r  Natrow  Mission 

The^key  -question  a  lead  agency  such' as  ^^IE  has  to  add- 
ress is  whether,  its  mission  i^  to  be  coastrued  narrowly 
or  broa4lyv  for  this  mission  {jerspective  will  determine 
hpw  the  Institute  allocates  ^the  limited  ^funds.  und^r  its 
control.     If  it  conceives  its  mission  narrocAy>  it  will 
operate  like  all  other  funding  £igerfcies^  making  in<;3ivi- 
dual  funding  decision^*  on  an  individual*  ad_  hoc'-b^sis  ^ 
considering  oaly  the  merits  of  a  particular  proposal 
and  only  the  requiremerits"  for  producing\i  particular^ 
output.    If  > 'however,  the  lead  agency  mission  is  con- 
ce^vedvmore  broadly,  then  the  agency  accepts  the 
responMbility  to  use  its  funds  to  fa^llitjate  the  devel- 
opment^'and  strengthenTng  of  the  educational  R/D&I 
system,  including  system  capacity-building,  system 
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malut^arHlt'  and  system  monitoring.     It  means,  too>  that, 
the  a^^cy  is  accepting  the  responsibility  to  play  an 
active  role  in  shaping  the  system. 


A  mature  R&D  system  orches trate^itself .  Relationships 
are  well  developed;  Participants  know  what  to  seel*  and 
to  deliver,  from  and  to  where,  and  what  to  expec^t  and 


trust.    An  immature  syscetn 


^   learn  how  to  acjhieve  sucTi 
educat^ion  is  to  be  served 


involve;  fa)  system  bujlld 
tion;  and  (b)  system^ orche 


n^^eds  help  to  grow,  and  to 


\  self-organizing  state.  If 
Dy  a  quality  R6fD  system,  two 
major  requirements  will  nesd  to  be  satisfied.  These 

ing,  maintenance,  and  protec- 
stration* 


If  NTE  is  CO  carry  out  these  roles,  it  needs  to  base  ^ts 
decisions  on  an  un^rstanding  of  the  system's  capacities, 
as  they  are  now,'  as  they  might  become,  and  as  they  very 
'^across  different  functions  and  sectors  that  make'  up  the 
eiducationaj  l\/D&I  system/  ' 


\ 


f.    Parameters  and  Guidelines  for  Budgetary  Planning' 

The  bulk  of  the  -CISST  analysis  focuses  on  Selected 
educational  Il/D6(I  functions  (research  development,  dis- 
-#  semination,  and  evaluation);  the  generic  requi remen^ts 
for  quality  work  in  eacfi  o£  these  functitpnal  ar^as  re- 
gardlQSsJ  or  the  particular  context  or  field  in  which 
the  work  is  carried  out;  the  extent  co  which  these  con- 
dition^  do  or  do  not  characterize  these  functions  as 
tHey^r^  carried  out  in  educational  R/D&I;  and  the 
implications  o£  ^this  for  the  roles  NIE  might  play  an^'^ 
the  manner  In  which  NIE  might  relate  to  the  field  so 
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as  to  carry  out  its -congressionally  mandated  .mission 
to  build  an  effective  K&D  system. 

That  analysis  is  far  too  lengthy  for'  us  to  try  to 
^summarize  here.    Hawev^r>  some  useful  parameters  an4 
guidelines  for  budgetary  planning  are  suggested  by  the 
analysis-    The  key  question    to  be  answered  is;  given 
the  immaturity  of,  the  educational 'K/oitl  system  and  the 
consequent  need  for  systen_^building>  how  can  NIE  best 
allocate  it^  financial  resources?    Among  the  factors 
that  need  to  be  considered  to  answer  this  question  are 
the  follow^g:  ■    '  •  * 

First >  there  are  inherent  differences  in  funding  require 
meats  for  different  functions.  'For  exapple  >  both 
institution  building  and  project  costs  in  basiQ  research 
tend  to  be  significantly  lower  than  those  required  for 
applied  research>  and  both  kinds  of  research  tend  to 
require  far  smaller  outlays  than  would  be  called  for  by^ 
development  activities.    Consequently >  the  effect  of 
increasing, the  allocaticn  foi^  a -particular  function  by 
2£  dollars  will  vary  from  function  to  function-  \i/hile 
that  sum  ipight  have  a  major^  effect  in  strengthening 
^the  functioning  of  basic  research>  it  might  have  only 
a  marginal  or  near-zero  effect  if  added  to  the  funding 
of  dev-elopment  activities.    Slmilarly>  the  somewhat 
larger  SUP.  of  ^  dollars  might  be  greater  than  could  be 
productively  absorbed  immediately  by\  the  basic  research 
coTTiiTiunity  in  education-»levant  are^is>  but  might  have  e 
decided  and  almost  immediate  effect  on* strengthening 
dissemination  activities* 
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Second>  the  time  recfuired  to  build  a  sy^iiem  will  vary 
across  fupctionsi     For  examplej  the  time  required^  to  ' 
train  cruality  basic  researchers  is  substantially  greater 
than  the  time  required  to  ttain  fievelopment  specialists* 
ihe  skills  required  to  carry  out  quality  work  in  basic 
research  take  longer  to *bulld  and  the  disruption  caused 
by  fuciding  setbacks  tends  to  have  much  longer  consequen- 
ces.   In  short>  the  two  functions  vary  greatly  in  the 
tine  horizon  needs  o:  funding  and  rh5  impact^of  funding 
changes . 


Thirdj  the  system  building  process  should  be  carried 
out  with  a  view  toward  balance  in  the  total  '^^tem  among 


func  tionss  personnel  >  institutions  >  syppljr  and '  demand 


Kourthj  NIE  is  neither  the  only  nor  the  largest  source 
of  funding  for  educational  R/D&I.    Thus>  on  the  one  hand> 
NIE  could  attempt  to  increase  Its  leverage  through  co- 
ordination^ and*  orchestration  with  ot|ier  agencies  to 
achieve  inaltiplier  and  synergistic  effects,    0^  the 
other  hand >  NIE  budget  allocations  might  focus  on  gap 
filling  ijn  areas  not  funded  by  other  agencies.  Thus> 
it  is  possible  for  the'NIE  budget  to  reflect  cross- 
agency  oppo rtunlties ^as  well  as. NIE,  priori  ties  and 
Uvels  of  effort. 

[Flfthj  cons^ideration  must  be  given  to  the  minimal^ 
(floor)  level  of  funding  needed  to  maintain  quality 
and  stability  withjn  a  function>  and  to  maximum  (ceiling) 
level  of  funding  that  can  be  absortte^L-l^roductivcly  by  a 
I  function  given  its  current  state  of  development.  For 
.  instance>  research  system  building  rates  arfd  the  ability 
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CO  , spend  funds  producciueTy  are  limited  by  the  number 
and  sca^le  of  the  .existing  centers  o£  excellence.  To 
consider  another  example>  funding  for'^^syscetn  building 
must  be  concentrated  rather  than  scattered  around. 

Sixth,  chere  must  be  funding  stability  over  tinit;. 
Sylstem  building  is  a  su&taiped  rather  than  an  *'in  and 
out"  kind  of  process.     A  three  to  five  year  period 
would  be  minimal  fcHr  any  kind  of  system  building 
ini>==icr>  :ind  would' ht-  corrpl^toly  inadecu^ro  for  the 
research  function  whece  the  required  time  horizon  is 
much  longer*    For  total  system  building>  an  even  longer 
tirae'frar.e  is  required,  ^ 

Finally>  from  the  political  point  of  view  it  cia^  be 
vital  to  attempt  to  educate  the  relevant  communities  as 
to  the  irn^ature  state  of  development  of  the  educational 
R/D^I  system  and  to  the  fact  thJ^t  the  next  few  years 
need  to  be  seen  as  a  period  of  long  term  capital  invest- 
ment if  '«'e  are  not  to  be  burdened  in-  the  future*  with  the 
errors  of  the  past  as  we  see  them  tod^* 

Appropriate  ProcureT^ent  Strategies 

Systeni  building  must  be  understood  as  different  from 
procurement  of  a  product>  requiring  somewhat  different 
approaches  to  solicitation*    For  the  procurement  of  a 
productj  open  cojipetitlve  bidding  In  response  co  an  RFT 
may  be  a  valid  solicitation  strategy.    However ^  system 
building  is  likely  to  require  a  more  active  stance  by' 
the  agency  and  a  tighter  degree  of  selectivity  and  con- 
t;rol  by  the  agency  than  would  f>c  possible  under  standard 
RFP  and  com'petitive  bidding  procedures.    Thus>  there  is 
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a  diteirma  in  that  the  sold  sourcG  ap|'>roach  is  mest  appro- 
priate  for  system  building  purposes,  but  there  are  s^vete 
legal  and  political  constraints  on  its  use-     It  may  be 
necessary  to  educate  Congress  and  other  relevant  groups 
as  to  the  long-term  requirements  for  system  building  and 
the^dlfferences  between  the  requirements  for  system 
building)  on  the  on^^"  Wand^  £ind  the  procuring  of  products 
and  serviced,  on  the  other, 

t\s  advocated  by  the  Campbell  pane'l,  it  would  sGem  essc^n^ 
tial  for  NIE  to  have  a  clear  sense  of  who  can  best  do 
tflE's  work,  to  procure  from  these  lnstitutit>ns  without  . 
incurring  the  wasteful  costs  of  mass  open  competitions* 
and  to  develop  a  "close  working  relationship  with  the. 
strong  talent  in  the  field  b<x  as  to  develop  and  imorove 
theli^  proposals  and  their  work  In  progress*    Such  pat- 
terz:s  of  functioning  are  not  encouraged  by  current  ^ 
perspectives  in  foderiTl  funding.    In  fact,  such  approaches 
are  viewed  as  unethical,*  loavlng  the  offending  agency 
staff  member  open  to  censure  (or  worse).    Clearly,  the 
approach  recortmended  here  requires"  a  radical  restructur- 
ing of  the  mores  that  surround  *fedaral  procurement  of 
educational  R/D£fT  activities, 

h>    Agency-Field  Relationships  In  Procurement  and  i^on- 
Procurement  Activities 

> 

V 

One'  of  the  starting  points  of  the  Agency-^ield  analysis 
was  a  rejection  of  the  agency  vs.  field  dichotomy*  The 
perspective  that  sees  the  agency  as  one  group  and  the 
field  as  ano'ther  seems  to  us  to  be  fundamentally  in 
error.     If  STE  is  to  work^ef foctively  to  facilitate 
the  building  of  system  capacity  and  to  improve  the 
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system's  environment,  the  agency  must  vic;w  itself  (and 
be  viewed)*  as  an  integral  part  oE  the  field, 

* 

For  that  perspective  to  develop  agency  personnel  must 
have  close  working  relationships  with  the  field  and 
function  in  a  basically  collaborative  mo^ie  . —  in 
agenda  building  and  refining;  in  program  developnient j 
in  planning  specific  procuremcfnts  and  in  selecting 
tb:>se  who  will  be  awarded  the  grants  and  *con t rac  ts  to 
carry  out  the  work;  In.-pronot ing  collaboration,  consul- 
tation, and  information  flow  among  groups  in  the^field; 
in  reviewing  and  strengthening  work  that  is, proposed 
and  work  in  progress;  etcr. 

What  this  means  for  the  exercise  of  the  lead  agency 
role  is  that  a  considerable  amount  of  staff  energy  and 
a  portioiS  of  nIE's  resources  nust  be  allocated  to  non- 
procutcment  activities  —  holding  conferencas;  attending 
meetings  of  professional  associations  and  pQssibly  mak- 
ing p^reseptations ,  holding  symposia,  leading  discussion 
groups,  and  meeting  Informally  with  researcTflers  from- 
the  field;  meeting  with  diverse  researchers,  R&D  person-- 
nel,  practitioners,  and  various  interest  groups  across 
the^country;  drafting  (or  commissioning  the  drafting 
of)  issues  paper  for  distribution  to  members  of  these 
various  networks  for  their^  reactions  and  conlments; 
working  with  other  federal  agencios  and  other  non-redcrail 
sponsors  of  educational  r/d&I  activities  as  well  provid- 
ing a  degree  of  coordination  aad  orchestration  to  the 
whole  educational  R/D&I  enterprise;  etc.    This  would 
seem  to  be  necessary  both  because  HIE  is  the  lead  agency 
for  educational  R&D  and  because  more  funding  of 


educational  ^t/M^  is  provided  outside  NIE  than  by  NIE< 
This  ijtay  mean  that  a  significarrt  portion  of  NIE's  efforts, 
may  need  to  fcre  appj/i^  toward  a  specific. critical  aj^a 
'even  though  relatively  little  of  NIE^s  budget  is  applied 
to  this  sane- area*     Stated  another  way>  NIE's  focus  of 
concern  would  shift  to  needs  and  not  be  restricted  to 
the  implications  of  its  budget  per  se.        \S  ^  ^ 

\;iearly>  if  the  agency  is  to  act  effectively  in  a 
coLIaborativs  relationship  with  the  field>  the  character 
aad  quality  of,  N'lE' s 'own  staffing  will  have  a  critical 
Impact  on  the  direci&ion  and  effectiveness  of  the  Institute. 
For  example,  the  SIE'rola  ol  orchestp^tion  require3  per- 
sonnel  who  have  skills  in  orchestration  and  In 
facilitating  collaboration  between  pf^ople  and/or  between  - 
institutions  and.  agencies  *     In  ^ddition>  NIE  Will  need  - 
some  personnel  who  have  'Apolitical  savvy/'    And  >  if  the 
research  function  is  to  be' built  collaboratively  with 
the  field,  ,and  if  KIE  staff  are  to  be  able  to  orchestrate 
the  diverse  elements  in  the  research  comnMnity> 't?IE  will 
require  an  internal  research  capability  with  a  staff  of 
talented  researchers  who  can  win  the'  respedt  and  esteem 
of  the  research  coViiiuni ty ^    If  this  approach  to  agency 
functioning  is       be  puJ^  into  effect,  staff  members  will  ' 
have  to  see  themselves  in  a  much  njore  active  stance  in 
relation  to  the  field >  and  be  comfortable  with  engaging 
the  field  in  an  on-s^oin^  basis  on  virtually  all  matters 
of  the  work  they  carry  out*    This>  too>  requir^^q  some- 
thing of  a  restructuring  (as  well>  no  doubt>  of  at  least 
a  partial  restaffing)  of  the  agenc^. 
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i.    Appropriate  Funding  Formulas  and  ^' Rules -oF  Thumb' * 

In  .requesting  that  work  be  carried  out  on  the  FIS  is»L!e> 
it  appears  clear  that  the  KC£R  was  hoping  *to  arrive  at 
(among  other  things  perhaps)  a  formula  for  determining 
what  percentage  of  NI£  funds  to  set  aside  for  the  fund- 
ing of  f ield^initiated  work.    "Howeverj  o\jr  argument  has 
been  basically  that  no  simple  formulas  are  approptiate> 
and  th?_t  the  issue  is  far  more  complex  than  had  previous- 
ly been  supposed, 

Rules  of  thumb  have  been  in  wide  use  among  funding 

agencies."  For  lnstance>  one  rule  of  thumb  we  have 

heard  has  been  "only  offer  a  grants  competition  when  a 

to'tal  of  one  million  dollars  csn  be  provided  and  when 

you  can  fund  25%  of  the  proposal  submitted-'*    There  is 

r 

an  inherent  logic  in  i;uch  a  rule  of  thumb  —  i.e.>  it 
is  correct  that  the  expectations  of  the  field  should  not 
be  raised  beyond  reasonable  levels  of  potential  for  ful- 
f  illment 

i 

However,  rules  of  thumb  tend  too  often  to  fall  into  the 
trap  of  ignoring  critical  system  or  function  dynamics > 
condicionsj  needs  and  requirements*  -In  the  above  case > 
the  danger  would  be  chat  such  a  grants  competition  would 
be  used  in  an  area  so  lacking  in'  excellence  that  the 
funding  of  25?<  of  proposals  at  the  one  rAllion  ^dollar 
total  level  would  tend  to  crap  the  agency  ioto  providing 
much  of  the  funding  to  low  quality>  low-success-probabl- 
lity  projects* 

The  cruxJ>f^he  argument  has  been  that  this  supposedly 
simple  question" is  in  fact  embedded  within  other  system 
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Issues  of  a  f uaclamental  nature  and  NIE's  response  to 
the  issue  is  bound  to  have  system-wide  impact.  Ratber 
than  providing  a  simple  formula  for  determining  what 
percentage  of  funds  should  be  set  aside  by  NIE  to  fund 
field-initiated  work>.the  CISST  analysis  called  for  a 
radical  restructuring  of  the  agenay/s  relationships' with 
the  field  and  move  complex  (rather  than  more  simplified) 
approach^  to  planning  budget  allocations.    The  conse-  * 
quences  of  this  approach  to  answering  ttie  requested 
question  would  soon  become  apparent. 

.    ■  } 

E>    NIE  Response:     Initial  £nthusiasm>  Then  Shelving  of  the 
Analysis 

\>i'hen  the  Agency-Field  analysis  was  submitted  to  NIE,   it  was 
"greeted  initially  with  what  appeared  to  be  a  highly  enthusi- 
astic response,  fron  the  R^D  System  Support  Division,  the 
^JTE  Planning  Unit,  and  the  NIE  Director's  Office-    The  report 
was  widely  disseminated  across  the  ^nstitute.     It  was  even 
vSuggested  that  a  series  of  conferences  were  being  planned  to 
pe^it  us  to  meet  w'ith  individual  staff  unlts^vithin  KIE*s 
organizational  structure  and  to  discuss  the  implcations  of 
the  analysis  for  the  planning  of  their  procurements  and  the 
conduct  of  their  other  non-procureraent  activities. 

However,  after  continued  <?elays  while  the  staff  was  over- 
yhelnerf  by  other>  pressing  matter^^  the  whole  project 
shelved  and  the  report  was  buried.    We  hdd  met  briefly  with 
the  Director,  and  held  a  lengthier  full-day  session  with 
soipe  staff  from  the  R£(D  System  Support  Division;    Also,  a 
Contract  continuation  was  negotiated  to  include  our  develop- 
ment of  a  budget  planning  guide  that  would  translate  our 
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reccTunandations  into  easily  understandable  procedures  that 
could  be  u'S^d  especially  by  NiE's  planning  unit.    But  ev'en 
this  contractural  item  was  later  modi£ied  to  permit  us  to 
substitute  another  piece  of  work  for  the  budget  planning 
docuinent. 

# 

The  reason  in  large  part  was  that  within  a  few  short  months 
there  was  no  longer  a  client  interested  in  the  development 
and  use  of  such  a  document,    The'key  planning  staff  Ti^ernbers 
'  who  had  been  interested  in  th'e  development  of  this  document 
left  to  work,  elsewhere,  and  the  new  and  remaining  staff  had 
other  interests*.    Other  top-level  NIE  management  changes  were* 
also  in  the  making.    And  the  one,  unchanging  constant  in  the 
picture,  the  R£iD  System  Support  Division,^  remained  as  isola* 
ted  as  ever  from  the  rest  pf  the  Institute.     It  therefore 
was  not  in  a  position  to  exercise  the  kind  of  leadership  role 
required  to  reorient  an  agency's  thinking  and  behavior  in  the 
manner  recornmended  in  the  Asencv-Field  analysis. 

Our  conversations  with  staff  members  from  other  units  of  NIE 
suggested  that  most  had  never  heard  of  the  report  or  its 
recommendations,  much  less  read  it.    Clearly,  the  report  was 
wordy  and  ponderous,  and  a  more  concise,  more  forcefully  pre- 
sented analysis  might  have  been  more  effective-    But  the 
Campbell  Report  a  year  earlier  had  been  concise  and  well 
written  and,  though  more  widely  read  and  .discussed,  had  a 
siinilar  fate.    V71|;it  does  all  ^this  suggest  about  the  conce:tt 
of  educational  r/D*&T  policymaking  at  NIE? 
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F.    A5;gncv-Field  Relationships  and  the  Concgxt  of 'Educational 
R/D&I  Policypaking 

*  < 
f  ^ 

As  in  the_case  of  the  Campbell  Report,  the  fate  oE  the  Agenpy- 
Field  Relationships  analysis  suggests;     (a)  the  same  "stop-  * 
and-start-anew"  eEfect  on  policy  development  o£  staff  and 
maaagement  changes;  and  (b)  thfe  Sfime  tendency  to  commission 
analyses  and  reports  and  thei*  ignore  the  recommendations  and 
bury  the  reports^^  especially  when  the  recommendations  are 
not  coag^^uent  wich^rcvious'ly-held  orientations  tow^^^rd  the 
policy  decisions  to  be  made^  ^  / 

But  perhaps  even  more  critical,  the  report  may  have  been 
Ignored  because  it  was  na't  adequately  responsive  to  che 
concerns  that  led  to  it^^'being  commissioned,    fije- NCER  wanted 
a  simple  pat  fon^ul^  to  determine  what  percental  of  NlE's 
budget^should  b^  set  aside^  for  f ield-initi^ed  fundamental 
research.     Instead,  this  aVialysis  said^that  the  problem  was 
much  more  complex  tb^n  that-^  and  would  require  more  f  hinking 
and  analysis,  and  that  even  that  additional  thinking  and 
analysis  was  not  likely  to  produce  a  pat  formula  since  we 
did  not  currently  have  good  data  on  the  elements  that  vrould  . 
comprise  the  more  complex  approach  to  answering  the  question 
(e.g*,  the  level  of  funding  the  fgadamental  research  community 
could  productively  use  now  and  the  rate  at  which  this  level 
could'be  expanded  while  still  maintaining  excellence  in  the 
(Quality  of  Che  re^search  output).    Th€*  lesson  to  be  lGarned>  jt 
then,  would  seem  to  be:^    give  the  policymaker  a  **handle"-^r 
meeting  his  need,  how,  even  if  you  must  tell  him  that  hi^ 
problem  is  more  <;oafiplex  than  he  had  .previously  thought*!  and 
evQn  if  that  "handl^e'*       no  more  precise  than  a  rough  *'gues- 
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^erhaf>s  phe  strongest  evidence  in  sup^ilbrt  of  this  bit  of 
conjecture  is  to^be  found  in  the  hiertory  of  the  last  funding 
parley  issue       consider  in  this  chapter,  the  issue  of  allo- 
cating funds  to  the  support  of  f ^eld-ihitiated  fundamental 
research -relevant  .to  education,    Ue  turn  to  this  issue  now, 

Strenathenina  Fundamental  Resea-rch  .   ^  , 

A*    The  'Issues 


Uhat  policies  are  most  appropriate  for  strengthenihg- 
the  conduct  of  Eundainental  research  relevant  to. 
education?         '  - 


-  Should  a'percentage  of  NIE's  budget  be  set  aside  for 
suppor^t^oE  fundamental  re      rch,  and,  if  so,  what 
percentage?        ^       -  ' 

"  What  degrees  of  emphasis  should  be  given  to  tield- 
initiated  (as  opposed  to  *MIE"4irected)  work  and  to 
work  carried  out  by  individual  researchers  and  small 
<groups  of  investigators  (^s  opposed  to  l&rger  research 
teams)?      *    ,^  ^. 


4-  What  *roles^should  be  played  by  the  research  c^jjpnunity 

■    in  the  planning  and  conduct  of  NIE's  research  program? 
** 

-  l^^hat  other  rolee  should  l?e  played  bv  NIE,  and  wtiat 
other  actions  can  NIE  take  to  strengthen  fundamental 
refie^irch  relevant  to  Education?  *    -  ' 
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B,      Historical  Backgraund  ^ 

'  la  Juae>.  1976>  shortly  before  the  CISST  FIS  analysis  was  re- 
quested^  NIE  at^d  the  NCER  commissioned  the  National  Academy 
of  Sciences  to  prepare  an  analysis  and  series  of  recommenda- 
tions  on  the  fiihdiiig  of  fun3anental  research  relevant^  to 
education.    As  discussed  above>  the  bas^c  research  community 
had  been  increasingly  critical  of  both  the  level  of  basic 
research  funding  provided  by  MIE  and  the  extent  to  which  NIE 

^  was  prepared  to  fund  field-iniciated^work.    The^  request  was  , 
tnade-to  the  NAS  in  an  effort  to  l^e  respoa&ive  to  "these 
concerns, 

The  National  Academy  of  Sclences>  in  cooperation  with  the* 
National  Academy  of'Edu^tion>  established  a  Committee  on 
Fundamental  Research  Relevant  to  Education^  headed  by  Sheldon 
IJhite  oE  Harvard  University.  ^ 

The  Commitcee  had  been  asked  to  address  three  matters  relevant 
to  NIE*s  congressionally  mandated  mission'to  improve  education 
by -^lengthening  its  scientific  foundations.    They  were  asked 
to:     (a)  Identify  promising  lines  of  fundamental  research  that 
were  contributing  to  the  improvement  of  education  and  in  par- 
clculaT  to  note  tliose  lines  of  research  that  ap'peared 
"psi^ticularly  pro'mising  and  deserving  of  higher  |>riority  than 
they  are  now  given*^;^^^    (b)  assess  the  adequacy  \oSf  federal 
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support  for  f und^^Tr^ental  rcs93rch  relevant  to  education;  and 
(c)  recommend  changes  in  policjr>^if  any>  that  should  be  con- 
sldtsVed , 

• '  ■  \- 

The  ^following  yfe^r,  ^the  Commipcoe  submitted  its  report>  Funda- 
mental Resea rch  and  the  Process  .of  Educacion ^^^^ 
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Tb^NAS  Report  ^ 

Tne  ^^A^^report  is  a  highly  useful  brief  on  behalf  of  the 
value  and  importance  of  f und'air-ental  rese«»ch, 

a.    The  Relevance  of  Fundamental  Research 

Tne  report  defines  fundamental  research  as  "undisciplined 

Inquiry  whose  purpose  is  to  understand  yty  and  how 

education^  takes  place,"    Disciplines  Identified, as 

relevant  to  education  include  the  behavioral  and   "  • 

social  sciences  (e.g,  /  psychology,  sociology,  anthropo- 

logy?  political  science,  and  ^economics)  and  some  of  the 

121 

humanities  (e.g.,  philosophy  |nd  history)^ 

J* 

Though  not  requested  to  do  so,  the  Committee  allocated 
a  sizeable  portion  of  their  effort  and  of  the  report  to 
arguing  the  "relevance''  of  fundamental  research  to"  the 
improvement  of  education  and*  to  showing  by  way  of  e>:amT- 
pie  just  how  fundamental  research  has  -  contributed  and 
can  contribute  to  education.    The'  Committee  was  respond- 
ing here  to  the  skepticism  expressed  in  official 
Washington  at  tlvat  time  as  to  the  value  of  the  federal' 
governi^ent  ^s  continued  support  for  fundamental  research>  . 
especially  in  the  field  of  education.    As  they  e>:prcssed 
it  ^fthems^lves  in  the  report  >  "Our  reading  of  government 
docuFients  and  Teports  on  cdu3fetion>  the  testimony  of 
government  of f icials  ibef ore  Congress,  and  our  discus- 
sions with  congressional  staff  and  program  officials 

*  ^  122 

greatly  increased  our  concern  with  these  questions/* 

Consequently,  they  reformulated  the  first  question  asked 

of  them  Ci.e.>  identifying  promi^sing  line^  of.  inqii^y 


527 


■in  need  of  priority  attention)  into  a  somewhat  different 

,  '  i 

set  of  questions:    How  does  edtfcatlon  Improve?    How  does 
.fundamental  research  contribute  to  th6  improvement  pro- 
cess^    l^at  makes  it  highly  '^relevant"?    The  lattery 
question  was>  no 'doubt,  a  response  to  the  oft-heard 
criticism  that  fundamental  research  Is  rarely  'Relevant'* 
^to  the  pressing  problems  faced  by  educators. 

The  Committee's  anawer  to  these  questions  took^the  ^ 
following  form.: 


what  makes  fundamental  research  relevant  is  the 
improved  knowledge  it  generates  >  which  in  turn  is 
a  condition  for  tnore  useful  views  of  how  education 
takes  placey  n^w  visions  of  what  is  educationally  ' 
possible,  stronger  commitments  by  those  wHo  educate, 
'and  Improvements  in  instruction  and  educational 
Institutions'.*-* 

t 

fundamental  rese^rcH  has  had  its  major  and  most  \ 
useful  impact  on  education  through  the^gradual, 
public  diffusion  of  new  ideas  and  con^^epts  that 
have  -been  assimilated  into  the  expec^tations,  prac- 
tices, and  resources  of  education.    These  have 
^influenced  practitioners'  views  of  reality'^  their 
vision  of  the  achievable,  'theijir' knowhoWj  and  their 
commitment  to  act**,, 

■ 


This  "diffusion  of  ideas"  notion  was  tied  to  the  rerSa^ 
der  of  the  Committee's  ai^gument>  the  need  for  quality 
^brk  ancl  the  requirements  for  such  quality  work  —  i*e*j 
higher  levels  o£  funding,  adtninist'eired  in  a  way  that 
allows  greater  autonomy  for  the  field: 
*  ^ 

♦   We  believe  that  fundamental  J^search  relevant  to 

s^elopmen 


lopment  of  ideas  for 
t  ton  occurs  ajiross 


education  is  basically  a  de 
eijplaining  how  a^nd  why  educa 

places,  time;  and  groups  of  people.     The  quality 
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of  this  development  is  reflected  in  the  validity  of 
the  new  concepts  and  understanding  that  gradually 
rfiffii'se  to  educators 'and  the  public>  where  it  stands 
its  ultimate  t^st:  the  degree  to  which  educators> 
^studentSj  and  citizens  find  the  new  ideas  more  use- 
ful >  more  sensible >  than  the  old  ways  of  thinking. 
In  turn>  the  quality  of  fundamental  research 
depends^  heavily  on  the  standards  of  those  engaged 
in  it  att<i  on  their  resources  £or  systematic  obser-, 
vation  aaoXar^ful  analyst^  building  upon  the  work 
of  otherSj  respond3(ng  to  emerging  possibilities* 
and -examining  the  many  realms  in  which  basic  educa" 
tic^TT^l  processes  occur.    These  "reso-jrces  depend  on 
two  factors  insufficiently  represented  in  the 
practice  o£  federal  policy  today  —  commitments  to 
financial  support  and  flexible  management  that 
encour^QS  self-directed  fundamental  inquiry*^25 


The  Committee  then  devoted  a  full  chapter  to  illustrat- 
ing the  contributions  to  education  made 'by  eight  selected 
areas  of  fundamental  research.     Ip  a  detailed  appendi:^', 

"the  same  poirtt  was  made  by  means  of  a  study  of  citation 
patt&rns  among  basic  research  journals,  educational 
research  journals,  and  education  magazines  written  for 
practitioner^    The  data  showed  that  basic  research 
literature  from  the  behavioral  and  social  sciences  "has 

^conside-rable  impact  on  the  writings  of  educational 
researchers  and  prac  tl tioners  .''^^^ 

b.    Assessment  of  Federal  Support  of  Fundamental 
Research  Relevant  to  Education 

The  most  important  single  section  of  the  Committee's 
"report  is  tlj^ir  critique  of  federal  policy  (especially 

HIE  policy)  on  the  support  of  fundamental  research 

relfivant  to  education.    Though  they  acknowledged  that 
'the  kind  of  data  needed  for  their  analysis  were  (at  the 

time  the  report  was  prepared)  "sometimes  unreliable  or 
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unavailable"*        they  proceeded  to  base  their  analysis 
on  the  data  available  to  -them  at  the  time. 

Thie  key  points  they  make  in  their  critique  are  the 
following: 

i*    Total  Educational  RSD  Support  level  ^ 

Across  agencies  and  programs,  federal  support  for  ^ 
educational  RSD  is  sizeabl'e:  ^  "The  total 'support 
for  education  R5(D  is  <iuite  large  —  33  percent  of 
All  social  RSD>  and  3-6  percent  of  all  federal 

129 

services  to  education  —  or  just  over  $.5  billion." 

H.    Research  Support  as  a  Percentage  of  the  Total 
R^D  Budget 

Federal  agencies  that  sponsor  RSD  relevant  to  educa- 
tion differ  in  the  percentfige  of  their  R&D  budgets 
they  allocate  to  research*  'In  sonie>  such  as  the 
Department  of  Defense  or  the  Department  of  CotHmerce> 
as  much  as  one-thicd  of  the;^r  RSD  budgets  go  to* 
research*    Their  estimates  for  0£  and  NIE,  however, 
are  that  less  than  10%  of  the  funds  gp  to  research 
while  more  than  50%  goes  to  demonstrations  and 
around  25^  to  dissemination* 

iii.     Basic  Research  Support  as  a  Percentage  of  Total 
Research  Support  - 


Wlien  the  data  are^^nsidered  together  for  all  fed- 
eral agencies  thnt  sponsor  RfiiD  relevant  to'education> 
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approximately  one-^hird  of  the  total  of  research 
support  goes  to  basic  research*    The  percGntaggj^s 
even  smaller  (22-29%)  when  atte^'ion  is  restrlctet! 
to  the  agencies  directly  concerned  with  research 
in  education,  and  smallest  still  (15-20%)  when  one 
.examines  the  data  for  OE  and  N'lE'alone^ 

iv,    Basic  Research  Support  as  a  Perc!entafie  of  Total 
E<jucatiQn  Rfp  Budget  \ 

The  data  for  ^11  Ijeder'al 'agencies  engaged  in  social 
research  show  that  11-12%  of  total'  fcderali^R&D  fund-- 
ing  is  allocated  to  basic  resear^*    However,  when 
the  data  are  examined  for  only  those  agencies  con- 
cerned with  education^  only  3-4%  of  R&D  funding  is 
allocated  to  basic  research*    ^Jhen  attention  is 
restricted       OE  and  N*IE  alone,  that  figure  is 
further  reduced  to  2%-    The  conclusion  of  the 
Coinmittee  is  Xhat  fundaniental  research  relevant  to  ; 
education  is  a  low  priority  item  in  federal  agen^- 
cies  who  are  responsible  for  supporting  or  improving 
education^  and  lowest  of  all  in  OE  and  NIE* 


V.    FundaT?.ental  Research  Support  Under  NI£  Compared 
to  Fundamental  Research  Support  Prior  to  1972 

/.'orst  of  all,  from  the  perspective  of  the  research 
community,  research  was  receiving  less  support  fron 
NIE,  both  in  absolute  and  relative  terms,  than  it 
was  receiving  prior  to  the  establishment  of  NIE 
which  was  explicitly  mandated  to  strengthen  the 
scientific  *^nd  technolpgic^il  foundations  of 
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education.    In  1968,  research  was  receiving  approxi- 
mately one^third  of  total  federal  R^l  fundings 
basic  rfesearc^h  represented  approximately  13%  of  the 
research  budget  across  federal  agencies,  and  OE 
allocated  approxima|:ely  7%  of  its  R&D  budget  to 
basic  research.     In  1975,  research  was  still  re-  ^ 
ceiving  toore  than  on^^-third  of  R£(D  funding  across 
federal  agencies>^but  ,in  OE  and  MIE  together^ 
research  was  receiving  around         of  R&D  funds  and 
basic  research  uas  rece'iving  2%  or  less.    Not  only* 
the  percentages  but  even  the  dollar  amounts  avail- 
able for  basic  research  in  education  declined 
between  1968  and/  1975,    5i?hile  federal  support  for 
educational  R&D  activities  in  general  has  increased 
in  recent  years,  fundamental  research  support  has 
not  shared  in  this  growth  and  Has  even  suffered  a 
decline  in  available  dollars, 

vi.    I'neven  Quality  of  Work  Supported 


Sone  of  the  R&D  activity  that  has  been  supported 
has  been  of  high  quality^  Sesame  Street  being  an 
outstanding,  example.    However,  much  other  work  has 
been  poor  in  quality,  largely  because  it  has  not 
been  adequately  informed  by  the  existing  knowledge 
base  from  fundarziental  research^  and  because  quick 
solutions  have  been  sought  in  areas  where  tsxisting 
knowledge  was  Inadequate  as  a  basis  for  such 
solutions . 


adequa^^ 


In  our  judgment  they  -represent  an  ill-advised 
trade-off  of  scientific  quality  and  future 

% 
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underscanding  for  promises  of  irjnediate  pro- 
ducts and  superficial  benefits, ^30 

Unfortunately,  manjjr  ot  the  new  E^^D  prograns 
for  education  hav-eL-Jwt  built  on  what  is  known; 
have  contributed  litcle  to  what  is  knowp,  and 
have  unknown  or  littte  usefulness  for  the, 
practice  of  education,^  Demonstrations  and 
development  projects,  for  example,  have  been 
conducted  with  inadequate  or  no  planning  for 
their  assessment,  and  attempts  to  evaluate 
chetn  retrospectively  have  proved  to  be  of 
■    limited  value,    Overevaluation--or  more  pre- 
cisely, unfocused,  poor  qualitv  evaluation — 
is  another  probl^u,    Eveti  more  serious  are 
those  projects  that  contradict  what  is  kno'.jn 
scientifically,  build  on  an  inadequate  base 
of  knowledge,  are  ill  designed  to  fill  S^ps 
in  understanding,  or  Require  quick,  predic-- 
table  answers  frora  science  that  are  inherently 
impossible  to  achieve. 

On  the  whole,.,  we  believe  that  the  federal 
government  has  adopted  policies  that  encourage 
superficial  and  wasteful  r^^search  that  has  the 
appearance  of  relevance  but  lacks  the  sub" 
stance  of  general"  principles.    We  recommend  ^ 
significant  redistribution  of  enphasis  toward 
more  fundamental  research  in  education  and 
toward  a  more  measured  approach  to  education 
R&D  of  all  kinds.  ^ 

i 

Clearly,  wh^t  was  called  for,  according  to  the 

.Committee,  was  a  higher  level  of  support  for 

fundamental  research,  to  increase  the  likelihoQfl 

of  producing  soun"dv;^^utions  in  the  future*  The 

Committee  did  not  view  this  as  dependent  on  a 

higher  NIE  budget.     Rather,  they  argued  that 

there  should  te  a  redistribution  of  emphasis 

within  the  current  level  of  resources,  vhlch  seemed 

133 

to  the  panel  to  be  "clearly  sufficient-" 
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vii*    Procurement  M^chanisrab 

Of  all  the  procur^iint  strategies  that  might  be 
*used  to  solicit  research^  the  Committee  cairie  out 
strongly  in  favor'-of  unsolicited  proposals  as  "the 
niost  productive  tool  yet  devised  for  managing 
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research  without  destroying  freedom  of  inquiry." 
Grants  competitions  were  also  treated  favorably. 
""The  argument  for  these  mechanisms  was  based  on^  ihh 
Comniittee^s  analysis  of  the  characteristics  of  a 
productive  research  environment  and  the  attendant 
conditions  the  fei^eral  government  ne^eded^  to  create 
in^rder  to  facilitate /the  development  of  this  kind 
of  environment.    The  requirements  noted  included; 
a  setting  in  which  expert 'criticism  flourishes  (as  ^ 
would  be  the  case  under  peer  review  of  proposals); 
time;  and  openness  and  f le;<ibilityj  needed  especi- 
ally  for  exploratory  research*  ' 

{  viii.    Lack  oF  Active  Lead  Agency  Role 

NIE  was  criticized  by  the  Comiaittee  as  not  adequately 
fulfilling  its  responsibilities  as  the  lead  agency 
for  fundamental  research  Relevant  to  education. 


Unfortunately,  service  has  gradually,  pished  out 
research  >  and  applied  work  has  driven  out  funda- 
mental work.     During  Fiscal  1976; 

-  Less  than  one-third  of  the  NIE  budget  ^ 
v'as  .allocated^to  research- 

-  Approximately  11  percent  of  the  NIE  bud- 
get (or  $10  nillionj  includiog'^ti^  1976 
transition  quartcr)'was  cla/ined  b\Ni;tiv 
to  be  ^located  to  basic  research. 


According  to  our  estimates >  fvmdamental 
research  obligations  actually  incurred  dur- 
i<ig  the  period  totaled  a  lictle  more  than 
$5  nlllion^  or  5.7%  of  the  budget.... 

Research  investigators  in  universities > 
labs  and  centers^  and  elsewhere  had  no  clear 
idea  of  the  overall  intentions  for  research 
....  Progratns  for  research '^^^ere  abruptly 
terminated;  sone  were  announced  but  not 
runded;  and  deadlines  for  proposals  were 
se-Cy  in  sone  instances>  two  weeks  or  less 
after  the  prograzi  announcements  were  re- 
c-jzved  by  researchtir^ . 

The  staff  of  NIE  had  divers^  and  contradic- 
tory perceptions  of  its  policy  for  research," 
especially  fundanental  research,  but  nearly 
all  agreed  that  fu^idamental  research  was  of 
lowest  priority  and  was  t^e  first  item  sub- 
■ject  to  budgetary  cuts. 


The  Wmnittee  called  on  NIE  to  adopt  and  implement 
"a  clear  strong  policy"  on  funding  research  and  to 
exercise  a  strong  leadership  role  for  federal 
sponsorship  of  research. 


The  National  Institute  of  Education      .  can 
and  should  differentiate  its  role,  from  those 
of  other  agencies...*  KIE*s  programs  shouLd 
establish  a  positio:i  of  leadership  in  research 
relevant  to  education. t  It  can  concentrate 
on  problems  that  irequire  nore  basic  understand- 
ing and  involve  the  interests  of  more  than  one 
ageAcy*    The  Institute  can  take  the  lead  in 
anticipating  issues  and  in  stimulating  pioneer- 
ing research  in  education.    Promoting  better 
coordination  of  the  government's  research 
efforts  in  education  is  another  task  that  NIE 
should  undertake^    There  is  cuiArently  sortie 
interagency  communication,  but  NIE'.*;  role 
should  be  more  active*    The  lack  of  coordina-' 
tlon  is  more  a  problem  of  wide  gaps  and  lack 
of  leadership  than  of  undue  overlap  or  ^n 
communication. 
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ix.    Call' for  Advisory  Groups 

J 

As  the  Campbell  Paoel  had  similarly  done  bBfoXc  it, 
.the^Committee  recommenaed  that  NIE  establish- one  or 
.more  special  advisory  groups  '*£or  obtaii^ing  the 
advice  of  the  scientific  research  community  on*it;s 
overall  research^ directions  and  quality. .Distin- 
guished basic  scientists  and  scholars  working'  with 
citizens  and  educators  would  help  to  formulate  the 
research  directions,  appraise  the  general  quality 

of  work,  and  identify  important  educational  problems 

t.,  ......  m137 

amenable  to  scientific  inquiry, 

c  >  Recommendations 

The  Committee's  recomm^nda^tions  were  few  and  were  rela- 
tively straightforward.    They  fell  into  four  areas.  They 
called  on  KIE  to: 

-  reempbasize  fundamental  research  (to  be*operation- 
allsed  by  allocating  a  higher  proportion ^of  the 
federal  education  R&D  budget  to  fundamental  re- 
search) ; 

-  improve  the  scientific  qua^lity  ^of  funded  by 
providing  foe  a  more  active  role  by  researchers 

*    in  planning  2nd  revicving  R^D  pro2ra:ns  to  make 
certain  those  that  are  undertaken  are  based  on  a 
strong  knowledge  and  'not  undertaken  simply  be-  ^ 
cause  of  the  significance  or'urgency  of  the 
V     '    problem  area) ; 
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-  make  more  extensive  use  of  f ield^initiated  pro- 
posals and  peer-re,view  systems  to  fund  researcti, 

.  and  e^ablish  separate  budgets  and  review  panels 
for  field-initiated  work;  and 

-  assume  a  more  active  leadership  role  in  the 
federal  research  effort,  by  adopting  and  iTPpleirent" 
ing  a  clear  policy  in  support  of  fundamental 
research,  taking  a  more  active  role  in  attracting 
first  rate  talent  to  educational  research,  support- 

'  ing  long-term  -work  on  important  problems, 

encouraging  pioneering  research,  and  adopting 
personnel  policies  that  would  give  the  Institute 
a  capability  to  adequately  understand  and  interact 
with  the  researchers  in  the  fieid- 

D,    .The  NCER  Programs  Committeel^ Report  and  Draft  Resolution 
on  Pundametital  Research  ' 

*  * 

A  short  time  after  the  NAS  submitted  its  report  on  fundamental 

research,  the  NCER  Program  Committee  prepared  a  brief  report 

o£  its  own  Csummarizing  the  NAS  report)  and  a  draft  resolution 

138 

on  the  sponsorship  of  fundamental  research*         They  noted  par- 
ticularly that  the  NAS  had  concluded  that:     (a)  fundamental 
rese^irch  was  a  low  pr;iority  item  for  agt*ncics  responsible  for 
managing  educational  R£rD;  and  that  (b)  NIE  had  not  adequately 
fulfilled  its  mandate  to  strengthen  the  scientific  and  tech- 
nological foundations  of  education.    The  KCER  Program  Committee 
accepted  the  argument  that  *'lf  the  knowledge  upon  which  applied 
research  and  development  projects  are  based  is  inadequate,  the 

; 

o  ^  ^ 
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likelihood  their  producing  valid  or  beneficial  results  is 
doubt!ul."  t'Jhile  there  is  already,  as  described  by  the  Pro- 
gram Conimittee,  "a  considerable  body^  of  fundamental  research" 

t 

that  exists  to  serve  as  a  base  for  manjf  kinds  of  r£(D  pfoject^, 
their  statement  indicated  that  this  knowledge  base  needed  to 
be  extended.    They  therefore  callefj^  for  a  "substantial  in- 
crease in  f^lE  support  St  fundamental  research  relevant  to 
education,^  so  that  NIE  could  ''fulfill  its  potential,  for 
atd^ing  major  long  term  inpfovement  in  education/' 

if 

t  t 

The  draft:  resolution;    ^a)  specified  set-aside  percentages 
and  target  dates  for  allocations  of  NXE's  budget  to  support 
of  fundamental  research;  {b^  called  for  ma:iinium  involvement 
of  the  research  conCTunity  in  planning  research  agendas  and  j 
making  decisions  about  research^to  be  supported  (through  - 
unsolicited  proposals,  participat^lon  in  development  of  guide- 
lines, roles  in  review  panels  for/^specific  proposals  and  for 


review  of  Nit* s  overall  fundam^tal  research  program,  working 
with  research  associations  and  organizations^^  etc);  (c) 
called  on  the  NIE  Director  to'vork  with  other  federal 
agencies  through  the  Federal  Council  on  Educational  Research 
arfa  D^^lopment  tVS:oordinate  the  support  of  fundamental 
research;  (d)  mandated  that  the  NIE  staff  Include  a  **substan" 
tial  number  and  proportion"  of  com^tent  researchers  with 
recent  research  experiencer  placed  in  "positions  respon-- 
sibility  in  all  activities  of  the  Program  Groups  affecting 
fundamental  research  decisions";  and  (e)  specified  reporting 
requirements  to  insur^  adequate  implementation  of  ^the  resolu- 
tioh 'and  its  annual  review  by  the  ^XER. 

Of^i^eatest  consequence  .was  the  section  of  the  resolution 

dealing  with  th^  allocation  of  funds:  ^  , 

A  . 
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a)  f\t  lease  207.  oE  ^tie  Institute's  funds  siiall  ife  used 
ta  support  fundamental  research  relevant  to  education 
by  FY  1979,  abd  by  FY  1935  this  shall  hav^ncr^ased^ 

■    to  at  least  30%*    "  '     "  ^ 

■  ■  ■ 

b)  At  least  half  of  the  miniTaum  thus  allocated  (10%  of 
'  the  Ins-titute's  funds  in  FY  1979,  increasing  to  15% 

by.  FY  1985).  shall^  be  used  ^for  research  grants  to 
individual  inves.tigator^  or  small  groups  of  investi- 
gators ■  '  ' 


A  footnote  to  the  <iraft  resolution  indicateii  that  some  of 
thtj  rttL^bers  of  tli^  )^CZR  Proyi;ai'T\  ComniLttee  agreed"  uith  the'^' 
l"ntent  of  this  section  of  the*resolution  tut  pi^ferred^ word- 
ing that  did  n6t  specify  set-aside  percentages  or  target 


dates.    The  vording  preferred  by  ^this  group  was^  the  following 


a)  A  significantly  greater  portion  of  the  Institute's 
budget  shall  be  used  for  fundamental  "research  in  FY 
1979  than  in  1978,and  each  year  thereafter  until  a 
level , is  reached  that  Is  satisfactory  to  both  tine 
Dir^ector  and 'the  Council,  ^  * 

^    b)  At  least  half  of  the  ijmds  thus  allocated  shall  be 

used  for  research  •gr^ts  to  individual  investigators 
-   or  sjaall  groups  oj 


investigators^  /'^S  ' 


E.    The  GISST  Ar^alysis;/^  Strengthening  Fundamental  Research 


The  CflSST>oli^ 
several  units 


l^^esjjn  hAJ  beerr  woricing  closely  with 

V** 


^at  the  tJpe  tjig^NAS  Committee  submitted, 
i^  draft  and  final/reports*  and  the  NCER  Prograra' Committee^ 
issaej  ^its  drafc  rdbolufion.    \!a  had  been  given  copies  all 
olL^thes^  documents /and  asked  'informally  for^.our  reactions. 
After  providing  stirie  of  these  reactions  atid  discussing  ■  them 
with  "sevenal  staff,  CISST  was  asked  to  prepare  a  formal  cri- 

Jtique  of  the  issue  and  the  relevant  docum^^nts.  ^Khis  was 

/  ^  ■  .1 '  ^ 
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included  In  our  contract  modif ication>  substituting  this 
critique  (£or*Uhicli  there  supposedly  was  an, interested 
audience)  for  the  budg*t ' planning  document  we  h*d- earlier 
been^asTted  to  prepare  a^  a  Eoliowop  on^the  Agency-Fi^d  ^ 
analysis  (before  NIE  l^j^titthose 'staff  members  in  the  NIE 
planning  unit  who, had  constituted  the  interested  audience 
for  tha^t  analysis),  * 
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We  sunimarize  below  the  key  points  in  the  CISST  critique.  ^ 

'  y 

-  r  ' 

a.    A  Balaaced  Perspective  Needed  on  Support  for-  Funda- 
mental Research  and  Other  r/D^I  Functions 

NIE^has  lead  responsibilities^  for  all  "aspects  of  educa- 
tional R&D>  not  just  for  fundamental  research*  l-Zhlle 
the  NAS  Committee' was  charged -to  examine  only  fundamental 
research-i  NCER/KIE  deliberations^  should  ^OLOt  ^consider 
fundamental  research  apart' from  its  other  areas  of  res- 
ponsibilities,   NCER/UIE  have>the  responsibility  to 
balar\ce  policies^nd  strategies  across  all  aspects  of 
educational  R&D>  a  balance  not  present  in  the  NAS  and 
NCER  docutnents  and^potentially  threatened  by  the  KCER  / 
recommendations. 

While  it  is  valid  to  consider  the  need  for  s^trengthening 
^    fundamental  researcjj  relevant  to^'e^Jli^^tion,  NIE  also' has 
responsibility  for  and  must  fjive  consideration  to  need 
^entification    applied  resear^ch,  development  >  and  di's- 
semination*    In  light  of  its  responsibility  for       ^  \ 
educational  probYejTis  and  practiT:e^  NIE  must  also  give  •  . 
*  consideration  to  such  matters  as  poli^^y  rcsearch>  train- 
ing>  and  t<?chnical  assistance  for  users  of  educational  ^ 


R£cD  outputs.     In  addition  to  con^i4er^itioh' of  each       ^  * 
.these  areas  indiviclually>  NIE  must  also 'give  coosidera- 
^'tJion  to  orchestration  and  system,  building  "across  .^hese 
areas*    Simply  put>^Nl£  must  consider  etlucMional  R^C'  , 
as  a  total  process  6f  innovation* 

^his  re^quires  that  NlE  give  consider'ati^n  to:     the  need  , 

to  balance  ^I^IE's  responsibilities'  across  each  ^of  these  ^ 

'**  *  ,     \  ■       ^ '  ^ 

areas;,  the,  need  for  a  balanced  rate,  and.i-evel'of  deveii^p- 

^     ment  acrosis  each  of  Dhese  areaa;  afc3^"iN'lK*i3  respon^biiity 

for^tha  impact  of  educational  R&fi'-otr  "tT^e  leducational 

operating  systeint    Herc>  th^,  several  basic  questions 

must  ba^  asked  whioh  are  pot  ^sked  in',either  th^NAS  or 

'  KCER  Program  Compiittee  reports*  ^ 

~  I^Tiat  are  the  needs  of  these  areas  for  which 

XIE  has  responsibility? 

-  What  are  the  relative  levels  of  funding  required 
for  significant  irapect  across  the  various  educa-  ^ 
tional  RicD  related  areas? 

-  Impact  would  various  levels  "of  funding  f or  ^ 
fundamental  research  have  on  NIE* s  ^ibility  to 
fulfill  its  responsibilities ^in  other  educational 

^  R4D  areas? 

th*s  KAS  and  I^CT.R  hav<^  concluded  that  education-re^levant 
funda:uental  tj^earch  shou^||^bl*  strengthened*  Howevcrj 
bcc^iuse  educational  R4D  is  relatively  young  in  thit; 
coiintrv,  all  educational,  R£(D  areas  need  strengthenings 
though  in  v^tryi^n^  deg'^rees.    In  particular,  some  people 
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'    '    '*'*coi^yii^  used  i£r§ntt£Tjjj|£ic^g|f  appfied  're^£>-arc.h^'^  tli  ^^^^.^-^ 

/    '  /areo^, which  have  e^je^Ji^tp^J^it^^  ftrr- -'strengtheinlng"  ' 

^  ^  ,  .       ^  '  f    ^in,-the '£i*^i<l;^pf  dqfrs  fundaiiiental  research- 


.b.  M:he  'CQnteict:\>f:^lH»1<i'aiiiental.  Research  l^elevant  to 
.  *  '  ^ — -  — .  — ^  

V  '  '        ;    EiiufcatlbTi/    '  '  '  „ 


7. 


''^'there  ^re  at  least^^eVer^l  critical  cQrffiderations  u&utT 
whj-ch  funcjiag  decisions, 'for  ^Mcation\reIe:vant  funda-^ 
,mental"ress^ch  sfiould  ^l^e  based. 

*  Firsts  dKceliencfr  is 'cVttical  to  fundamental  res^rch-r. 
\in  any  field,    Fimdin^  levels  greater  than  what  can  be 

used  effectively  by  tiig>  quafity  Researchers  and  re- 

t  '-iff 

search  institutions '"simply  invito  .application  by  and 
distribution  of  funds  -to ^low  quality  researcher?  and 
>tesearch  institutions.    Thus,  funding  niust  be  provided 


in  a  manner  which  carefully  selects  high  quality -programs 
or  projects  and  screens  out  low  quality  one^, 

'Second,  if  Excellence  is  a  critical'  requirement ,  then' 
the  capability- of  the  £ield  to  absorb  and  use  produc- 
tively ihcreased  levels ^of  funding  for  fundamental 
research  is  limited  by  the  available  base  (i,e,>  the 
availability  of  high  quality  fundamental  researchers 
and  f und^irrp'fital  research  insticutions)  .     Simply  put^ 

'the  fewer  the  number  of  avail^ble^igh  quality  funda- 
mental research  personnel,  ^pMe  lower  will  be^  the  level 
of  fijndinij  for  fundanental  resc^arch  projects  which  can 
be  prodnct  ive - 


FRIC 


Thirdj  the  current  base  o£  fundamental  researchers  and 
research  institutions  also  li>nits  the  rate  at  which 'the 
f qndamental  research  community  can  be  built  up,  for  it  ^ 
is  Che  -existing  personnel  and  institutions  which. provide 
training  for  new  fundamental  research  personnel.  Further> 
training  of  nex^,  high  quality  fundamental  researchers*.  * 
does  take  time.    These  coi^isiderations  are  constraints 
on  the  ability  tcr  improve  or  strengthen  fundamental 
research  thrQu^^h  increased  levels  of'frindingj  and  these 
are  not  issues  considered  in  the  NAS  or  1R;ER  rtiports. 

The  existing  base  of  high  quality  basic  researchers 
within  edui;^tion  is  small, sand  this  operates  as  a  con- 
straint on  the  rate  at  which  the  field  can  be  built  up. 
The  numbers  of  quality  fundamental  researchers  and 
research  institutions  in  areas  .relevant  to  education  is 
more  substantial,  but  the  low  prestige  of  educational^ 
research  tends  to  act  as  a  constraint  oxi  attracting 
large  numbers  of  these  researchers  to  education.' 

^  c.    The  Inherent  Funding  Requirements  of  Different  Kin^s 
.    ^  of  K/DSI  Activi-ty 

Different  kinds  of  K/D&I  activity  have  different  inherent 
cost  requirements.    Compared  to  applied  research  and 
development,  the  costs  of*  fundamental  research  are  rela- 
tively  sm.iill.    Both .ap^lieJ^  research  and  developme"nt 
have  requirements  of  scale  several  degrees  of  magnitude 
greater  than  the  scale  requirements  of  fundairental 
research.    Differences  in  sectors  and  ^disciplines  make 
precise  anaios^les  difficult.    In  areas  such  as  dru^s 
and  chemicals  (which  involve  "hard'*  sciences  and  which 
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^bave  very  high  levels  o£  industry  Involvement)  ^  funding  - 
maAjfbe  as  raich  as  ten  times  greater  for  appXied  research 
(and  one  hurMred  times  greater  for  development)  than  for 
fundamental  research.    In  the  "soCter"  soc       sc ience*>K^ 
the  differences  in  magnitude's  of  funding  may  not  be  so 
great  —  but  th'ey  are  still  significant-     In  the  social 
sciences,  funding  for  applied  research  typically  is  two- 
to^foaf  times  greater  than  for  f unt/anterrtal  research. 

The  implications  of  this  is  that  funding  for  fundanencal 
research  can  be  increased* significantly  without  under- 
mining tfie  funds^av^ilable^^C^nid  needed)  fot  other  R^D  . 
functions.    At  the  same  tine,  there'  is  also  an  impllca* 
tion  that  funding  levels  for  fundamental  research  are 
,  not  typica4rly  20%  to  30^  or  the  total  combined  funding 
for  fundamental  research*  applied  research  and  develop- 
ment '     y  '  '  ■ 

^4*     Impact  of  Various  Levels  of  Funding  for  Fundamental 
Research  on  N'lE's  Ability  to  Fulfill  Its  Respoi;stbi" 
lities  in  Other  Educational  R^D  Areas 

'  J 

The  NCER  Pro'gran  Committee  ha5  recommended  that  207  of 
NIE's  budge^t  be  allocated  to 'fundamental  research  by 
11979  and  30^  by  1985*    This  recommendation  can  be  properly 
evaluated  only  in  the  context  of  N'lE's  responsibilities 
for  all  aspects  of  educatLon:il  RiD  (need  icientif  ic^i t  ion* 
fundamental  rei.ejirch»  applied  research  and  development) » 
as  well  as  for  dissemination  and  irnpleiBentation/util  tza- 
tion  of  the  o^itcoiTies  of  educational  MD*    Allocation  of 
30%  of  NIE's  bticlget  to  f undar;iental  rese^^rch  would  leave 
only  702  of  NTr'<^  budt^et  lot  nrts  ocht^r  R^-D-related 
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rt:;sponslbili'ties+ ^  Since  applied  research  and  develop- 
iaent  both  tend  to  require  much  higher  magnitudes  of 
funding  than  does  fundamental  researchj  the  effect'of 
the  NCER  Program  Committee's  recommendation  could  be  to 
weaken  ^'IE*s  capacity  to  meet  funding  needs  fot  applied 
research  and  development^  —  as  well  as  funding  needs  for 
N*IE's  other  education-related  R&D  areas  of  responsibility 

Conf;ideration  p.ust  also  be  given  to  the  fact  that  ^TE 
does  have  fixed  expenses  for  administration  (12-14%  <3f 
its  budget' in  recent  years)  and  other  commitments  for 
Chich  funding  Is  allocated  ('e.g^,  dbntractural  commit-  ' 
meats,  prograniinatic  commitments  such  as  the  implied 
three  to  five  year  commitments  to  SEAs  involved  iti  the 
State  Dissemination  Capacity  Building  Program,  congres- 
sionally  mandated  corrmitnents  such  as  recent  legislation 
relating  to  the  labs  and  centers),    Fixed  expenses  and 
tOTimitments  cannot  be  automatically  removed  or  reduced 
to  reallocate  funds  to  fundamental  research  (or  to 
any  oth^  RiD-related  concern).     Since  fixed  expenses 
and  conmitments  already  represent  a  significant  portion 
of  NIE's  budget,  increasing  WIE's  fundamental  research 
allocation  to  20-30%  could  be  accomplished  only  by  using 
funds  from  the  ''uncommitted"  portion  of  lUE's  budget  — 
thereby^signif icantly  reducing  the  level  of  the  discre-- 
tionary  portion  of  NlE*s  budget.  ^ 


This  siir.ple  fact  raises  at  least  two  serious  questions 
about  the  NXER  Program  Committee's  recomniendatlons.  (a) 
;;ould  the  remaining  uncommj  tted  portion  of  NIE*s  budget 
be  adequate  for  NIE  to  fulfill  its  other  R&D-related 
responsibilities?    And  (b)  Would  KIF  have  the  level  of 
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flexibility  and  discretionary  use  of  funds  it  needji  to 
respond  to  anticipated  or  unanticipated  chaages  in  the  ^ 
educational  R&D  context^  promising  new  developments  in 
any  area  of  the  total ' educational  R6D  process>  the  need 
to  balance  the  levels  and  retes  of  maturation  across 
'all  educational  S&D  functions>  etc.? 

e-    The  Critical  Meed  for  Stability  Over  Timg  in  the 
Support  of  Fundamental  Resc^arch 

^Stability  over  time  is  very  important  for  fundainental 
research.    Thus,  *w'hile  ^e  recognize  ch^t  j^ercejitages  can 
be  useful  for  administrators,  we  do  question    the  wisdom 
of  allocating  a  total  budget    percentage  (10%,  20%,  30% 
or  whatever)  for  fundamental  research.    If  NIE'js  budget 
increased  significantly,  a  totaj  budget  percentage  basis 
might  well  result  In  moVe  funding  being  assigned  than 
the  personnel/institutional  base  of  fundamental  re'search 
could  U55efully  absorb.    The  other  side  of  that  coin  may 
be  even  more  .worrisome :     if  NIE's  budget  decreased  signi- 
ficantly, a  total  budget  percentage  basis  would  require 
cutting  funding "allocations  to  fundamental  research 
projects  —  thereby  IntrcKJucing  an  instability  which 
would  likely  be  highly  dysfunctional. 

f.    An  AltemativQ  Funding  Strategy  for  Fundamental 
Re^^£rch 

In  light  of  the  above  discussion,  the  need  would  seem 
to  be  to  develop  a  funding  policy  which  is  both  effective 
in  strengthening  fundaftiental  r'esG^irch  and  ftsasible  given 
the  constralntfi  discussed  above  and  the  nered  for  balanced 
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f\:nUing  across  R^D-rclated  areas  of  NTE  rosponsibiUty. 
We  suggested  in  our  analysis  chat  there  was 'an  effective 
and  feasible  alternative  strategy  which  ve  describe  ' 
below.    This  alternative  a^sqmes  that  a  cercain  amount 
of  prior  work  would  be  done  before  Che  implementation  of 
this  stpategy>  and  that  in  particular  this  prior  work 
would  produce  analyses  and  estimates  on  such  matters  as: 
the^evels  oi  funding  which  che  fundamental  "research 
personnel  ^institutional  base  is  currently  capabl'e  of 
U5in^  pro^u'jt  Lvfcly ;   zu's  relative  nOed  fc^r  fundLn^; 
^Xi  aspects  of  the  educacionai  RSfD  process;  etc* 

i,    'farRet-Doliar-Ai'^ount  Level 

The  alternative  strategy  we  suggested  w*as  that  NIE^ 

establish  a  carget-dollar-amount  level  for  NIE 

■ 

y  funding^  of  rundaTiental  research  relevant  to  educa- 
tion* 'The  target  dollar  atnount  level  would  likely 
be  greacer  than  the  <^rrent  dollar  air^ount  level* 


<^{irren 


Tne  use  of  a  target-dollar-amount  level  for  increas- 
ing SIE  funding  of  fundamental  research  would  serve 
several  purposes  and  vould  have  several  advantages 
over  a  perce^ntagc-of-budget  basis  for  funding* 
Both  dollar-amount  and  percentage-of-budget  formats 
would  deTOnstrate  the  coinniitment  of  KTE  to  a  policy, 
of  strengchening  fundamental  research-     Both  would 
provide  targets  or  goals  to-be  reached*    However,  a 
target-dollar-aaount  basis  for  funding  Would  also 
allow  N'lB  to  relate  funding  to  the  capability  of 
the  field  to  use  funding  productively  and  would 
protect  f tjndaTental  research  fuhding  from  f luctLiation 
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-or  instability  in  budget.    A  percentage-of- 

Sudget  basis  for  funding  would  not  serve  these 
purposes*.    The^  specific  target-dollar-^amount  "level 
would  be  established  on  the  basis  of  realistic 
estitnates  of  probable  NIE  budget' levels,  the  cap- 
ability  or  the  field  to  productively  use  funding> 
"and  consideration  or  NIE*s  mission  responsibilities 

iri .    Review  , of  Targ.et-Dollar-Amourtt  Level  at  Five 
^  Year  Ificervals  ■  * 

The  target-dollar-auiount  level  would  be  reviewed 
at  approximately  five  year  intervals.    This  is 
.essential  since"  it  cannot  'be  assumed  ^that  any 
specific  level,  once  set,  is  either  "written  in 
stone  for  all  ti'T>^s"  or  based  on  "perfect  wisdom." 
The  target  level  does  , represent  ^  definite  comit- 
ment  which  i^  based'  in  well-considered  judgment^. 
At  the  sarte  time>  there  inus^tr*Te^lf^^view  mechanisms 
which  can  take  into  account  such  coni^t  changes 
^s  significant  changes  in  RIE'fe  overall  budget 
levels*  increased  capability  of  the  field  to  use 
funding  productively >  etc.  ^  , 

While  a  review  process  is  needed>  the  review  niust 
be  neither  too  often  nor  too  seldoni.     If  performed 
too  often  (e.tj.i  annaally)  >  thert^,is>  not  ^d^^o-iit^rt 
time  to  neasure  and  weigh    the  changes  noted  above> 
"the  danger  'of  instability  is  reintroduced >  and  the 
force  of  the  funding  commitment  is  undermined.  On 


the  other  hand*  it  the  review  is  performed, too 
seldom  (e.f;*>  every  ten  years  or  n^jre)  >  adaptation 
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to  context  changes  rnay  come  top  late  to  bo^e££ective 
and  the  concept  of  "review*'  becomes  ^erationally 
,  meaningless.    Thus,  we  suggested^he  review  be  per- 
formed approximately  every  five  years. 

ill,    Annual-Incremencal-Percenta^e-Growth  of  !^IE's 
F-^ndanental  Research  Budget 

In  order  to  reach  the  ta^rgfe^t-dollar-amount  level 
specified  as  policy,  N-Il  vould  establish  as  policy 
'an  anniial-increnental-peEcentage  growth  of  KIE's 
fundar.ental  research'  budget.    Any  increase  in  KIE 
funding  for  f ut^damerttal  research  must  take  into 
account  the  current  capability  of  the  field  to'use 
productively  increased  levels  of  funding  and  the 
rate  of  developnent  of  the  field  over  time.  An 
annual- incremental-percentage  basis  for  increasing 
fundamental  research  funding  takes  both  of  these 
factors  ipto  accoun-t;  '  Indeed,  the  specific 'annual 
percentage  set  as  policy  would  be  based  on  informed 
estitiiates  of  these  two  factors. 

This  strategy  is  tased  on  the  premisfe  that  fundamen^ 
tal  research  by  its^ very  nature  requires  a  rather 
steady  growth  rate  rather  than  a  one-time/short- 
term  spectacular  growth  spurt*     If  deemed  wise  and 
fea=;ible,.  the  incref^intal  percentage  could  be  hrpher 
in  the  first  ^year  in  order  to  bring  the  level  of 
fuTtda::Tental  research' funding  up  to  the  level  at 
which  the  field  is  currently  able  to  use  funding 
productively/   Regardless  of  what  ^s  dtscided  on 
that  issue,  the  specific  .innual  percentage  for 
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incremental  growth  should  also  be  subject  to  review  ' 
approximately  every  five  years  (Eor  the  saroe  reasons 

L 

as  those  considered  above  for  reviewing  the  target- 
dollar-amount  level  at  five  ^ar  intervals). 

It  should  be  emp^hasized  that  the  p^rceQtage  formula 
req^min^Bed  here  was  a  percentage  of  NIE's  fundatnen- 
taJ^r^^earch  budget,^  not  of  KIE's  total  budget, 

/ 

iv,    gasinfi  Project/Program  Se;lection  on  Standards 
of  Excellence  Regardless  of  Totals  Available 
to  be  Spent  on  Fundamental  Research 

It  would  seem  essential  that  a  strategy  such  as  the 
one  recommended. here  include  in  it  a  proviso  that 
funds  'set  aside  for  fundamental  research  would'be 
used  only  when  programs  or  projects  meet  the  cri-  , 
terion  of  researcher  and/or  research  institution 
excellence  (as  well  as  any  other  criteria  estab- 
lished by  NCER/NIE). 

v>    Flexibility  in  Growth  Rate 

Provision  would  need  to  be/^ade  that  for  any  givea_ 
fiscal  year,  the  annu3l,^"rcentage  growth  rate  may 
be  temporarily  suspen<*ed  for  a  one-year  period, 
with  the  conjDler^entary  provision^  th;^t  th^a, level  of 
funding  already  reached  would  not  be  reducfed. 

We  have  stressed  the  importance  of  not  providing 
levels  of  fundaoental  research  beyond  the  capabili- 
ty.of  the  field  to  use  productively*    An  inflexible 
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growth  in  funding  levels  does  not  take  this  -factor 

'  ft 

'  into  account.  .  The  above  provision  provides  "the 
needed  flexibility  —  I.e.,  if  ap-atiy  time  NIE 
finds  that^he  level  of  produc^l^e  funding  has 
peaked  (temporarily),  it  may  suspend  the  annual 
increase  in  the  "funding  level.    At  the  same  time, 

c 

stability  would  be  provided. in  that  th(i  levfel  of 
funding  already  established  would  not  be  reduced. 
The  intent  of  a  policy  of  annual  increases  in 
iLindlng  Icvfil  you\J  b3  prousctsd        the  provisiorv 
that  a  suspension  would  be  for  one  year  "only. 
Continuation  of  the  suspension  (if  valid)  would 
require  an  annual  decision* 

vi.    No  Targcet 'Dates  for  Reachini^  the  Target-Dollar- 

Agiount  Lgvel 
 J  7:  

We  recoihniended  that  no  target  year  be  established 
for  reaching  the  target-dollar-amount  level.  Set- 
ting a  target  year  may  sound  good  at  glance, 
but  it  is  unnecessary  and  the  effect  is  simply  to 
rigidify  the  process,  thereby  leaving  NIE  less  abla 
tp  adjust,  .the  process  to  the  capability  of  the 
fiei*d  ox  "to  changing  conditions  (e.g.,  a  period  in 
which  Congress  does  not  provide  for  the  increases 
in  WIE's  budget  needed  to  increase  allocations  to 
fu^idamental  research) . 

vii-  ^  Monitoring  the  Field's  Capabilities 

As  part  of  the  implementation  of  the  above  policies, 
NI'E  would  need  to  continually  monitor  the  capability 
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of  the  field  to  use  fundamental  research  funding 
productively.    This  could  uell  be  parried  out  within 
the  franiewor*^  of-  the  Education  ^CPU  Monitoring  Programs 
'  started  by  NIE^s  R£fD  System  Support  Division^  This 
provision  would  also  serve  the  secondary  purpose  of 
devel^oping  and  maintaining  close  contact  between 
NIE  and  the  field  and  keeping  NIE  ^ware  of  who  in 
the  field  is  best  able  to  carry  out  needed  work* 

HIE*s  Roles  as  Lead  A^ancy        ,  ^ 

As  theUead  agency  for  educational  R5(D>  we  agreed,  MIE 
should  be  carrying  out  three  roles  in  relation  to  funda- 
mental  research>  -beyond  merely  providing  funds  for 
fundamental  researchers • 

One  required  role  is  to  provide  leadership  in  system- 
building  for  fundamental  research  relevant  to  education* 
the  very  least>  this  role  implies  the  need  for  poli- 
cies and  strategies  that;     (a)  f'acllltate  the  development 
of  linkages  among  disciplinesj  among  funding  agencles> 
and  among  fundamental  researchers;  (b)  provide  for  the 
training  of  education-oriented  fundainental  cesearchers;  '  ■ 
(c)  build  ^ind  strengthen  centers  of  excellencef  for 
education- re  leva  tit  fundamental  research;  (d)  provide 
stability;  <ind  (e)  increase  the  status  of  educational 

"research.     A  sys  tern  bailding  role  also  iinplies  that  the 

+ 

system-building 'potential  of  a  specific  project  should 
be  a  major  criterion  for  project  selection  decisions* 

A  secondj  clasely-related  role  is  that  of  orchestration: 
(a)  facillLatlng  cor?"unicat  Ion  <icross  dif^ciplines  and 
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among  fundamental  research  personnel;  (b)  working  with  " 
'the  field  in  identifying  particular  ar^as  of  fundamental 
research  ^hich  appear  to  have  a  particular  signif'lcance 
ior  education;  (c)  t;^k^^-a  lead  role  irt  coordinating 


►  f  undarttental  ^research  pwkrams 'afid  projects  across  fund- 
ing  ^agencies  in' order  to  develop  synergy  acrosS  "pr^rams 
^and  projects;  and  (d)  linking  fundamental  reseatcl 
*'upstr-eaui'''  and  *Mownstream'* -R&D  functions* 

Implied  in  this  drchestfation  roLe  is  ^ec  a  third  role 
for  HIE       a  coalescing  role<     Fundamental  research 
relevant  to  education  issjjighly  scattered  <  -  It  ^involves 
a  variety  of  disciplines,  each  with  a  variety  of  research 
area"^  potentially -relevant  to  education.    Funding  for 
this  research  is.scattered  across  many  funding  agencies. 
Education  is  generally  a  secondary  concetn  in  these 
varied  disqiplines  and  funding  'agencies-    The  education-^ 
relevant  fundamental  research  "community*'  is,  at  best 
loosely  aacj  weakly  linked*    Education-relevant  research 
is  not  per  se  of  high-status*    Thus,  there' wo?^d  seem  to^ 

can:*'   (a)  coalesce  leadership  in         f  iel<^  (b)  ^can  the 
various  education-relevant  disciplines  to  identify  po't^n- 
tiaL  for  synergy  across^  lines  of  ^tesearch;  ^d  (c) 
perfotm  the  syst^  building  and  ortheOTratiOn  roles* 

b The  Aficnciy-Fleld  Issue  '   .        '      ^  , 


A  basic  i^ssue  in  R^D  is  th5  role  of  the  field  in  relation 
%   ■  * 

to  the  r0ia  of  a  maj6r,^f unding  agency  such  as  NIE<  Both 

>  >*  -  * 

the  J?AS  and  NCER  Program  Committ^  rep<t3rts  callfed  for  a 

strong  field  ifole  in  review,  in  ns^sting  NIE  in  \^ 


be  a  strong  need  for  a  c oaies c i ngr    core  ox  J3un.eits 
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researt^h  neecis,  and  in  initiating  fund^ental  research 
ptoiects*  *The  MCERf  draff  resolution  even  included  a 
provision  that  50%  of  NIE's  fundamental  research  funds 
'be  allocated  to  "individual  investigators  or  small  groups 
o£  investigators*" 

In  developing  a  policy  on  the"way  in  whiclv  the  agency 

should  relate  to  the  field,  th^re  seemed  to  us  to-be 

some  important  issues  that  needed  further  consideration  . 

and  clarification.  ^ 

& 

^  One  of  these  issues. is  the  level  of  consensus  among 
^    researchers  in  the 'field  about  such  matters  as;  identic 
^    fication  of  key  questions  in  need  of  answers,  adequacy 
or  appropriateness  of  diff^ent  methodologies,  lines  of 
,  research,  which  appear  to  be  mos^t  promising,  etc^.  \7here 
field  consensus  is^low,  it  wotild  seem  appropriate  for  a 
funding  agency  to  work  with  (but  clearly  not  be  directed 
by)  the  field  to  determine  areas  and  .p^jects  ^or  fund^ 
^  ing.    That  Is,  the  sgency  would  be  fairly  aciiv^p  in 
molding  ancj  selecting  from  what  the  field  has  to  offer 
rather  than  just  responding  to  scattered  field-i  nit  iai^e^ 
,     proposals.    On  the  other'hand,  where  field  consensus  on 
key  issues  is  high,  such  an  agency  role  would  seem  less 
necessary  and  an  approach  that  was  highly' responsive  to  , 
field  initiated  proposals  would-  seem  quite  appropriate. 
Thas,   It  is  iacu-ribent  on  NTE  to  determine  the  level  of 
field  consensus  on  key  fundame^al  research  issues  - 
fore  setting  a  fixed  policy  about  f i^drinitiated  \ 
proposcils-    However,  pending  5iuch- ^  determination,^  it  ' 
appe^irs  to  us  that  in  many  areas  fundamental  \es€iarch 
relevant'  to 'ejducat  ion  i8  inore  neari>;  chfli;acteri?.cd' by 


low  rather  than  high  consensus.    I£  this  is  indeed  tl:e 
case>  the  lead  roles  of  orchestration  and  coalescing' 
be<iome  especially  importari^  ^  ^ 

A  second  (an^  related)  issue  is  the  need  for  system 
capacity  ^^uilding  ii^relation  toxfundamental  research 
relevant  to  education.    As  we  noted  earlier^  this  role 
implies  that  projects  should  be  considered  in  terms  of 
their  po?:ent^ai>^(^r  system  capacity  biiilding  as  well  as 
Ln  ter^ns  of  their  quality  and  substantive  output.  -  Ax\ 
perview  agency  such  as  KIE  is  more  likely  than  the  field 
(to  haVe  an  overview  perspective  of  total  system  building 
needs  anS  to  be  specif ical^ly  concerned  with  this  issue. 

T!he  tasic  implieation-  of  the  above  ^^iscussion  is  siti^>ly 
that  ther.e  at^  le^d  roles  which  can  be  performed  only 
^by  a  major  funding  agency  sueh  as-  NIE  and  that  these- 
lead  agency  roles  are  especiiilly  important  when'  an  E£(D 
system  3uch  as  that  in  education  is  relatively  young  , 
■atid  innature- 

However*  having ^said  this>  it  is  now  important  to  balance 
the  discussion  by  point  out,  in  agreement  with  NAS  and 
the  NCER,  ^ihat  the  field  must'  have  ^a  strong  r.ole^En  the 
fundir^g  v^o^^ess  for  fundamental  research.  Fundamental 
research  Is  a  hijhly  uncertd^in  process-.    It  difficult 
"to  d^z^nr.ine  yWich  tinas  of  research  are  ''most  promising. 
The 'knovlerfg^  and  perspective  of  researchers  are  needed 
it  adequate  evaluations  are  to  be  made        the  'q6ality  of 
rcse£^rch  proposals'.  -  -     ,  ^ 


The  practic^il^  question  at  this  point  mi^ht  seem  to  be;^ 
How'can  the  "lead"  role  of  HIE  and  the.  "strong"  role  of 
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th^  field  be  recocicHed*    Actually,  this  is  the  wrong 
question*     It  implies  that  the  ageucy/field  issue  is  , 
"eicher-gr*'  question,    Ue  suggested  instead  that  the 
nature  of  Lundamental  research  in  the  educational  c<5ntext 
requires  a  highly  collaborative  agency/field  relation- 
ship* "  In  order  to  develop  and'  maintain  such  a  close, 
collaborative  relationship  with  the  field,  NIE  would 
need  to *have  "fundamental  researchers  on  its  staff*  And 
if  would  seefn^  advisable  to  have  these  staff  researchers 
continue  their  involvement  in  research  and  have  as  a 
major  responsibility  maintaining  close- contacts  with 
other  members  of  the  field.    The  *^either*-or"  question 
thus  gets  translated  intQ  a  matter  of  determining  the 
inost  appropriate  modes  pf  collaboration,  y/ Indeed,'  if  NiE 
has  active  ^researchers  as  part  of  its  internal  staff, 
NIE  becomes,  in  one  sense,  a  part  of  the  field* 

?oth  the  N'AS  report  and  the  MAS  resolution  put  heavy 
emphasis  on  the  individual  researcher  or  small  research 
team  as  the  most  appropriate  or , productive  ijpde  for 
fundanentai  research*    Although  we  do  not  question  the 
^inportanc^^' of  individual  researchers  and  small ^eap,s 
as  pare  of  the  f undamencai  research  commLmity,  .we  do  ^ 
challenge  ^he  perspectivG  that  this  mode  i^^h^^^only 
(or  ^bv&n  the  main)  approach  to  fundamental  research 
or  .necessarily  ev^n  the  most  productive  one^J  Such  an 
LmplXcjtion  doe^  not  take  cognisance  of  "xi^^al  trcrtds 

\toward  the  use  of  ceamS  in  fundamental  rft^^arch  V^^a 
nup.ber  of  areas,,    The  need  for  system  capacity  building" 
sugj^GSts  the  t/isdofrT'of  a  strategy  of  supporting  reseai^h^ 

*    ciicried  out  in  settings  that  can-  b6  characterized  as 
'^Centers  ot  txc^Hehce"  end  which  by  their  very  ntiturc 
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must  be  institucions  where  there  is  a  "cluster"  of  funda- 
mental  research  personnel  ^;7ho  can  interact  and  stfengthen 
each  ottier*s  work*  '  , 

There  is  no  evidence  for  the  assertion       the  NAS  report: 
that  the  unsolicited  proposals  mechanisqi  represents  "the* 
^^l^t  productive  tool  yet  designed  for  managing  fynda- 
nental  research  without  destroying  freedom  of  inquiry." 

disc^jission  of  thlp  issuG  ir-  the  MAS  recoct  failed  ^'-o 
cake  into  account  how  uQSoiicited  and  agency-suggested  ^ 
proposals  should  be  viewed  in  tertns  of  such  matters  as 
-  MIE's  lead  agency  roles,  agency/fieid  relationships, 
^    selection  decisions  regarding  lines  of  research,  etc* 

In  short,  this  contention  fails  to  consider  the  matter 
■  in  as  complex  a  manner  as')%he  questioti  requires.     It  ^ 
needs  to  be  rethought,  along  with  the  propcrsed  policy 
for  funding  fundamental  research  as  stated  in  the  KCER 
draft  resolution* 

F.    NCER  Response 

The  CISST  analysis  was*  greeted  v;ith  some  enthusiasm  fron  those^ 

I 

within  :^Ii;  and  N'CER  who  had  opposed  all  along  the  percentage 
set-aaide  approach  to  the  support  of  , fundamental,  research,  . 
The  CISST  tean  even  iTcceived  a  warm  and  gracious  letter  from 
the  head  ot  th^  MAS  Cojnmittee  which  had  prepared. the  funda- 
mental research  report j  acknowledging  the  validity  of  some 
of  t^he  points  ve  had  !nade. 

t 

Ho'^ovor,  che  ^ipal  resolution  passed  by  the  Council  waSf  vir-  , 
tu/illy  identical  to  the  draft  resolution  prepared  by  the  NCER 
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'Program  Co:z!iLttee  priot*co  the  CISlST  analysis.    The  only 
changes  involved  additions       atlefinition  of  fundamental 
research  relevant*  to^  education,  and  a  call  on         staff  to 
carVy  ouf  activities  to  dilseminate  research  remits  *and- 
support  the  utilization  of' research  results  in  the  forp.ulation 
of  research  plans,  educational  programs,  and  educational^ 
policies, 

v 

The  CISST  analysis  had  in  no  way  affected  the  outconie  of  the 
Council's  decision  Tiaking,  and,  tow  the  best  of  out  knowledge, 
had  little  effect  ^on^^even  the  deliberations  which  preceded 
the  passage  of  the  Council  Vesolutiort, 

C*     Strengthening  Fundamental  Research  and  the  Context  of 

* 

Educational  R/D&I  Policymaking 

V 

As  in  thf  cas^  of  the  Agency-Field  analysis^  a  report  coinmas- 

sioned  by  an  agency  was  essentially  ignored  in  the  decision 

^  ^ 

niaking  process  for  which  it  wa^  supposed  to  provide  some 

ass^stancG,    The  funderental  Research  analysis  was  consider- 

.ably  briefer  and  better  writtWi  than  the  Agency-Field  ireport, 

so  presuriably  hulk  and  ponderousneps  were  not  significant  ' 

factors  here.    A^d  here,  a  specific  policy  alternative  vas_ 

t 

proposed  that  gave  the  Council  a  handle  on  th'eir  iron^ediate 
policy  probl^in,  ^  '  ^ 

the  -k^'  rcnson^  for  the  lack  nf  iafltietice  of  the*4??nsiy§is 
were  probaj^ly  Tuch  the  sare  as  ^those  6perative'in  the  case  of  . 
the  f\genc;/-?^ie_ld  analysis,    Agdin  (and  here  oven  Rore  directly 
and  intensely  than  in  the  case  of  the  Aaency-Field  report), 
(a)  the  rt'ConmendaEion^  of  the  comnjissio^ied  report  were  cor+- 
triry  to"  tht?  prev [ous ly-d^ve toped  policy  incl  in^^tlons  and 
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biases  of  the  particular  body  of  d£-ci$ibn  makers;  and  (b)  the 
report ''s  recor:n:tindficions  required  a  more  complex  approach  to 
the  problem  than  what  the  Council  felt       needed.    The  Council 
h'ad  a  precise  fonr-ula  ready  to  be^implenented  iTnmediately.  ' 
'pifhat  the  CISST^a.'ialysis  pro;^ded  was  a  reasonably  specific 
approach  to  develop in^  a  formule  but  ^^^ith  the  nu:nbers  needed 
for  policy  inple-entat ion  still  blank  and  essentially- unknouTi. 
Sor-e  prior  work  vcJ-jld  nee<^  to  be  done  to  develop  estimates  of 
hov  rwic'n  funding  the  field  could  productively  use  at  this  tinie, 
etc.  ^ 

»  * 

Both  the  Aj^ency-Field  analysis  and  the  analysis  of  funding 
policies  f or  "^tr^iDgthening  fundamental  research  had  been%om-  , 

Lon^id  as  a  result  of  the  NCtR  and  NIE  desire  to  be 
responsive  to  pressures-  fro::ii  the  fundamental  research  cornmun- 
icA  for  a  set*aside  for  NI£  runding  of  field-initiated 
>fjj:^cir?.ental  research.     Being  responsive  (3^ften  requires  strong 
gestures,  not  calls  for  additional  work  X-o  develop  more  ap- 
propriate policies.    Now  that  the  gesture  has  b^en^niadej  ■ 
thgughj  the  question  remains:    Will  the  needed  information  be 
gathered         th4  analyse^  perfornad  so  tha^^ore  appropriate 
policies  can  be  developed  sone  time'in  the  future? 


■L!Nt>INrT 


4 


V,,      FCNPINCt  policy  issues  in  need  Or  EXPt.CRATIOx\' 


The  funding  data  and  analyses  which  have  become  available  in  the  } 
Li^^  fc'^  yenrs  ha.'e  t^I'.ci:^  \is  ^i.  long         toward  understand inj^  what 
is  clearly,  ''the  funda~entaX  Question  in  annlyzing^  the  allocation 
of  resourc:os.         Who  recaives  h^iJ  r:iuch  from  whom  for  what?"^^^"^ 

The  bc:tt--r  our  answers  become  to  that  set  of  quest;i6nSj  the  sounder 
t!u-  b-:i>e^f"or  4'>pproacrii^i;  the  key  questions  to_  be  Cackled  by 
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policymakers:    What  should  the  allocation  of  resources'look  like? 
How  should  funds  be  distributed  across  functiarial  areas?  across 
types  of  iDstitutional  performers?    across  substantive  problem 
areas?  etc.    And  on-what  bases  should  such  decisions  be  made? 

One  useful  approach  to  answering  the  question  of  the  distribution 
of  funds  across  functions  was  taken  in  a  recent  article  by  Ward 
Mason  an^Jl  Carnot  kelson.    Mason  and  N'elson  pointed  out  that  in 
r^issiDn  -^.'^erYcies  it ,  is 'coT^mon  to  distinguish  betveer.  direct  and 
indirect  KPU  strategies; 

-  Directj  typically  short  raQse>  strategies  focused  on  the 
solution  of  particular  problems. 

-  Indirect;  typically  long  range,  strategies  which  emphasize 
'  the  building  of  resources  and  capabilities  for  condiacting 

^  education  KPU.    These  would  include  s^upport  for  fundamental 

research,  building  a  cadre  of  highly  qualified  personnel, 
and  building  general  purpose , dissemination  systems. 

Bach  set  of  strategies  requires  different  kinds  of  considerations 

in  d5J;err:lning  how  fundinf,  ^^houid  be  4>alanced  atiross  fuhctions. 

For  dire-c:  strategies,  as  described  by  Mason  and  N"elson,  it 
■ 

yo^iid  be  inappropriate  to  allocate  funds  by  KPU  functions  on  an 
a  priori  basis'.     Instead,  the  allocation  would  be  based,  first, 
on  tho  priority  pnoblem  areas  selected  by  Congress  or  by  the 
agency,  and _ then  on: 

(V)  the  state  of  the'srt  for  each  function  -.jithln  zh-d  area, 
and  (2)  whaC  the  or^anizatio'^ijpl  and  personnel  capaBil'ities 
of  the  KPU'  systein  are,  in  regard  to  each  of  the  functions  in 
that  area.    For  ex^nmple,  if  the  knowledge  base  is  well  (jc- 
veloped  but  there  are  few  curriculum  materials  which 
incorporate  whot  is  kno'-^m,   then  developnent  should  be 
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eniphasisedj  with  due  allouattci^  for  the  role  the  private  sector 
piay$  in  curriculum  development*     I£>  on  the  other  hand> 
proJuc:$  are  available  but  are  untestedj   then  evaluation  ;ind 
demonstration  are  called  for. 

Once  the  area  and  functions  have  been  specified,  it  next 
bococ,e$  necessary  to  exaaine  the  availability  of  perf  ornifrs . 
If  the  field  i$  such  'that  there  are  a  number  of  well- 
qualified  performers  (either  individuals  or  organizations) > 
then  ^oie  form  of  competitive  procurement  would  appear 
appropriate.     If,  on  the  other  hand>  there  are  few  capable 
perforTierSi  it  niay  be  necessary  to  cycle  back  into  a  long 
■rang'^  capacity  building  effort;  this  beeches  part  of  the 


;^irec:  iiratt^r^ies 
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In  s:;ort,  for  problem  solution  activities  >  the  allocation  is 
arrivEid  3t  after  considering  a  host  of  factors:     the  problem  area 
to  be  ^ackled,  hov  strong  the  existing  knowledge  base  of  eacl* 
functior;ar\area  is  with  regard  to  tackling  the  given  problem  area> 
hov  well  developed  the  institutional  and  personnel  base  of  the 
field  has  been  developed  with  regard  to  rneeting^  that  particular 
need,  etc. 

Indirect  strategies,  however^  have  been  treated  differently,  and 
here  3  priori  approaches  to  allocation  decisions  have  often  be^n 
made  —  for  instance,  the  l^CER  decision  to  allocate  20%  and  even- 
tually  30^  of  NIE's  budget  to  the  supporf  of  fundamental  research^ 
Allocations  to  resource  building  (e/g^,  building  capacity  in 
certain  kinds  of  institutions >  providing  training  programs,  de- 
velooing  dissemination  networks^  etc.)    are  often  difficult  td 
justify  because  they  ere  generally  not  linked  directly  to  the 
solution  of  particular  problens,  tfnB  mission  agencies  arc  problem 
oriented-    Therefore>  the  percentage  set-aside  (illustrated  by 
the  \TER  allocation  to  fundamental  research)  ^pfcof  ton  used  as  the 
only  s^ire  ueans  of  channelling  funds  to  rr-^source  building  require- 
rrtyits. 


those  who  support  thts  approach  tend  to  see  the  setting  of  funding 
levels  ''norc  or  iess  arbitrarily  as  a  percentage  o£  the  total 
effort"       a  reasonable  strategy,  no^different  from  arbitrarily 
determining  the  appropriate  percentage  of  total  effort  than  can  be 
allocated  to  an  inst itu  t i6n  *s  ^'overhead. Carrying* out  funda- 
.  mental  research -is  a  kipd  of  ^"overhead"  or  support  activity 
necessary  for  a  healthy  RiD  system^  just  as  the  existence  of  a^ 
strong  diss^emination  network  vo^ld  be, -or  the  provision  of  train- 
ing for  personnel*  or,  in  the  ca<;e  of  a  given  institution's 
overhead^  the  provision  of  an  admiriistrative  staff  or  a  typing 
pool. 

Kason  and  Kelson  " counter  with  the  suggesLion  that  thete  must  be  a 
better  way:    '*The  view  which  we  would  propose  is  that  it  is  possible 
to  increase  our  ability  to  make  intelligent  Allocations  of  funds 
for  indirect  strategies/'         \<hat  is  neede<i,  is  developing  a 
better  understanding  of  ''how  o^jr  institutional  and  hur?an  resources 
function  to  geneVat^^  and  utilize  new  knowledge. "  ^  ^    Xn  short, 
what  is  noede^^s  an  understanding  of  how  the  system  works  and 
the  gathering  of  the  kinds  of  data  needed  as  a  basis  for  sound 
policy  decisions. 

All  of  our. own  work  has  been  based  on  the  very  sane  premise-  We 
have  S'l^gested  at  several  points  ^in  this  chapter  what  some  of  the 
ren^iiTing  unanswerod  questions  art^.     In  this  concluding  section, 
we  brii'.g  ^together  sorr^e  of  these  points  about  funding  policy  Issues 
in  n*^., :  of  c;:;;^lorc:i^n,  ^nd  zhe  Uin^*^  of  d^-^t^.  tn^t  n-^e^V.        be  ^ 
fS^ithered  and  anal-'zcd  for  futar.-  policymaking  on  funding  iq,ques- 


1 ■    Current  Costo 

A.    ProblpiTt  Areas 

How  much  h'ls  it  been  co,«;tlTig  to  do  quality -educational  R/D&I 
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uQr'<>  in  different  functional  areas>  on  different  probl^;n  areas 
for  which  the  knowledge  base  is  more  or  less  well  d^veloj)ed> 
and  for  whlct\  the  institutional  and  personnel  resources  are 
stronger  or  weakor?  .  ^ 

A  few  cost  figures  exist  in  the  literature>  for  Jjjstiince .  tht 
costs  of  produci:^9^Sesa^le  Street>  the  KSF  Course  Content  Impro- 
vement Prograc,  and  tne  Far  West  Laboratory's  rriinicourses  (all  ^ 
referred  to  earlier  in  this  chapter).     But  clGarly>  there  is 
a  vide  range  of  .educational  r/D&I  work  that  has  been  funded > 
sore  of  it  has  produced  quality  outputs>  and  surely  there  nu5t 
be  a!  substant ial  anount  of  _funding  dat^  on  these  projects 
that  inight  help  us  develop  a  better"  understanding  of  cost 
requirements  (as  well  as  requirements  in  other  areas  such  as 
t'iTTie  >  personnelj  state  of  development  of  the  existing  knoT^-^ 
ledge  and  technology  base >  eCc.)- 

We  need  to  dev^^lop  a  clearer  sense  of  how  much  it  costs  to  do 
quality  work  of  different  kinds.     Sor*e  problem  areas  are^'boiTtKL, 
to  be  more  costly  than  others  —  because  of  the  state  of  . 
development  of  the  existing  knowledge  and  technology  base> 
because  of  the  kinds  of  K/p^l  activities  called  for  and  their 
scale>  etc*    We  need  to  develop  a  handle  on  these  cost  factors. 
The  data  are  there  in  funding  records.    But  they  hav<^  not  been 
analyzed  and  reported  on>  and  we  are  therefore  lacking  this 
basic  kind  of  information. 

 Fiipctioaal  Are^is 

Sinilarly>  the  same  kinds  of  data  should  be  able  to  sht^d  ^some 
light  oA  the  costs  that  have  been  iticurj^cd  acroBs  functional 
•area.H  (the  costs  of  fundamental  research  vs.  appFi^^  research 
v3 .  clevelopnient  >  etc  . ) . 


Thifi  becones  a  hit  more  difficult  to  aneily2C>  but  mip^h't  be 
approached  through  data  on  long-term  efforts  where  informei- 
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tion  e^is^s  on  the  costs  incurred  by  different  cj^mponents 
on  an  overall  effort.    For  instance^  it  might  be  difficult 
to  put 'a  cost  figure  on  the  body  of  fundamental  research  on 
which  IPI  was  based,  but  there  is  probably  good  data  on  how 
much  was  spent  on  applied  rea^arfeh,^  on  development^  on  fdeid- 
testing  and  evaluation^  on  irapleraentation  supports^  etc* 
Similarly,  the>cost  histories  of  many- of  the  other  outputs 
produced  by  educatiooal  R&D  performers  over  the  past  decade 
and  a  half  mi^ht  be  analyzed  in  similar  fashion^  to  shed  some 
light, on  the  cose  factors  for  different  functions.    We  have* 
so3^  idea  of  thea^e  cose  factors  from  other  fields,  but  no 
good  information  on  Ehi's  for  the  field  of  education* 

C.     Ingtltutional  Fgrformers 

Are  .certain  kinds  of  institutions  more  cost-effective  for 
carrying  out  certain  kinds  of  work?    Assuming  equal  quality  , 
were  possible  in  an  academic  institution  and  a  non-profit 
research  corporation^  would  it  be  less  expensive  to  mount  a 
major  research  program  in  one  rather  than  the  other?  It 
oighj:  be  assumed  that  because  of  existing  facilities  (libraries 
laboratories^^  concentrations  of  expertise^  etc.)  the  costs 
would  generally  be  less  in  a  university.    Is  this  in  fact  true? 
To  consider  another  e:ja|npJLe>  it  might  be  assumed  that^SL^.s 
are  probably  th^  best  srtes  for  mounting  major  dissemination 
efforts^  because  of  in-place  linkages  to  fhe'IEAs  who  are  the 
ulzl-^ate  targ-^t^  or  the  dissenlnation  strategies.    1;^  thi3 
tn;e?    Are  there  ways  of  determining  relative  costs  ,for  dis- 
senination  strategies  emanating  from  different  types  of 
inscitutibns?    Such  attempts  would  probably  break  ^wn  if 
the  analysis  were  carried  to  the  point  of  looking  for  relative 
cos*:?;  **f>or  njiiltof  effectiveness"  (hovever  that  might  bo 
measured  In  such  an  amorphous  area).    But  surely  there  is  a 
gr*eat  deal  of  data  thnt  mif;ht  be  analyzed  to  give  us  some 
handle  on  the  question *of  cost  variance  by  types  of  performer 
-organizations*  ^  ^ 
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2.   -Generic*  ^ac^ors  / 

■  / ,  , 

A.     Cost  DlEferences  By  Function  ,  i 

i  / 

We  suggested  earlier  in  this  chapter  that  there  are  inherent 
cost  differences  across  functional  areas.    Because  of  dif-  ^ 
ferences  in  the  scale  of  activities  generally  required > 
*  fundamental  research  tends  to  cost  considerably  less  than 
applied  research  which  costs  substantially  less  thaa  develop- 
:nent  KQrkj  etc.    We  considered  some  estimates  for  the  hard 
2L\z  soft  sciences  on  these  c^at  di: f-ersncials .     Is  it  possible 
,  Co  develop  nore  estimates,  from  a  wider  range  of  fields>  and>  * 
,within  education,  across  a  range  of  problem  aroas?    Even  iff 
the  estimaTes  developed  are  ^far  from  precise  for 'application 
to  educational  r/D5(I>  the  exercise  would  likely  shed  a^great 
deal  of  light  on-soirse  of,  the  factors  that  make  work  intone 
functional  area''taor§^ostiy  than  work  in  another*    At  some 
futu;re  tine  when  funding  estimates  are  needed  for  an  alloca- 
tion decision/  the  insight  gained  from  this  analysis  might 
.be  of  considerable  use.     Which  of  these  cost  factors-might 
be  expected  fto  be  operative  here>  and  w^at  night  this  suggest 
about  the  allocation  glecision  to  be  made? 


X 


B.     Rates  at  Which  Capacity  Can  Be  Ex^^anded  Per  I'unctional  Area 


We  3IS0  not^d  eaJlier  that  there  are  differences  among  func- 
tions  in  the  rate  at  which  their  institutional  and  personnel 
base  for  quality  work  can  be  expanded.    These  differences  are 
related  in  part  to  thcj  amount  of  time  it  takes  to  train  the' 
needed  personnel,  to  "establish  the  needed  ifistiiutional  struc" 
*  t'Xrefi  and  linkages,  to  build  up  a  usable  knowledge/technology 
bast,  etc.    Fundaniental  researchers  t^ko^  considerably  longer 
to  tr^in  than  applied  researchers,  .^nct  all  reses^rchers  tend 
to  require  more  training  than  development  specialists,  who 
in  turn  tend  to  take  longer  to  tr^in  to  a  hi^h' level  of  com- 
p^teno^i  than  dissemination  speci^ilists,  etc.    The  length  of 
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training  required  is  related-  to  the  amount  and  type. knowledge 
that  needs  to  be  absorbed, the  kig^s  of  skills,  and"  probably 
too  the  level  of  skill  that  defines  "competence"  <and  ''equality" 
in  each  functional  area, 

f  .  '  .  ' 

^  Coi^siderably  ^nore  information  is  i^eeded  to  put  more  precise 

numbers  to  these  statenfer^ts.     Soiije  insight  can       gained  from  - 
the^data'^on  these  questions  across  a  rai^ge  of  fields,*  But, 
in  particular,  we  need  to  exarnj:ne^^_4ieJ^aps  in  ■  re  trosp^ec  tive  / 
fashion  and  through  asses?;tnsnts^by  knowledgeables ,  how  long 

t        it  has  caken  quality  personnel  to  develop  cocnpetence,  in* 

J, 

different  functional  areas,  given  different  conditions  (e.g,: 

\ 

existence  of  formal  training  progVa^^s  vs;  geat-of-the-pants^ 
on-the-joV  learnii^g).    We  need  also  to  develop  estimates  of 
hoy  these  rates  might'  be  changed  by  pi:ovision  of  certS^  * 
coi^ditions  that  did  Tiot  exist  -  earlier^(e*^, ;    training  -  ' 
prograTns,  prof essional ization  of  KSD  specialties,  improved 
^  information  flows  of  vairious  kinds  including  existence  of 

new  specialized  journals  and  targetted  commtinication  programs, 
etc. ; . 

3,     Cortte;tti:al  Factors;    The  State  of "pLvelopmenc  of  Different 
Functional  Areas  in  the  Educational  R/D61  gystem  Today 

kinds  of  work  can  be  carried  out  in  the  quantity  require.d  to  meet 
needs  and  with  an  adequate  *  level  of  competence? 

For  vhai  kind?;  of  work,   in  what  problem  sreas,  is  there  a  strong 
know^ed^e  and  technology  base  chat  is '  alre^idy^sble''  to  support 
quality  R&D  activity? 

1  *- 
i'ineS  of  fundamental  research  s^how  J5t:rong  f>rQniise  of  having 
significant  implications  for  £*ducafion  but  need  considerably  more 
'yorV?  '  . 
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*^    ^       \whac  tfechnofogies  are  best  and-least  well  developed  for  the  conduct 
^  -ot  educational  R/D5(l?        *      ■  " 

■      •  ■  .3^.  ■  •■ ,  .-.  ■  ■. 

*    *  *'In  what  functional  areas  aod  on  .what  substantive  problem  areas  is 

*  thero  already  in  existence  " a  strong  irtstitutional  ^fwJ^f ersonneT    -  *  * 

base?    I-n  what  areas  does  the  Irfs  titutional  and  ^rspnnel  base  need' 
'   ^        To  be  strengthened?    Vhi<:h  of  £hese  r^pre^nt  the.^Kigt'iesi:  priority 
^  areas?  '  '  ^  '  .  ^ 

^   ,      Given  the  scale  of. the  existing  quality  base  in^ac^i  functional       •  , 

area  (and  perhaps  too  in  eScli  substantive  problem  area),  what  is  *  ^ 

i"  ^    '^^the^inimun  level  of  funding  required  to,tnaintain  that  existing 
Ij"*   '   .   *  live  1/ of  capacity?  »  ■  i  ' 

^.     What  is*th^^'evel  of  funding  currently  Icing  spent^  "pro^^jj^ively^' 

*       ^    .    in  .each  functional^  area  and  in-e^ch  priority  problem  .area?  (^His 

'  *iXl,*no  4oiibt,  require  assessments  by  panels  of  expert  judges  asked  # 

.^        r        ^    ^  ,  * 

j^t-O  distinguish  between  projects  that  have  and  have  not  -spent  their 
funding  productively.)  -      *  ^    (H|  *' 

ik*    Expanding  Capacity  ^  * 

Ht>w  long  is  it,  likely  to  t^e,  and  how  much  i$  it  li|;ely  to  cost;*,  ^. 


_  to"  expand  ^be^  base  of  qualijc^  jnstUtu'tions  ar^^personnel  in  each 
^,  fung/tional  area  l^o  various  specified  leve'ls  of  strength?  What 

^         ^        alternattvi;  strategies,  are  likely  to  hav6  what  effects',  at  what 


costs?* 


G  Lvt-n  the  existing  quality  ba^ie  in  each  functional  area  and,i:i 
eac'h-'.n^ijor  priority  problt^t^area,  and  estimates  of  the  rate  at 
1  ^vhich  thef<jualitii;  base  *ca^i  bei'texpai^ded  through  various  alternative 
^  strategies*  ^at  what  ra^te  can  the  funding  level  be  expa^ed  pwd«c^^ 


,  tiv^iy  in  ^ach  are.'v? 


-  •  ^i^t" » ■    *  ■ 

liven  v.iriati'ons  at^rosfe  fVinct,«ftu  area's  in'inl^rGnt  cost , require- ♦ 


2S       .    .  # 
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merits,  in  ths  anoimt  o£  capacity  buiia*«g  required,  in  the  inherent  * 
cost  and  time  r^equiremfents  of  -capacity  buildins,  and  in  the  rate,  at 
which  capacity  in  .each  can  be  exp^nde<^  while  ^till  maintaining  a 
hi^h  level  of  quality  (given  the  existing  institutional  anM  personnel 
base  in  educati-onal  R/D£tl),  "what  allocation  of  funding  across  Eun<;- 
tional  areas  would  seem  to  be  suggested  as  n^edecl  at  present  for  a 
helathy  aducatioi^l  R/D£tl  system  expariiding  at  a  reasonable  rate 
toward  greater  maturity  and  higher  levels  of  quality?  - 

,  ^ 

S.    Fur^d  ip^>  MuIti-Purr>nF:e  Procur^^ne^t:^  an'd  Agency  A^g^n's^,  and  " 

Need<^d  Analytical  ^io¥k  '  "  "  .  ^ 

t 

The  thrust  of  the  above  discussion  is"  heavily  oriented  toward  funding 

requirements  for  syste^n  c^gacity  building*    However,  mission  agencies 

must  focus  on  stJ^stantive  problem  solution  relevant^  to  agency  missions 

We  have  dealt  with  this  problem  elsewhere  and  sirtnmarized  our  analysis" 

in  a 'prwvioiis  Section  of  this  ^chapter  describing  the  Agency-Fleld^ 

Relation5*hips  policy  issue.    The -basic  point  we  tried  to.  make  in  that 

analysis  va.s'that  agenc^  actions  Cbo^h  procurements  and  other  non- 

procurement  <fction3)  should  be  planned^wrth  n^Mlt i-purposes  in  A^nd  — 

i,e*,^  that  whil*. funding  a  particular  program  to  solve  a  particular 

substantive  problem,  ic^rtain  kinds  of  planning  and  decision  making 

could  st^ructiirQ  what  is  done  so  that  capacity  building  and/or  environ- 

ment-imsro^ing  objectives  are  being  achieved  at  the  same  time  tend 

'through  the  same  projects  as  the  direct  support  of  problem  solution 
rj.     ■      *  * 

activities.  '      .  *  ,     ^  • 


UJttmately,  we  would  hop^^  that  a?'jC*ncy  planners  would  be  able  to^ake 
use  (either  implicitly' or  explicitly  and  concretely)  of  'a  mtilfi- 
dimensional  grid  type  cjf  "project  ^elc^ction  and  budget  plaJlning 
instrunent  that  vou^ld  focus  attention  on  three"^  factors:     (a)  sub- 

V  i  ■  V 

stfint,ive  /or  I  of  projc*cts  and  prugr?.f?s  (as  these  relate  to  agency 
Tni?)5ion3  ^n<l  priority  problem  areas)^     (b)  systen  capacity  building/ 
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c^pacitv  n^alntesji.'^nce^  re^^^ureinTants ;    and  (c)  the  existing  pattern 
of  funding  of  the  above  across  all  the  ^sponsors  of  educational  R/D^I 
activity."  "  ^  . 


Balance  acros^  diverse  requirements  nigt^  be  assessed  in  termi^  of 
how  well-  a  range  of  different  needs^  were  shown  to  "be  met  by  differont 
grid  patterns  produced  by  different  allocation  decisions  taken  or 
ptoposed^   .Inbaiances  might  be  Readily  pinpointed  through  such 
ins^ru::i£>nt,  asw^rfT^s  allocat^ion  shifts  needed  "to  bring  funding  bacJ^ 


Liito  ^^Txi^izsc  balance  '2\ 


arc3i^ . 


What  we  are  suggesting  ia^  clearly^  complex,  and  clearly  will  require* . 
a  considerable  amount  of  data  gaThering  anil""analyticaT  work  "before  "^^^ 
,   it  can  be  made  workable.    MVnetheless,  nftch  of  Xhe  data  already' 
t   ex'iits  in  one  f orni"  or  another,  of  should  exist  if  NIE^s  Educ^tiort 
KPU  Monitoring  Program  is  tc^  function  as  intended,     I-f  it  were 
possible  to  develop  such  *an  i^istr^inent,  it  w<xild  take.thi  field  a 
long  way  towacd  the  "bettor  way"  t^r  d^etmining  ttPw  to  allocate  ^ 
funding  a^ro.^s' func tion^l  areas^  (or  insti'tutionaL*perfonn^3  or  ^ 
■  other  system  elements)  called  for  by  Mason  ^nd  Nelson,    And  c.^^ply, 
ev^n  if  such  an  effort  sii^eeds  in  onl^*app,roaching  the  goal  of  pro- 
educing  jjuch  an  ins^runent,  "the  enterprise  should:sTied  ^  gre^t  deal^ 
of  light' on  sonie  of  -tjie  significant  unanswered  finding  policy  questions 
outlined  above..    And  , Coo,  the  kinds  of  thinKii^^^equired  and^the^ 
Kind  of  informafion  gatheredwould  likely  provide  the  field  with  a* 
V  great  de'al  of  new  insight  into  tlte  workings  of  the  educational  ^ 
systen  an<J  its  n'eedi.    Without  such  an  -approach,  much  of  thi 
systXim'^?  funding  policy  is  Jikely  to  continue  to  be^  made  oh  a  some- 
what ar^^^rary  ^and  cd  hoc  basis,  without  atiequ^te  consideration  of\ 
long-term  effects  on  educational  R/D&I  in  this  country- 
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to  disru^5i.the  :r,r|Liea"cion^  of  ti^e  rcDort  with  thi*n:;  only  on^^  such 
seminar  was  held;  *     _  '  * 

*  ^  + 

2  I ,        1 1  :>n<.i  1  ^^:ad'?r  ,  -^^^  Sc  i  enres ,  ran-J_^;i^nt_aj_J^^qoarclt  ■  nnd  the^  Process  c^f 

f:fr'J-:^Srl9J*'j  t^in-'^J  K*^p^>rt  of  t'u^  Co^ittt-f^^  on  Foodan^fnl  Researcli  Rele-  , 
vrint:  tv  Education,  A^s^onplv  of  !\^havvornl  and  Socin^  SriencA*  National^: 

■ 


V 


R^isearch  Council  Sara  B.  Kiesler  ArA  Charles  F.  Turner^  ecis» 
Wash'ln^t^n:  ■  NaS"/ 1977) 

22.    NatLu".^il  CoviHcH  on  *Lviucac1onal  Re^earch^  "NCKR  Pro^ran  Cor-^ittee 

R/joort,  an-}  Draf:  ^olicy  Research  on  Funjarit-nta I  Re^^earch  Relevant  \ 
to  Hducacif^n/'  (V;^,;;hi[igton:     NC!:":*,  July  1977). 

23*^    Michn^i  Rnc!nor>  Durvarjj  Hof?^^  and  Harriet  SpLnah>  Str^ggthcyinfi 

Fundanieiital  RGst^arch  Relevant  to  EducationyCEvanston^  Illinois:  '  ' 
Centtir  for  the  In:c'rdLsi:i?Ii^^iry  Study  Ol  Science  aiid  Technology^ 
^^'orthwc'SuCrh  tt^-iivi-rsi  ty  ^  1977) .  ' 

2\.  ^This  estimate  va??  provided       NIE's         Systein  S>jpport  Division  for 
tJ  '   a  revi^iv-d  version  c:  our  draft  raterials  £or  cht;  N'CER  report  to  ^ 
C6n'»;ri,>s?;  (see  draf:  of  Dece-ibr'r  1-^  1976).     Also  see:     KTE>  Tt^Jp. 
"Onzhb^^' >'^^  on /  c  1 1  ■  ,  p.  Jr4t^  and  ^."els^r.,  So-r^ers^  and  Mason^   1973  Veder- 

■ritl'^rL<il  Science  :  .  .r/6ation,  Nacior.it  Patterns  o-   RjO  ResourcGs>  Fun::^ 
a_nd  '^■^npLver  in  t'^, United  Sta^s  I953-I^J3^   (U'^ishiagton :     Governr-en ^ 
Prir^tiry  Office^  I?7i),*"  ■     "        "  ~  _  ^ 

.  '  *v 

26.    Nil,   1976  iJatabonk,  dp.  clt-  .  d.  3.  ^  " 

'27.    For  irstance>  see,  Co'^'^ittee  on  EconoTnic  Developnent ^  Innovation  In  , 
Educationi:     Mew  Dlreftions^  for  Che  American  School  '(N^tj  York:  CED> 
196^^;  CoTni^ttee  : -^r*  Econo'^ic  D^v^lopnent,  ^Ihe- Schools  and  the  Challenge, 
of  rnnovatxon  (Va;.-  Vork:    McGrav-Hill>  1969);     Hendrick  D.  Gideonse,  / 
El'^inf^PCj^  of  Natio-izl  Science'PoIicv:    A  Persi^ectivo  From  the  Sehcivioral^ 


and  S:>cI:iil/^ienC"'s Paper  submitted  to  the  Subcoznmi ttee  op  Science  Re- 
search =jnd  DaveTpor^ent  J  Corhittes  on.  Science  and  Astronautics*  U. 
House'of  RepT^e'ser.v^^ives*  S^pcenber  11>  19.70>  Reprinted  in  The  Oregon 
Studies  in  Educat  i^y>al*  Reseauch't' D^ve lotJfrent  ^  Diffusion,  and  Evaluaiion . 
Vo^^..II:     The  Lit'^rature  of  Educational  RDD&E>  Eette  C.  Portex>  ed. 
,    (MonWuth >  ^pregon :    Je^^iching  Resear<;hj  O^gfeon  State  Systeia  6i  Higher 
*  Ed'jcSt'ionj  LT72  )  Ltvi^ertj  ^'I£:  ,  pp .  ci  t .  >  p.  3. 

2s,   Ma$on  an^  i:%el^ofi">  '"A  C-onpari-scn  yf  ^ata  Bases 'Describing  federal  Funding 
of  ^dut,at^o,n  RSD>'*  op.  clt:       \'   ,  .  ■ 

29.  .Richard  DeiJ^binwr^  The  Federate Gov^rnir^ent  and  ^Educational  R!.D  (Lexin^- 
^  ton>  Mcis&i  *  Ley.lijgVon.  ?ooi«^  i^76)^.  pp 42*45> ,  84;  ,0E,  gducational  f.e- 
'  ^-^r-S  -tnd  Dea^f^:j^-/iri*'tt^,-'  Stnt>--s>  op.  cit..  pp.  ^Il't-li6. 

30.  OL,  ha-j;:^-3r4pri3>l  ^v^.-^Etfeh  'iad  J>4^i?i^jffienr 'in  tha  I'rtUred  St^^es.  op.  .cic.  > 
fii-.ii^, /table  17/'-  *  \--"^.'^\\    \  S  ~^ 


P2  .  ■  "0^,  ;  l<tnsi  f r,-: e^ r ^uH.      (^^ ^Di>'.^p^o >t ^ 1 1? (i  'Un  j t gd  S t>a ^ s    op .  j:  it 

*p.'  Ii3;/3a^.p.'  i>^/4^^»r^  *^e^f ^i'^^'jppolrt'  far  jftelfie^arch  "^nd  Deveiopnent 
.  *     i%  VAnzciV  lq^  ^^^sV^J^icV -V.r f  eot^^         .'^^a't7<Juai' ^oVteTy^  for  the  Study  of  gduca- 
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;    '  ^ion  Vearjook,  Levien,  NIE:    Prel ImnarvVPlan >  op.  cit* 

; 

33.  SdHi^^.  S^eber  and  Pa-il  J..i3arsfd*ld,  The  Or^anizfcjtion  ot  £4ucatj.onal 
Research  in  the  United  States  (New  York:     Bureau  *f  Applied  Social  Re- 

.  search,  ^olunbia  iJaivarsityj  1966). 

34. /^  Chase,  Tne  Maclgnal  Pro^rcHti  of  Educational  Laboratories  >  op ^  cl  t .  ;  / 

Bailay,  "Emergence  of  the  LabQratory  Program, op .  cat .  ;  Francis  S. 

Chas^,  *'R&D  in  the  TWa;iideling^  of  Education,*'  in  The  Oregon  Studies 

Voi.  lit  OD.  tit.  \  .  * 

1  —   — ■   

35.  For  instance,  see  Gideonse  >  Eleinents.  of  National  Science  Policy, 
ciy.  >  p.  119;  0£,  Zautatlonal  Research 'and  Developnent^  in  the  Uhlted 
Stacks ,  OP*  ciu.,  ?.  116;  and  D€rshirr.er,  The  Federal  Government  and 
Educational  r^^D>,  c?.  cj.t.  ,  p .   33 . 

.  •  .  ^-^ 

•C,'},     Oi>,         -T'- I^'-l;.!  "-"SP^rj":   '^..i^  Dgv'=lor"S:ar^t  jp  tha  'J'ii:e-d  States,  p3>.  eit.-  , 

p-  136.  :  ^ 

37.   "N^Is^on,   fior.ers,  a:id  Mason,   1975  Federal  Jundln^  ^  fQr  Education  KPA, 
'  op-  cic.  '  ■  ^  ■   -        "  ^  '   A-   -         -  ■  ■  .  , 

33.    See  our  chapter  on  educational  R/SfeX  institutions*  i  ' 

39.  fgr  sc-e  det^iiis  on  Lhis^  see  our  thapter  on  the  dissemination  function 
in  educational  R/DSI. 

40.  19'^6  Databook,  o?.  ctt .  ,  pp.  Tables  4.*3  and  A. 4. 

41.  For  ins'ance,  see:    Cna^e,  The  National  Progran  of  Educational  Labora" 
tor  ie^ ,  op.  cic . ;  Chass,  "The  Laboratories:     1970  and  Beyond,"^  op.  cit.; 
tra:*ci^  S.  Chase,  "The  Educational  Laboratories:    How  Do  They  Fit  into 
t'ne  Future  of.Arerican  Edutation,*^  in  Chase  >  The  ^'atlonal  ProE;ram  o£ 

f      Edi^catLional  Laboratories,  op.  r:it . ;  and  Francis  S*  Chase,  "Educational 
'  '         t      R&se^rch  and  Developp.en::  in  the  Sixties:    The  Mixed  Report  Card,''  in 
^   The  Oregon  StiKii^s>  Vgl  .  11,  op.  cit> 

42*  '  Levie#r;  :;iE:     Prelir.Lnay  Plan,  op-  cl^  ^ 

43*   VimlX^  :;eTe  Sone  exteption?  to  this.     Tne  most  iniportant  of  these  was  the 
OE  st,a:ys  report,  0£,  Ecucrftional  Research  and  Development  in  the  .United 
Stat^■^>  op.  etc.;  pp".  113-117.    Another  wars:    Mithael  W.  Ktrst>  "Tho 
4  '  Qr^vtr        Fe^.^ra"'  Tnfb:t^nc;e  in  Educ'fetion,"  in  the  1974  N^^.^  Ve/irbook. 

r  " 

U*^,     S^-e  ^c^.r^^a  cited  abovc>  in  toocnores  6  17.  .       -  ' 

4>.  *0r,  r^iL:c<:tional  Rese.-^^rch  k^A  Develop-iSnt  in  the  United  States^  op.  cit> 

*    pp.  llV-116. 

See  S^iic'wr"  TI-IE  tn  this  jch<iptt*r>  Tfi.'^pcscttitions  abo^it  LovgIr  of  Fund- ^ 

\\\%  ('♦rwcn  -  .  '  ■ 
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OS,  EdvcaclO[iaI  Research  and  DeveIor>fnent  in  the  United  Stiaties^  op. 
cit . >  p .  117 . 

AS.  Ibid. 


u 

A9.     Thi;>  estiiiuTte  was  provided  by  NIE's  R£D  Systen  Support  Division  for  a 

iffevised  version  of  our  draft  rnaterials^or  the  NICER  report  to  Congress 
(see  draft  of  Deceroer  14,  1976)  •    Also  ^e:    NI£>  1976  D.ataboQk>  op . 
ci t . ,  p.  16;  and  Nelson>  Son^ers,  and  Mason,  1975  Federal  Fundin;^  for 
Edacatlo-^.  KPA^  op.  cit. 

In  addicLoa  co  che  reasons  cited  by-  the  OE  analysts  for  believing  these 
figures  anderrepresented  the  einouncs  spent  on  educational  KW^hy  private 
founimiois,  private  indu3try,>  SEAs  >  LIAs  >  and  the  ttepartmeTit  of  Derense> 
the  or:  analysts  indicated  the  following:     '^455  of  1,72^  abstracts  from 
Sn,  iJjC,  OTd  NSF  reported  an  unknown  funding  level*    The  project  descrip- 
ti-'^"-  *: ^  .^V^'^s^  ir.dic^.te  that  th'^y  are  sn^^-ller  Chan  fiverage  in  %ize  Cfe'v 
of  c  Lj  c'^£trac:s  ror-  which  fu:iding_  Levels  were  unkno'^n,   for  exarr.ple,  were 
^    devel'v-'"^'^^^  efforts  or^iarge  scale  stnrveysiJ    Still>  if  the  actual  fund^ 
In^  levels  were  to  be  deterrined>  they  could  be  expected  to  add  a  con-  ^ 
iderab:^^  fHHft- to  ti^-r4rS^-a4-year  1968  totals."    0E>  Educational  Researcn 
\<1,  Dc'.-elopT^ent  in  the  L'nited  States,  op*  cit.  >  p.  117  • 

NIE^,  19.76  Databook,  op,  ci^t,>  p,  r6";  Melson,  Soners>  and  Mason,  1975 


Fed^r^l    funding  for  Education  RPU>  op.  tit, 

1976'  Da^abook,  .bp.  cit.  ;  p^  16, 

This  diSCf^ssion  is'^based  on:    Nelson>  Somers,  and,iMason>  1975  Federal 
Fundin^<  for  Education  KPU,  op .  cit .  ;  and  Mason  and  Nelson>  ''A  Compari- 
son of  j^ta  Bases  Describing  Federal  Funding  of  Education  R&D>"  oo .  cit. 

5^.     See  se^iun  I,    ''Overview  of  the  Available  Literature,*'  Part  2>  ''Data 
Serie^s  on  .Analyses  of  Larger,  Bodies  of  Funding  Data/* 


MrTSon  an':i  Nelson,  "A  Co:r*pariso'n  of  Uat^  Bases  Describing  Federal  Fund- 
ing of  Education  R&D,'*  o?.  cit.  Note:  '  The  6riginal  figure  in  the  Mason 
^  ^d  Neisbn  article  also  incWided  a'T>refix  table  on  information  provided 

in  :hie  rep^orts  of  ch6  Federal  Intera^^rncy  Conmitjtee  oi\  Educa  tion".  .How- 
ever, sin«e  the  FtiC^  reports  provide  no  funding  data>  i/^  have  excluded 
this  from  our  discussion  her^.^  ^ 

^6 .     In  fact,  sone  Jisse^iln/ition  and  demonstration  funding  is  included^  in  the 
^i^V  aazn  oas^,  Sin^c  the  ^SF  funding  fig^iiTes  ar^  ooiiected  :runi  agency 
self-rt:pAts>  officials  of-each  .igency  xieternine- wh^it  siiould  or  should 
mt  be  included  in  the  funding  totals  it  provides*     NIE>  for  instQnce> 
^7      '  inciu^ies  slL  of  its  activities  in  the  figure^  it  reports  to  NSF.  See 

^n  and  Nelson>        Coijipsrison  of  Delta  Ba^X^  Describi^g  Federal  Fund- 
'0*=  F.ducational  RLJ>,'*  op.  cit,     ,      "  ^    '  '  f 


The  rib^vt^  discu5^Lon  of  the  NAS  d.ita  base,  its  advaTitages  and  limitation?*, 
is  based  on  *Hason>  Nelson,  find  Somers;  Federal  Funding  for  Education 
Knowl-'L*^  Production  and  j;til'''^<Tt:ion:     KPU  Function,        Agency>  op^  cit. 

   ; 
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38-     The  jibove  dlscusslun  o£  the  NAS  data  b3se>  its  advintages  and  llmi- 

catiJni,  IS  based  on  Selsor*  and  Mason,  1975^  Fedor^il  Fundln,'^  for  E^m:a- 
'    io^  ■  Knovled^e  Production  and  Utiilsation:    Project:  Content  'and  Per- 
for"er>  ?>v    ^f;encyt  op.  cit.  '  ■  ^      ■  " 

39.     Neisorij  Sjrrters,  and  Mason  ^^975  Federal  Funding  ^for  Education  Knowledge 
ProdMCtlon  and  Utilization:     A  Conposite  Estimate,  By  A<^eacv>  Cslng 
-FoLT  Data  Bases  >  op.  cit . ;  and  Mason  and  Nelson,  "Federal  Funding  of 
Educarional  R&D:    RiD  Function  By  Agency/'  op.  cit. 

60,    This  S5i5  million  figi^re  is  close  to  the  upper  bounds        the  earlier 
estimate  niade  by  the  N^IE  RSD  Systecn  Support  Divisior^  in  the  1976  Data- 
^  .book.    The  earlie«r  estiaata  (nade  prior  to  the  do^^elopmen t  of  this  coni- 
posite  estir,ate)''was  that  $470  uiillion  was  the  Dost  likely  figure  for 
ft:t^c;ral  funding  of  educational  RSD,  with  a  lower  bound  for, that:  esti- 
nate  of  $430  million  ar.d  an  upper  bound  of  $520  million. 

\,\.^  ^^'^b^'-.ji  LC:i  in  thi-s  >ec:icn  on  fundiri^  dara^y  fi-nztiDr!  is  bastrc  on: 
Ma^on>'  ^relson,  a:>d  Soriei:s>  Federal  Funding  for  Education  Knowledge  Pr::- 
dujCLon  agd^Utilijlation:  .  KPU  Function.  By  Agency^  op.  cit.;  and  Hason 
and  ^elson>  "Federal^  Funding  of  Educa t iqfiJlifcpV    R&D  Function  Vy  Agency*' 
^  Qp-  cii^.     ,  '  , 


62.  NIE's  composite  data  base  Right:  h£ive  becnlfce  best  source  of  j.nfonna- 
ti:?n  of  federal  funding  of  e'ducational  R/D^YT    However,  use  of  tha^ 

-  '  ,  -data  bass  for  this  purpose  would  have,  required  codir^g  o£.inf ormation 

frpn  programs  not  included  in  the  NAS  data  base>  creatiOT  of  new  data  * 
tapes  >  e^tc.     Mq  as3;-Lne  this  yas  i^o:  dcJne  because  the  NIE  analysts  had 
■  ^     severely  limited  funds  to  carry  out  ^their  wcrk>  and  the  additional  costs 
'    might:  ri^ive  been  prohibitive. 

63.  The  cven;n^^lrmg  majority  of  the  funding  prograzis-  the  NIE  analysts  in-  ' 
eluded  in  their  data'^base  were^'those  the  NAS  toam  had  classified  in  the 
eduzA tioi  social  policy  area.    Of  $452.2  million  obligated  in  1975, 
$557.8  riillioa  (75?;)  w=re^  in  the  education  social  policy  area;  S39.9' 

"  nillion"  (107.)  were  in  science  education;  $22.4  million  (5^)  were  in 
health  edu-^ation;  $20.7  million  (5^)  were  irt  the  cultural  affairs  area; 
and  521.4  :niUion  (5%>  were  in  the  employment/manpower  area. 

hi^.  and  ^"eison>  ''Fedsral  Fundirlg^of  Educational  R£<D:     R£iD  Functionl 

by  \^^:y:y>'"  op',  cit.  y  Table  1.  / 

63.     The         sche^jei^n  .-olvcd  dlzhotimiziog  all  activities;  as  *it:her  ''Know- 

.Ir-i-^  '^rT'd:'.  ti^r."  or  ''i-'.-^cvl^d-^.o  A;5pi  ic^,:  lor*'*  and  t,tA3:^ifyiTr9  all  Aitlvi- 
tits  undtr  these  broad  heading,;?  into  _7  functions  and  M  subfunct ions . - 
ihc  "NI".  analysts  u.-ied  a  three-way  classification  scheme  (Knowledge  Pro- 
duc"i^j^i>  Problem  Solv£^r.^>  and  Ut  i  iizat  ion)^and  classified  activities 
jntj  the-  8  funct:ions  and  2^  sub-functions  shown  in  Fugure  6.3,  For  ex.- 
pLir.itioa^  ofVhy  a:id  how  NIE  nodi^ied  the  NAS  sch^fr*e>  s^^e  the  publica- 
>tior.^   pfr^iiH.'ired  by  th^  >;rE  Analysts.     Given  the  modifications  in  the^ata 
-    bns^-  'i-A  clxUf!?^iEitati^".-.  --^ide  by  the  N[F  lean,  tl^ere^'are  somi  diffei|niCGS 
betwei.\'^  tne  findinl^s  repcurted  by  N'TE  and  NAS. 
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66.     Ic  should       enp':yisized  chat,  although  chere  is  an  88%  overlap,  'the 
*  NA5  data  baSr  ui^^d  here  is  not  the  sane  as  the  NIJ:  composite  data  base 

we  cousiderdd  e^rliei:  in  s^eccion  III. 2,  "Distributiuii  of  Tocal  Educa- 
tional R/Dil  funding  by  Sources.*'    In  the  NIE  coniposite  ban,  DHKW 
o  accounted  for  82. A%  of  total        1975  federal  funding  of  educac ion  KPU . 

The  Lducation^  Division  of  DHIii;^  alone  accounted  for  69.9%  of  the  cotal, 
and  within  that  division,  OE  alone  accounted  for  51.5%        total  federal 
,  obligations  and  XIE  accounted  for  14. In  the  NAS  data  base  us^d  for 

the  part  of  the  funding  analysis  reporced  here,  DHEW  accounted*  for  only 
75%  of  the  cotal;  OE  accounted  for  5^%]  NIE  accounted  for  16^;  :;SF,  9K; 
the"  Public  Health  Service,  5%;  Defense  Departia^nc,  5%;  the  National  ^:n- 
dc3'.*Tnent  for  the  Humanities,  (^7,:^  and  the  .Assistant  Secretary  for  Educa- 
tion, See  Mason,  Nelson,  and  Soners,  Federal  Funding  for  Education 
Nnowledge  Production  and  l'Elliz;^cion:  KPU  Function,  Bv  Agency,  op.  cic. 
T^''^-          Co  I  ur\^-  1  (rf  1975  ^ct  ua^ob  1  I^^t  t  ion?5y . 

,  '      67.    .Sason  aqd  Nelsun>  ^'Federal  Fundif.g  of  Educational  EtSD:    RSD  Function  by 
Agency,"  op.   cit.  ,(  .  ■  " 

68.  This  figure  is  likely  to  have  decreased  since  FY  1975\^due  to  the  KCER 
resoli:tion  calling  for  a  deerphasising  of  de\'elopinent  activities.  See 
N^ationa^l  Couocii  on  Educational  Research,  Resolution  N'CER  G?  77-001, 

^  >f.irch  18,  1977, 

f  ■•_  ♦ 

69.  This- figure  is  likely  to  have  increased  since^  FY  1975,  due  to  the  ^IsCER 
resolution  ^calling  for  an  increase  in  NIE^'s  funding  of  fundamental  re- 
search relevant  to  education,  and' a  reseajich  ''set-aside^*^  of  2Q%  of  the 
XIE  budget  by  Fx  1979,  risir.;;  to  30;:  by  1985.  See  .N'a  t  iooai  Council 
on  Education;il  .Htsearch  ,^  Resolution  NCER  GP  77-002,  Sep^ecber  16,  1977. 

70.  Tac  table  sho:vS  that  3^.A%  of  the  funds  obligated  by  the  Assistant 
Secretary  for  Education  were  rjesearch:    This  is  due  priniarily  to  so^e  of* 
the  large  research  programs  conducted  by  the  National  Center  for  Educa-  y 
tion.  Statistics  which  has  b^en  included  under  the  jurisdiction  of  ct\e 
AssistSnt  Secretary  (e.g.,  the  National  Assessment  of  Dducafrional  Pro- 
gress ) .  '  '  .  '  ,  .  . 

71.  Our*  d  lsc\js?5ion  of  the  SRC  data  l^ase  and^its  limitationss^is' based  pri- 

narily  on  Nelson  and  Maso-n,   1975  Federil  Funding  £ojc  Education  f'now-* 

ied?^  Production  and  U&ilizacion:     Prqj^c't  ^Content  and  PeriDCmer,  By 

•  -    —   '  ■ — "  i— »  ^  ^  1 — —  

Agt-r.-:^,  op.  cit:  i 

72.  '  ,  p.  13*  Table  2.  ^       -      *  y 

73.  Ibid.,  pp.  29,  3!,  Tables  12  and  13. 

7^.     Ibid .  ,  p<   3S .         not^  there,  ''This  finding  contradicts  Cuba  and  Clark 
Cl9ii)  that  .th^^rf*' is  little  or  no  divi*fiion  of  labor  among  different 
^ki'n^S  of  KPl"  organizations.'*    The  "Cuba  and  Clnrk"  reference  is  to: 
Egon 'C.  Cuba  OTi  David  C.  Clark,  "The  Conf  ignrational  Pipripective:  A 
Xf!v;  View  of  Edu'c^it  ional  (Knovl  e-dge  Prodvjc<ioti  and  Utilization,"  Educn-' 
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tional  ?.fcsearcher  >  Vol.  4,  N'o .  A,   1975.     We  refer  to  Cuba  and  Clark's 
"cor.f ('durational  perspective"  In  several  chapters^\  of  our  analysis. 

73.     Nelson  and  >fason,   19^5  Federal  Funding  for  Education  Knowledge  Produc- 
tion ond  Utilisation:  .Project  Content  and  PerforHier^  By  A^ency^  0£. 
^     cit.  >  p.  ,'>6. 

76.  For  instance^  See:    NI£i  Request  for  Proposals^.for  a  Survey  of  Education- 
.   al  KD'J^E  Or$;anizations>  RFP  NIE-R-76-'00I7  (Washington:  KIE>  197^); 

Joann*^  Frankei>  Albert  D.  Biderman  and  Laure  H.  Sharp>  Pretest  Report: 
Regls<:rv  and  Survey  of  Research    Organizations  in  Educatior.  (Washington: 
Bureau  of  Social    Science  Research>  Inc»  ^  1977). 

77.  Erye,  Management  Policy  for  Institutional  Support  an^  Assessnent>  op. 
ci_t .  ,  p.  3. 

7:^.     Jir^^co  IVilchj  "lo-^ard  .\utor.o.T.y :     --'-Q'^  Polity  for  Lab^  ar.d  Centers,"  Edu- 
cational Researcher    Vol  /  1,  No.  5>  May  1972. 


79. 


We;lchj  ''Toward  Autonomy^"  op .  cit .  ,  suniniarizing  Frye  /  Manaaerr^etvt.  Policy 
for  Ii'Stitutional  Support  and  Assess:r:ent,  op.  cit.,  pp.  ^--5.  X 


80.  Frye,  Managenent  Policy  for  Institutional  Suppprt  and  AssessQent>  op . 
cit, ,  p .  8. ^/ 

/ 

81.  Ibid,  p.  16. 

Ibid  >  p.  19.  ^'ote:    There  are  various  lijtiitatioRS  on  what  can  Jegxti- 
'         matsly  be  paid  for  "using  the  independent  research  funds  and  the  manage- 
ment tee.    Thes'*  limitations  are  described  in  the  Frye  document. 

83.     Mason  >  Issues  Related  to  the  Transfer  of  the  R&D  CenV^r  end  Edocational 
Laboratory  Pro^rans 'to  the  ^^ational' Institute  of  Education,  op.  ci't. 

8A.    Mason  p:)inted  out  that  th^  financial  probleins  were  particularly  serious 
for  the^  regional  laburatoXles  becausn&  they  were  autonon^us  ini> ti  tu tions , 
less  serious  for  the  RSD  centers  because  they  were  sub^jnits  of^  academic 
insri tucion.'i  and  therefore  hrid  the  financial  resources  of  the  uni^rsi- 
ties  al  their  disposal.    Therefore,  R6D  centers  might  be  able  to  get 
adva::ce5  fro7>  their  universities  to  carry  out  research  that  would  later 
be  reimb'-^rsed  by  '.'J[£>  but  re^^lonal  Taboratories  woulS  not  have  &%:h"  a  * 
rescrv?  to  draw  on.'    Siailarlyj  in  a  slack  period  betwe^  contracts  the 
ur.t  .v^  aLies*^ wht  be  able  to  provi  i:^  i^on^^  funds  to  a=^^  :**z  the  R^D  Len- 
'    lorA.     The  regional!  laboratorie:.  ^  ho"jt;\/er,  would  have  no  such  financial 
vn:^^>r-^^  to  dmw  on»    Similarl/f  the  tinlversltlcs  night  pick  Lip  various 
indirect  costs  that  -^ould  not  cnne  out  of  ptTTgram  funds.     But  again,  the 
'  ■  Inb  ^Tcj  to  r  tes  would  n^t  have  a  source  of  funds  for  costs  of  this  kind. 


8p .     M^a ' J n ,   Issu^?;  k^iatpJ  to  the  Tra n_5fe_r  of  the  R&D  Center  ar>d  Educational 
Labo ra to ry  Pro_grar-,,  op .  cit.,        16;  + 

■t  \  " 

36.'    Caripb^^ll  et  il .  ,  R&D  FundLn^^,  Policies  of  the_  rcation^l  Inst  i  tiite  tf>f__Educa- 
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The  study  referred  to  here  was:    Albert:  Kiciermaa/jfad  Laarc  Sharp, 
The  Competitive  Evaluation  Research  Industry  ('^shington:     Bureau  of 
Social  Science  Research  ,  Iqc  . ,  ^^^)  ^  *         .  ^ 

Cari.I>beLl  et  al,,  RoD  Funding  PoJ-icies  pf  the  Natior^al  Institute  of 
Kduca cion,  op >  ^it . ,  pp,  56-57.  .      ,  ^  ^ 

[bjc!.  ,  pp.  57-58.  \       '        '   '  ^ 

IVJ^-  '  ?r-  '^^7,  '50,  62,  63.         "  ^ 
Ibid, ,  pp,  63-&i,  69, 

Ibid.  ,  pp.  13,  31,  63,  73,  78.  -  '      ,  ^ 

Ibid . ,  p.  76. 

Peter  H.  Rossi,  Asse^sir:^  In'stitutlonal  Capacity:     Sone  Considerations 
fron  the  CrafLlore       Qroanlzed  Social  Research^  Paper  prepared  for 
tha  RofD  System 'Support  Division,  N'atiohal  Institute  of '  Education> 
October  25,-  1975.       ■  ^  '  . 

Harriet  Spivak,  Michaal  Radnor >  Victor  D^Lugin,^  and  Barbara  Vilkomersofi, 
Qrj^ani^ational  Capabilities:    Design  of  ?i  Sprvey  Instrt^ent  to  Assess 
Or:;5TXizationaj.  Ca'pabilitieg  to  Porfom  Educational^  R/D&I  Activities, 
Vith  Field  Feedback  on  the  Instrument  Design  (Evanston:  ^  Center  for 
the  Interdisciplinary  Study  of  Science  find  Technology^  Nor'thwestern 
University>  i977f. 

/         •  ■  ■ 

The  NIE  project*  off icor  /ndicated  a  positive  res[)onse  to  the  instru-* 
tnent  design  and  pilot  ^st  irtdicated -above  in,  footnote  9&>  with  the 
possibility  of  the  instrument's  refinement  a;id  use  in  a  laper^cycle 
bf  the:  organizational  survey  of  the  Educational  KPO  Monitoring  Pro- 
gr?im.     However^  the  fi*rat  organizational  survey  took  considerably  I, 
longer  to  complete  than  had  or:iginally  been,  anticipated  and  there     ^  " 
ha^  been  no  later  cycVe  of  the  progran.    The  chances  of  there  being 
a  scDScquent  cycle  o^  the  program jfio  not  appear  to  be  very  strong 
p.s  of  noWf  though,  with  or  wiihouu  this  additional  set  of  i|:GTns 
to  ^issess  orgarri^atipnal  capabilities. 

IWSy  Research  , and  Development  Source  Sought  for  j^ducation  VJ^h  Systonf 
Stud  Les V  (Washington;    lllEj  1977),,    CISST  was  one  bf  several,  organiza^ 
tions  known  to  Ujs  vho  rMponded  co  this  "RoD 'Source  Sought"  procure- 
ment d.'^cument.  »  / 

ThiH'  obst^rvatior^  was  nadc  by  an  lllE  staff  member,  \^ho  headed  one  of 
.the  tnst  itute ' s 'tftanning  groups;. 
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102.     Susan  Duify  and  iNoel  iirennan ,  Status  Re[>orc  on  FI^  Internal  Memorand<fn 
by  XIE  £;taFf  studying  the  issue  of  Eield-initi5ted\^tudies  (W3shxngt/>n 
Nig,  August        1976).  '  , 
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1^3.     Ibid.  \  ^ 

,;  -  *  ■  > 

104.     It  should  be  ^^meifeerod  that  FY73  was  KIE's  first  year  of  operation 

and  that  therefore  the  ir^m^diate  funding  of  unsplicited  proposais  could  , 
not  be  expected.    The  Institute  nee^iad  this  period  to  est^lish  its 
policies  and  procedure3  with  respect  to  these  proposals*  issue  guide- 
lines, and  establi^  the  necessary  rev^ieW  nechanistns  and  the  field  '  ' 
neeJtiCi  a  certain  amount  of  time  to  respond  to  the  established  procedures. 

lOS-    T^is  ,c  tbif^  if  fro^  the  aprencjix  to  Daffy  and  Brcnnan,  Statua  Report  on 
Fis',  op.  cit. 

IQo^     Ibid.  ■  ,      \         '  ■ 

107-    Mational  Academy  of  Sciences  (Herbert  A.  Simon  e^  al .)  *  Social  and 

Behavlqral  Science  Programs  in  th3  National  Science  Foundation,  Final  ^ 
Report  of  the  Corrinittee  on  the  Social  Sciences*in  the  National  Scx^ce  ^ 
Foundation*  As&enbly  of  Behavioral  and  Social  Scien<yeSj  National 
Researcii  Council  (E^ashin^ton:    NAS*  1976)- 

103.    MarV;       Abramson  and  .ThonasKtC.  Glennan^  Grants  *and  Cont.racts  Policies 
,     for  Soc  lal  ^6D,  Draft  Paper,  Study  Project  on  Social  KGD  (^^'ashingtoa: 
National  Academy  of  Sciences/iiational  Research  Council*  October  1975), 

109,    Duffy  and  Brennan,  Status  Rep<ji^t:  on  FIS,  op>  cit.  ,  also  Susan  Duffy^ 
Wor'f^lng  Drafts  .ih  Progress  forj  FIS  Final  Report*  received  by  us 
August  -  September  19f6-  /    '  /  '  ' 

DuffX^  Brt^nnan*  "Status  Report  on  FI&^  op.  clt\ 

Ibid.  -  &  ^ 

Ibid.  \        ■  ^ 

Duffy,  Drafts  of  vQrk  Ln  progress,  op>  cit.  ^ 

JAL^,'         ■  .  ■  ■  *  ■ 

Duffy  and  Br^nnan*  "Status  Report  on  FiS*"  op.  cit.  '  ,  ^_ 

The  other  issue  involve^i  the  implications  of  tJiG  conrc/pt  of  "regionalism*' 
for  e-ciucat ional  R6D*  an  orientation  which  was  receiving  strong  backing 
in  Cou^^resjn  at  that  time.    The  rogionalis::i  analysis  v^is  taken  up  som^^ 
tin'3  aFtc?r  cKir  ctopletion  of  tl»c  A^oncy-Kield  Relationships  (FIS)  Issue*  * 
and  w-is' presented  in:    Dur'jjard  Hofler,^  Mich^iel  Radnor*  and  Har^et 
Spival'-p.  Regionalism  in  Educational  R/P^I;    A  Policy  Analysis  for  the 
National  In^titutf^  of  E:ducation,  (Evanstcyi;  ,^Cent(;r  for  tl^&  Interdis- 
ciplinar-y  Study  otf-Sclei^^  and  Technology,  KSrJjh'wostern  University,  vl977)  . 
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An  additional  sec  of  ^analyses  had  been  requcsced  by  KIE's^  Dissemination 
and  Resources  Croup,  to  assise  chem  in  the  planning  of  cheir  "D^issemina- 
cion  and  Feedforward  Syscem"  (the  name  was  lacer  changed  co  the  "R&D 
Exchange  Program") These  analyses  were  provided  under  a  separate"  ^- 
contract  and  were  published  in:  Michael  Radnor,  fiun^ard  Ho£ler  and 
Robert  Rich,  ^ds.  ,  Information  Dissemination  and  Exchange  for-  tducati  onal 
Innovations;  -Conceptual  and  Implementation  Issues  of  a  ReKionally-" 
Based  Nationwide  System  (Evanston:    Center  for  the  Interdisciplinary 
-    Study  of  Scienqe  an<J^  Technology,  Northwestern  University,  1977). 

117.  Radnor,  Spivak,  Hofler,  and  Yo,ung,  Agency/Field  Relationships  in  the  . 
Educational  R/:D£f I  System ^  op',  cit.    \\e  have  abstracted  from  this 
document  in  much  of  the  discussion "  that  follows.    We  have  also 
abstracted  segments  from  an  E:<;ecutive  Summary  of  the  Aj^ency/Field 
Relationships  analysis  prepared  by  Virgus  Streets,  th^n  a  member  of 
NiE's  planning  staff. 

118.  .See  especially  our  chapter  ori' envijronmental  influences  on  educational 

r/dsi.  ■  ■ 


119.    Office  of  the  Director,  National  Inst;j:tu*CQ  of  Education,  Study  of 

Fundamental  Research  Relevant  to  Education,  1  page  summary  o£  the  study 
request,  July  1976,  ^ 
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■NAS,  Fundamental  Research  and  the  Process  of  Education,  op.  cit.  The 
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138,    NCER  Program  Committee,  Report  and  Draft  Resolution  on  Fundamental 
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139.    Radnor,  Hofler,  and  Splvak,  Strenj;thening  FundameYital  Researcht  op,  clt. 
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1^0,    National  Council  on  Educational  Research^  Fundritaental  Research  Pselevant 
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TheT  pi^oject  repoMed  herein  was^perf orrned  *nder  Cgntract  if  NTE- 
C-* 400- 76- Olio  66r  the  National  Institute  of  Education^  Department 
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National  Institute  of  Education  should  be  inferred. 


583 


CHAPTER  SEVEN 


l^TORMATION-  FLOWS 


f 


V 


ERIC 


IKTOKMATION  FLOWS 


Coaclusions 


Pqflc 


I*      KPU  INFORMATION  FLOW  EXTERNAL  TO  THE 

OPERATIC  SYSTEM  V   -  '  -  '  X  589 

1*      The*  Relevaat  Litt^rattire  *  '   590 

A+    Anal^yses  from  the  Sociology  of  Science 

^ad  the  laformat^oa  Scieaces  -  7.+  +  590 

Bs    Empirical  Investigations  oLJciformation 

Flows  ia  Educatioa  ♦  ♦  ♦  r\  ,  59! 

C-    Analyses  of  laf ormatioa-Seekiag  Behavior 

in  the  Disciplines  and  in  Educat^Lon  %  *  592 

D*    Literature  on  ERIC  aad  Othsr  Forjaal 

AgeacieSj  Institutions  aad  Systems   593 

2-      KP  laformation  Flox^  Systems^*    Generic  Model  ■  -  594 

A-    Research  Areas  *  *  *  .j  ^   594 

B*  .  Social  Organizatioa  of  Research  Areas  -  ,  *  ^  *  -  595 
a+    Prerequisites  for  Emergeace  of  *^ 
Sociai*  Organizatioa  of  a 

^  Research  Area  *  *  /  ^  5^5 

'  tr.    Patterns  o^Social  Orgaaization   595 

c-     lavisitflfe  Colleges    596 

C.    Professional  Associatioa  Meetings  601 

D-    Primary  Publication  Outlets  603 

E*    Secondary  Publications  ^  *  * 

F*    Information  Seeking  Behaviors    605 

,  G,    Formal  Information  Systems  aod  Ageacies,   608 

H+    Summary  t  ;   6 10 

3+     .  K?  Information  Flows  in  Ejjucat^oa  \  +  +  +  +  611 

A+    Research  Areas   611 

B*    Social  Organization  .^f  Researchers   612 

C*    Information  Exchaog^  Surrounding 

AERA  Meetings  *   .  *   613< 

^   D,    Primary  Publication  Outlets   616 

E*    Secondaiy  Pubrllcatio as   620 

F+    0^/erview  of;  Information  Flow  Problems  

C-     Infornatio'n-Seeking  Behaviors   625 

H,    Informatioa  Systems  and  Agencies   627^ 


628 


Information  f Low  ~is  a  critical  element  ia  the  functioning  of  any  R/DitI 

systeai-     It  is  essential  to  the  development  of  a  cumulative  knowledge 

base  to  enhance  the  operations  Qf  each  separate  R/D£<I  function,  to  permit 

the  integration  of  r7d&I  activities  across  functions,  and  to  provide  the  . 

Ictnds  of  criticism  and  feedback  needed  to  improve  R/DSI  outputs-  ^  The 

literature  suggests  that  major  advances  in  the  knowledge  base  of  a  field 

'•1 

come  aboijt  through  the  formulation  of  new  theoretical  paradigms, 
foliow&d  by  infornation  exchange  amoRg  r^^searcHers  critiqulug  aad 
explorii^^  the  impl-ications  of  the  paradigas  and  looking  for  problems 
and  errors  in  need  of  revision  or  ways  to  apply  the  paradigms.  ^ 
Further,  it  appears  that  major  advances  are  rarely  made  by  individuals 

working  in  isolation^    More  ^often,  what  is  needed  is  a  critical  mass  of 

'  2 
talent  interacting,  either  in  the  same  organizational  setting  (micro 

level  information  flow)  or  through'well  established  commuEjication 

channels  in  the  field  as  a  whole  (macro  level  information\flow)  , 

information  flow  in  education  is  clearly  one  of  the  most  significant 
points  of  weakness  in  the,  f  ie Id 's^^basic  capability  for  advancement. 
We  have  come  across  information  flow  problems  in  our  analysis  of 
virtually  every  R/D£<I  function' we  have  considered  —  those  functions 
on  the  KP  and  the  KU  ends  of  , the  KPU  spect^m^  and  the  linkage  func- 
tions in  between,.   Our  analysis  suggests  that  several  kinds  of  inter"^ 
ventions  in  the  existing  patterns  of  information  exchange  could  provide 
leverage  for  improving  the  total  KPU  system  of  the  field.    We  explore 

'  some  of  these  in  this  chapter, -atter  presenting  our  analysis  of 
existing  patterns  of  information  flow  in  education  and  the  kinds  o£ 
problems  that  cliaract^ize  those  flows^.  , 

At  least  three  distinct  patterns  of  injfornation  exchange  need  to  be 
Considered  to  understand  information  flow  probl-emSj  and  attend^fift 
policy  and  managesient  issues,  in  education:    .(1)  KPU  information  flows 
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wichin  atid  among  R/jl^I  systems  extertial-  to  the  operating  system; 

^(2)  KPU  information  £16ws  within  the  operating  system;  and  (3)  KPU 

inforadtion  flows  between"*  exttjmal  R/D$I  and  Toperatiag  systems- 

/ 

We  discuss  the  latter  two  patterns  of  information  flow- elsewhere 
in  this  volume.    Our  chapter  on  the  dissemination  function  in 
educational  R/D$I  takes  note  of  many  of  the' weaknesses  In  infor-- 
matlon  flows  between  the  ^  and  KU  communities  in  edircafion*  And 
inform^ion  flows  within  the  operating  systefn  arc  given  some 
attsntion  In  our  chapter  on  the  inipjlementacion  and  utilisation 
functions  in  educational  R/D&I-  '  VJe  will  ^-therefore  restrict  our 
attention  in  this  chapter  to  the  KPU  information  flows  within  and 
among  r/D$I  systems  external  to  the  operating*system,*  v 


For  the  aiosi?  part,  this  entails  analysis  of  the"  exchanges  of  scien- 
tific information  iti  the  research  community*    Although  It  would  be 
useful  to  have  information  about  information  flows  among  develop- 
ment specialists,  or  dissemination  specialists,  or  change  agents> 
there  is  as  yet  little  in  the  way  of  organized'professlonal 
"communities"  or  networks  in  these  speciality  ar^as>  relatively 
weak  and  diffuse  information  exchange^ channels,  and  no  research  that 
we  have  been  able  to^  locate  on  information  flows  iti  these  profession- 
al communities.    There  is  a  clear  need  for  research  of  this  kind. 
However,  for  the  present,  we  will  attempt*  to  synthesize  only  the 

*  literature  that  is  already  available,  and  'therefore  the  narrowing 
of  our  subject  matter  should  be  clear  to  the  reader.    We  will  be 

*'alluc3ing  to  the  broader  donj^ln  but  focusing  here  on  info#mation  flow^. 
in  the  research  corrnunity. 


 t—    '  ^ 

*In  a  subsequent  draft  of  this  chapter  already  In  preparation^  we  will 
be  *^ealing  with  the  broader  topic  of ^information  flows:  Including 
information  flows  among  R/D&I  specialities ^ther  than  research  and  also 
^covering  information  flows  within  the  o^perating 'system  and  , between  the 
practic^*and  R&D  coisimunities^    Much  of  the  material  presented  here  is  in 
summary^  form  in  the  current  draft.  ' 

  '^^^  — — 
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I.      KPU  INPORiHAtlON  FLOW  EXTERNAL  TO  TUE  OPERATI^:C^  SYSTEM 


We  include  uader  this  heading  all  information  flows  that  impinge  on  the 
need  identification,  research,  development,  aud  evaluation  operations  , 
that  take  plac^in  KP  organizations  external  to  the  operatjj^  system., 
for  ease  of  presentation,  we  }Ae  the  teritu?  **researchtirs**  and  ^'research^* 
as  shorthand  references  to  all  personnel  and /functions  on  the  production 
end  of  the  KPU  spectrum.    Therefore,  when  we  write,  for  instance,  about, 
the  social  organization  of  '^researchers,"  or  ab'out  information-seeking 
beha^viors  of  '^researchers we  are  in  fat:t  rtiferriag  not  otiiy  to  those 

identify  themselves  as  researchers  but  also  to  dev^opers  and  the 
evaluators  who  work:  with  researchers  and  developer^  in  product  design, 
testing,  and  refinement.    Similarly,  when  we  consider  *Vesearch**  areas, 
we  ar^  including  here  not  only  topics  or  problenis  actively  pursued  by 
researchers  but  developers  and  RficQi  evaluators,  as  well. 

In  generic  terms,  information  flow  systems  in  all  knowledge-producing 
fields  (particularly  scholarly  fields)  can  be  described  in  terms  of  the 
following  eletaents  and  their  interrelationships:     (A)  the  research  areas 
that  make  up  the  active  research  front  of  knowledge  production  in  the 
field  J  (B)^the  social  organization  of  reseai^chers  working  in  each 
research  area;  (C)  inf orta^ion  exchange  surrounding  professional 
association  meetings;  (D)  the  primary  publication  outlets  of  a  field; 
(E)  the  secondary  publications  that  facilitate  synthesis  of  new 
knowledge  and  retrieval  of  written  sources  of  information;  (F)  the 
inftirmat ion- seeking  behaviors  of  researchers  in  attempting  to  meet  . 
their  information  nee<is;  and  (G)  formal  information  systems  and 
agencies  established  to  acquire,  store,  and  permit  i;etrieval  of  . 
information,^    The  literature  is  .highly  suggestive  about  what  eac1i  of 
th^se  elements  might  look  like  in  an  idealized  KP  information  flow 
system,' and  how  far  from  that  ideal  information  flow  is,  in  education 
as  well  as  in  other  se'ctors.  ' 
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The  Rerevant  Liltieratmre 


A  well  devePoped,  cumulative,  highly  useful  literature  on  inEormatiun 
flow  systems  appeared  in  the  late  I960$''and  early  1970s.'  Froia  this 
literature,  we  can  get  a  very  clear  sense  of  how  information  flows  in 
highly  developed  scholarly  disciplines  such  as  the  physical  scieuceSj 
and  what  some  of  the  key  weaknesses  are  in  the  patterns  of  information 
£low  that  characterize  other  fields  of  study  such  as  education.  We 
have  found    four  bodies  of  literature  particularly  helpful  for  our 
analysis. 

A.    Analyses  from  the  Sociology  oE  Science  and  the  Information 
Sciences 

,    A  fasci^afing  literature  appeared  in  the  1960s  on  the  growth 

and  declirfe  of  research  areas  and  the  patterns  of  social  relation- 
ships amon§  researchers  that 'Accompany  the  emergence^  development, 
and  lacer  decline  of  a  research  area.    The  seminal  work  here  was 

Kuhn*s  The  Structure  of  Scientific  Revolutions  which  first 
3 

appeared  in  1962.     This  study  stimulated  research  on  the  social 
structure  of  scientific  fields  and  technologies  and  the  various 
kinds  of  communication  mechanisms  (both  fortnal  and  especially 
informal)  which  facilitate  information  flows  and  provide  quality 
control  in  the  cumulative  development  of  the  knowledge  base  of 
a     field.    Some  of  the  most  exciting  work  in  this  area  was  done 
■    on  fexploring  the  phenomenon  of  **invisible  colleges**  as  a  particu- 
larly effective'  form  of  social  and  communication  structure 
approached  in  varying  degrees  by  different  research  areas. 

In  addition  to  the  emphasis  in  much  of  this  "work  on'  the 
importance  of  the  informal  communication'  mechanisms       a  field, 
^       a  good^deal  of  empiricol  work  was  also  focused  on  the  formal 

communication  mechanisms  of  a  field,  particularly  its  association 
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[needing^  and  jourtial  outLets.  Most  C?f  this  body  of  research  was 
done  by  Garvey  ahd  his  associates  at  JohnMopklns  University  who 

studied  the  .functioning  of  scientists  ?fid  engin^sers  in  nine 

'  5 
disciplines  Or  fi(ilds  .of  study^  inc  luding.  educat  ion,      Tha  work 

of  the  Hopkins  group  is  especially  interesting  because  it  "pro- 
vides comparative  data  and  a  comparative  perspective  across 
dif£e?^eRt  fields, 

B>      Empirical  Investigations  of  Information  Flows  in  Education 

The  American  H;ducational  Research  Association  (AERA)  pla^^ed  a 
major  role  in  the  late  1960s  ^nd  early  I970^in  promoting  ^ 
apcnsoringj  and  serving  as  a  forum  fcjr;  analyses  of*  information 
flows  and  communication'nfetworks  in  educational  research.  This 
seeras  to  have  reflected  the  interest  of  t?he  AERA  leadership  at 
that  tim^  in  stimylatir^g  the  (ievelopment  of  the  field  of  edu-' 
cation  in  the  direction  of  the  scholarly  disciplines,  AER\ 
scateCTenta  have  taken  note  of  the  sigaificant  applied  component 
in  much  of  educational  research,  and  the  aseociation  has  taken 

pains  to  describe  -itjelf  in  terms  of  the  D  as  well  as  the  R  in 

6  ^  '  •  *  , 

*'R6tD-"      Still,  the  AERA  viewpoint  implicit  in  its  publications 

on  information  fl^  seems  to  reflect  the  suggestion  by  a 

discussion  in  one  AERA  symposium  that  the  field  should<try  to 

act  like  VQiscipline  even  if  it  is  not  one.  f 

Much  of  the  literature  on  ^Information  flow  in  education  was 
published  by  the  AERA  (particularly  in  its  3ournal>    The  Educa- 
tional Rcsaa.i:cher  and  the  American  Educational  Research  Journal) 
And  too,  much  of  the  research  that  has  been  conducted*  on  the 
topic  h^s  .come  about  through  Che  active^Qooperation  of  the  AERA 
or  the  activities  of  som^  of  its  work  groups  (for  instance,  its 
Subcommittee  on'an  Abstract  and  Intonation  Retrieval  System  for 
Educational  Researchers)'.      The  AERi\  was  one  of  the  nine  pro- 
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fessioaal 'associ<i,tions  tg  joia  ia  the  study  o£  Garvey  aad  his 

associates  at  Johas* Hopkias *    Aad* several  of  the  analyses  that 

have  appeared  are  based  on  research  doae  oa  the  Al^EltV's  l96S 

10  ^ 

aauyal  meeting  aad  the  research  presented  there.  l^elson, 
who  was  a  mej:ifaer  of  the  Garvey 'research  team,  pro<}ticed  several  * 
pieces  oa  this  research  as  well  as  additional  studies  oa  t^e  * 
fieldis  jouraals  aad  iaformatioa^seeking  behaviors,  aad^  then 
coatinued  to  publish  thSu^ht-provdkiag  pieces  ia  jihe  Educatioaal 

ses  of  U 
,  the^P 

pieces"  that  brought  together  the  work  doae  on  infortnatiou  flow 

ia  other  fields  with  ^^he  work  done  by  the  Garvey  group,  as 

well  as  a  discussioa  of  the  "iavisible  college"  idea  as  it-' 

might  apply-to  education)  aad  some  overview  pieces  suggesting 

that  at  that  Xirae  the  AERA  was  coasidering  moving  ia  the  direc- 

tioa  of  more  active  iatellectual  as  well  as  political  leadership 
12  ' 

of  the  field-       We  shall  consider  all  of  this  literature  in 

+  f 

some  detail  in  our  presenta tioa*  ^ 


Researcher    oa  the  ueakaesses  of  t^he  field's  commuaicat ioa 
nechar,Isns  *        In  addition,   LhG"tC£Ri\  published  a  syaposi*jm  of 


C>      Aaalyses  of  Infomation-Seekiaa  Behavior  in  the  Discipliaes 
and  ih  Educatioa 

Several  aaalyses  have  beea  published  about  how  researchers  go 

about  seekiag  iafomatioa,  their  iaformatioa  aeeds  aad  iaformatioa 

seeking  styles,  and  the  implircatioas  of  all  this  for  iastitut ioas, 

+ 

ageacies  aad  formal  iaformatioa  systems  established  to  permit 
acquisitioa,  storage j  and  retrieval  of  aeedpd  iaformatioa, 

Q 

The  b^st  single 'source  oajaVl  of  this  is  a  review,  article  by 

Craati,^^  who  came  frohivSwUs  Hopkias  aad  who  lias  herself  con- 

tcibytcd  several  importaat  pieces  of  research  ia  this  area 

14 

including  a  volume  on  invisible  colleges.       What  makes  the 
Craae  reviev  pant icu lady  helpful  is  that  it  aot  only  provides 
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an  overview  of  the  Ht^ature  on  information-seeking  behaviors 
but  also  synthesizes  it  with  the  material  on  the  growth  of 
research  areas",  the  social  organization  of  research  areas,  aytd 
formal'and  informal  communication  mechanisms*    For  tis,  it  was 
clearly  the  single  most  helpf ul/sotirce  in  the  v^ole  literature 
on  information^f low,    ■  _     .  ^ 

In  addition  to  Crane's  analysis, -there  are  several  other  pieces 
in  the  literature  on  informatiki-seeklng  and  inf ornfation  needs, 

including  sone  particularly  focused  on  educational  researchers 

16  .  *  ' 

and  practitioners  *         "  * 

i  * 

D>      Literature  on  ERIC  and  Other  Formal  ]foforma-tion  Agencies, 
fflistltutioas,  arid  Systems 

The  field  of  infornia^^iorrscience  produces  3f  good'^deal"  of  litera 

ture  for  its  own  internal  ci^nsumption ;  it  has  even  reached  the 

stage  of  development  where  the  f ieldtproduces  ah  annual  review* 

volume  of  the  state  of  knowledge  on  different  key  topi^s*^^ 

Some  of  the  literature  is  helpful  £or  pr.oviding  Insight  into 

some  of  the  generic-issues  of  information  flow  that  plagiue 

libraries,  coniputerized  information  rjetrteval  systems,  and 

other  agencies  and  mechanisms  that  have  beei>-establ  ished  to  ^ 

18 

facilitate  information  flow*       The  ERIC  system  has  "produced 
a  large , literature  about  itself,  and  some  of  this  is  also 
useful  for  identifying  some  of  the  iri€or[natlon  flow  pro"blems 
that  continue  to  be  troublesome  for  educational  KPLf  iis^^^te  the 
vast  ir.vestmenc  of  "resources  chat  has  been  mad^  ^^.-^^^^i^**^ 

Ifi  the  Sections  which  follow,  we  will  siiinmar^.^e  ^what  we  have 
learned'from  all  this  literature       about  information  flow 
in  education  and  in  other  fields  —  ^d  we  will  consider  a 
numbeV  of  pos*;i^ble  policy  and  Research  implications,  | 
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2.    ,  KP  iT^ormatioa  .Flow  Systems:    Generic  Model 

A.  ^  ^  Research'  Areas  f ,  " 

"    ,  Theoretically^  aay  field  of  knowledge  production-  is  divisible    '  ' 
ia^  a  aumber  of  actively  pursued  researcfi  areas ,  each  deflaed 
as  "a  set  of  closely  related  problems  that  ''is  viei-^d  by  sciea-  ' 

70" 

tists  who  study  them  as  a  discrete  eatity/'"     The  research 
froat  of  a'particular  field  of  kaowledge  at  a  givea  [Soiat  ia 
time  may  be  made  up  of  huadreds  of  such  disciact  research  ^ 
areaSj  liaked  at  vAious  points  of  overlap  t^here  We  research 
area  is  drawfc  oa  in  exploriag  aaother,  etc.  Hypotheticallyj 
'  it  should  be  possible  to  map  these  research  areas,  showiag  how  ^ 
closely  or  dist^atly  related  they  are^.oae  to  aaother,  where  the 
poifits  of  overlap  are ,  aad  how  the  reseai'ch  areas'  of  oae  field 
draw  oa  (aad  therefore  overlap  with  maps  of)  the  researc'h  areas 
that  fall  primarily  within  other  fields.    The  liitkages  aad  areas 
of  overlap  caij  be  determiaed  by  aaalysis  of  citatioas  aad  '  . 
patteras  of  iaformal 'commuaicatioa  among  researches  tryiag  to 
ind' aad  exchange  iafbrmatioa. 

Research  areas  are  dynamic       coastantly  chaagiag,  appeariag  anew, 
growiagj  decliai|gg..   At  aay  oae  poiat  ia  time,  a  map  of  the  research 
*areas  of  a  given  field  might  iaclude  some  at  each  stage  in  th^ 
research  area  life  cycle  of  slow  growth^  expoaeatiaj.  growth, 
liaear  growth/  aad^i:adual  decline,-  *    The  stage  reached  ia  the 
life  cyq'ts^f  ari^'^'particular  research  area  is  determiaeTS  by 
aaalyzin^  for  ^^j^  year  the  aumber  of  acw  ptiblicagioas  and  th^> 
cyjmber  of  researchers  publisliiag  for  the  firiJ^ime  ,ia  the 
^We'scarch  area. 


/ 
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Social  Organizatiion  o£  RL*search  Areas  ^ 

Prerequisites  for  Emergence  of. Social  Qrgdnizatidn  Kjf 
a  Research  Area 

The  concept  of  a  research  area  is  tied  inextricably  to  the 
notiorj^of  the  s6cial  organization  of  a  resrearch  area.  A 
social  system  of  informal  communication  networks  emerges 
a^' a  research  area  experiences  rapid  growth*    As' described 
in  ::he  literature:  ,  -     ,  ' 

,  I  " 

Growth  of  an  area  is  stimulated  by  intriguing  findings 
oiffby  a  new  and  untested  theoretical  model  *  *   .  * 
TheOT  ideas  attract  scientists  to  the  researcher  area, 
which  begins  to  expand  rapidly  in  terms  of  publica- 
tions and  authors.    A  few  highly  productive  scien- 
tists set  priorities  for  research , .recruit  and 
tj^ain  students,  and  maintain  informal  communication 
contacts  with  other  members  of  the  area*    As  the 
mplications  of  the  seminal  ideas  are  exhausted  or 
beccjme  increasingly 'difficult  to  test>  new  scien- 
tists are  less  likely  to  eiiter  tlje  area  and  old 
members  are  likely  to  drop  out;  this  leads  to  the  — 
gradual  ciecline  of  the  ^ize  of  the  membership  area.^^ 

The  prerequisites  for  the  emergence  of  such  a  sdcial  system 
appear  to  be  institutionalization  of  the  research  role, 
rapid  growth  of  the 'research  area,  and  social  contacts 
among  researchers*    Wherever  a  significant  amount  of 
^  ^  social  contactg^nd  informal  communication  develap  among 
researchers  working  in  a  given  research  area,  it  becomes 
possible  to  talk  about  th^  social  organisation  of  a  research 

f'  >  23 
  nd'  the  existence  of  a  "research  community"  tied 

tog^her  by  a  set  of  intellectual  problems. 


b.   ^  Patterns  of  Social  Qrsanisation 

:  '  '  ,  ■  4  • 

Several  patterns  of  social  organization  have  been  delineated 
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,within  research'  areas  —  e*g,  :    ''social  ci3:cies,/\  wi th 

vague  boundaries  and  no  fdrmal' leadership  but  much  irtdirect 

influence^nd  interaction  within  the  circle;  "solidarity  * 

groups/*  ^ch  as  a  teacher  and  fiis  students^nd  collaborators 

"highly  coherent  groups,"  such  as  a  school  of  thought'that 

is  ^trying  to  overthrow  the  dominant  positioiv^in  a  discipline^ 

or  research  area;  "loose  cotnmunicatign  networking,'*  where 

scientists  have  various  kinds  of  loose  ties  sand  contacts 

24 

with  researchers  in  their  own  arid  other  research  areas. 

The  one  pattern'that  has  excited  the  most  interest  is  the 

most  highly  developed  ctf  the  forms  of  sicia^  organisation, 

25 

the  "invisible  college-"      s  A 

a       .  .  ' 

c>      Invisible  Colleges  '  ^ 


An  invisib^*  college  is  described  generally  as  a  relatively 
small  group  (100  members  at  most)  of  eminent,  productive 
scientists  in  a  research  area,  who  tnaintain  frequ^t*  in- 
formal contact  with  one  another  through  such'  ragans  as 

preprint  exchanges  and  participating  in  the  same  "cotnmu- 

26 

ting  circuit  at  meetings  and  collaborative  projects. 

i 

Within  any  invisible  college;  we  tend  to  find  a  hetero- 
geneous social  organization  made  up'of  ^  few  stars  sur- 

*  -       If-  .  ' 

rounded  by  a^larger  number  of  deraistars  and  satellites/ 

Included  nfay  be  not  only  active  knowledge  producers, 

knowledge  synthesizers,-  individuals  who  serve  the  group 

politically  or-admittlstratively  (e.g.;  *  in  NIE  or  AERA)  ,  and 

various  others' characterized  as  troubadours  (carriers  oZ 

up-to-date  news  and  gossip  through  the  college)  and  scouts 
'  •  '  27- 

(knowledge  providers)*    ''They  reviei^  each  otTier's  books 
and  referee  each  otTier's  articles,- thereby  assuring  the 
'publication  of  these  works,  even  when  the  manuscript  is  , 
submitted  with  the  author's  name .removed .    This  happens 
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because  they  ghare  the  same  pattern  of  thinking,  the -same 

*  jargon,  the  same  methods,  etc*,  "and  therefore  find  each 

Other's  vjork  total ly  ^acceptable ,  and  generally  moresjo' 

than  the  work  of  another  author  who  uses  different  Jargon, 

methods^  etc*    Often  they  received  the  same  training  at; 

the  same  universities  (characteristically"  ".st^arting  at  a  , 

major  university  unfier  the  sponsorship  of  a  major  figure 

in  the  field''),      and  therefore  the  invisible  college  / 

functions  somewhat  in  the  manner  of  an  *^old  boy  network, 

.wither  without  intent.    Members  of  the  ir.visible  college; 

*  ^ 

know  each  other,  atid  they  respe<^t  each  other^s  work  and  ^ 
capabilities  I    They  further  each' other's  influence* through 
recommending  one  another  for  ©pernings  on  editorial  boards, 
advisory  .groups ,  or  review  panel-s,  or  for  positions  as 
consultants*    And  of  some  significance  in  identifylng^a 
specific  invisible  college,  they  cite  each  other'd  work 
aud"  build. on  each  other^s  findings 

» ^» 

There  have  beea  ^omief.methodolbgical  problems  in  identifying- 

'  '29 
actual  invisible  colleges  in  many  fields*       It  is  unclear  . 

whether  that  should  Be  interpreted  to  mean  that  they  do 

not  in.  fact  exist^.in'^thes.e  fields,  or  that  they  exist  but 

the  methodology  for  identifying  them  is  ngt^et  sufficiently 

developed*    Regardless,  the  question  o£  importance  to 

policy  makers  mAy  not  be  so  much  whether  they  already^ 

exist  In  a  given  field,  but  whether  it  is  poss^le,  to 

create  them  by  active  policy^  intervention*    The  importance 

of  this  question  cannot  be  oyereik:imated:     for  achieving 

■    .   ^  ^  \ 

the-basic  goals  of  any  knowledge  producing  field ^  the 

Invisible  college  mechanism  is  far  superior  to  any  other 

form  of  social  oi^ganlz^atlon  operating  in  research  areas* 

To  develop  a  high  quality ^kfiowledgfe  base  as  rapidly  as 
possible,,  cumulative  knowledge  production  is  essential. 
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A  few  najor  advances  in  a  field  may  seem  unrelati^d  to  / 
all  that  has  gone  before,  but  the  great  bulk  of  knowledge^, 
production  in  a  field  builds  cumulatively  on  previous 
worU*     (Even  the  major  advances  when  studied  carefully 
enough  are  likely  to  show  the  influence  of  earlier  tbexrfl^ing 
.ot  empirical  investigation*)    Each  research  area,  therefore, 
needs  integrative  mechanlsois  that  function  to  place  and 
keep  the  researcher  in  touch  with  all  relevant  work  that 
has  preceded  him  and  all  that  is  ^oing  on  at         same  time 
elsewhere*  ^ 

* 

The  invisible  college  of  ^  resefarch  area  is  made  up  o£ 
those  researchers,  %till  actively  producing,  whose  work 

fshaped  the  definition  of  the  area  end  the  problems  of 
concern  to  Chose  working  in  it*    They  are  t)ioroughly 
familiar  with  aXl  the  work  produced  by  themselves  and  their 
colleagues  and  the  leasers  of  the  research  area  who  preceded 

.them-    One  assumes,  then,  they  could  easily  quote  chapter 

a^d  verse  to  anyone  in  J^sd  of  readily  identifying  the 

research  area's  seminal  works,  major  theoretical  pieces, 

key  empirical  investigations,  and  explorations  of  f^roblems, 

* 

implications ,  applications ,  etc*,  or  to  anjrone  seeking 
^to  locate  portions  of  that  curauiative  knoi^ledge.  b^se  relevant 
to  a  given  problem.  * 

Through  the  day-lftr-day  communication  that  flows  through  the 
invisible  college,  menders  also  ajre  fami^liar  with  work  in  / 
progress  throughout  the  research  area       who  is  working 
with  whom,  where,  on  what  questions,  usihg  what  approaches, 
with  whose  funding,  and  with  what  results,  ConsequentTy, 
Members  of  the  invisible  college  are  not  only  excellent 
soutces  of  information 'themselves,  but  serve  an  iraf>ortant 
function  in  ch6nneling  inquiries  to  other  sources,  of 
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informacioa  —  who  to  ask  about  informatiou  on  x  or 
,or  the  best  sources  to  read  on  ^.    The  functioning  of 
an  invisible  co^ege,  therefore,  can  make  information- 
seeking  within  ^  research  area  less  randota  and  more 
efficient . 

Even  where  information  is  not  sought,  the  day-to-day 
comnuinicat ion  ^araong  invisible  college  members  serves  to 
channel  information  to  those  who  might  be  able  to  use  it  , 
at'  a  time  when  it^can  ha^e  sorr:e  impact  on  their  own  work. 
The  invisible  college  member  "^'selects  information  of  * 
inte^st  to  his  colleagues;  he  passes  it  on  \Jhile-  it*s 
still. fresh;  and  he  adds  his  own  expert  opinion  in  an 
editorial  comment  or  two. 


L 

lilitjrfes  ini 


The  invisible  college  not  only  facilit\rfes  information 

flow  among  its  members,  -but  ai%o  betVeen^^its  members  and  " 

Others  outside  the _ invisible  college  who  are  working  in 

the  same  research^ area ,    Invisible  college  members  in  a 

■  « 

given  research  area  are  likely. to  be  working  irt  numerous 

R/d&I  institutions  and  settings  dispersed  across  cTie 

country,  and  each  Invisible  college  member  is  likely  co 

have  hi^'oi^n  network  of  ■  "followers'*       ^esent  and  former 

students,  collaborators,' colleagues,  ett-    The  flow  of     '  * 

P 

information  can  be  visualized  irr  terms  of  the  classical 

31 

two-stage  diffusion  models       First>  the  invisible  college 
series  tg  diffuse  information  among  ics  geographically 
dispersed 'member^.    Then,  these  eminent  resea^Sjchers  function 
as  gatekeepers  selecting  and  diffusing  information  other 
researchers  in  netx^orks  emanating  from  them.    As  a  conse- 
quence, the  best,  most  autHD^itative,  most  useful  informa-. 
tion  and  insight  diffuses  throughout  the  research  area,',fron 
its  leadership  at  the  center  ojitward  to  others  *at  the 
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periphery,  integrating  knowledge  groduciiion  in  the  rfeStiarch 
areaV  v 

Cumulative  development  of  a  high  qual^^y  knowledge  base 
id  deper^eut  on  this  kind-  of  accessibility  to  ijnforination 
about  relevant  previous  and  current  work*    It  Vt  also 
dependent  on  the  functioning  of  mechanisms  that  provide  a 

.measure  of  quaU.ty  cpntrol  on  the  knowledge  and  other 
"outputs  being  produced,  especially  those'outputs  that 
achieve  archival  'status  through  publication  in^  the  journals 
and  other  outlets  of  the  field-  An  example  of  such  a 
quality  control  mechanism  would  be  the  referee  system 
through  which  manuscripts  are  accepted  or  rejected  for 

'publication*.  But  mechanisms  of  this  kind  are  sibw,  and 

occur  late  in  the  knowledge  production  process,  too  late  , 

to  have  auich  impact  on  the  particular  reported  investiga- 

tion  while  it  was  in  progress*    The  invisible  college,  where 

it  exists,  is  far  more  efficient.     It  'Veacts  quickly  and 
32  *  ' 

authoritatively"  to  new  Ideas-,  new  thepities,  new  approache 
new  findings,  etc,  identifying  concef>tual  or  methodological 
weaknesses  before  presentations  enter  the  journal  literature 

/  ■  ' 

The  infcprmation'that  flojtjs  through  the  invisible  college 
tenSs  to  be  pricnarilj^  about  work  in  progress,  fr^otn  even 
the  earliest  stages  of  conceptualisation  and  search  for 
funding*    Invisible  ^college  tnembers  can  provide  reactions 
and  critiques  quickly  so  that  false  starts  are  avoided*  ■ 
And  where  a  proposed  or  ongoing  Investigation *is  judged 
sound,  invisible  college  commwication  can  provide  helpful^ 
guidance  and  insight,  suggestions  about  questions  to  be 
investigated,  -variables  to  be  included  in  a  research  design, 
appropriates  methodology,  etc*  .In  short j  the  invisible 
college,,  where  it  exists,  provides  the  most  effective  ^nd 
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efficient  Qachanism  we  know  of  to  facilitate  the  rapid 
expansion  of  a  research  area,  to  speed  the  quantity,  arfde- 
to  sharpen  the  quality,  of  knowledge  production  in  a 
research  area.    In  developing  policy  options  to  enhance 
information. flow,  then,  careful  consideration  should  be 
given  to  the  possibilities  of  creating  invisible  colleges 
where  they  do  not  yet^exist. 

Whatever  the  form  of  social  organization  of  researchers  in 
a  field  -^^hether  invisible  colleges  exist  or  some  other 
looscjr  form  of  co'rrtxunication  networking  r-  the  socia'l 
system  functions  to  move  new  knowledge  from  the  rasearch 
area^  to  the  informal  and  then  to  the  formal  communication^ 
mechanisms  of  a  field,  :  This  is  demonstrated  most  clearly 
^      in  the  literature  on  information  exchange  surrounding 
,  professional  association  meetings. 

'  Professional  Association-Meetln^s 

Comparative  research  across  several  knowledge  producing  fields 
'suggests  that  presentations  at  professional  associatioif  meetings 

represent  a  key  point  of  linkage  between  a  ficld*s  informal-and 

'  33  ' 

formal  communication  mechanisms.       As  we  have  seen,  in  fields 

S 

with  well  developecf  social  systems  ana^  close  integration  of 
informal  and  formal  communication  mechanisms,  dissemination  of 
information  ^bout-  a  given  piece  of  research  begins  while  the 
work  is  still  in  progress.    Those  working  on  similar  or  related 
problems  are  known  to  one'another.    They  correspond  and  stay  in 
contact  with  one  ^another  through  various  informal  channels, 
^^ogress  repQrts  are,made  at  various  colloquia  and  in  local, 
iregionfll,  an<C  other  meetings  of- prjifessional  and  industry 
associations.    Through'  these  contacts,  the  researcher  begins  to 
get  informal  feedback  on  his  conceptuali^sation  of  th^  research 
problem,  his  methqd^^  tentative  findings ,  et^c ,    t^/here^  it  seems 
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warranted,  he  may,  as  a  result,  modify  his  work  (or  the  maaaeV 
in  which  he  reports  his  work),  or  reanalyze  or  reinterpret  his 
data.    When  the  investigation  has  progressed  to  the  point  where 
the  researcher  feels  confident  enough  in  his  findings  to  dis- 
seminate them  formally,  he  "distributes  early  drafts  of  his  manu- 
script  to  those  he  considers  knowledgeable  to  react  to  and 
critique^  his  woxk.    This  circulation  of  manuscript  drafts  is 
generally  referred  to  as  the  "preprint  exchange/*    Based  on 
the  feedback  received,  the  researcher  may  revise  his  presen- 
tatioii  further^  or  perhaps  decide  to  conduct  efdiitlonal  data 
gathering  or  analysis  before  disseminating*  his  findings 
formally* 

r 

National  meetings  of  professional  associations  continue  this 
process  of  informal  feedback  by  bringing  the  researcher  into 
contact  with  a  greater  number  of^colleagues  and  providing  a 
setting  for  intensive  face-to-face  information  exchange  among 
researchers  working  on  similar  or  related  problems*^    In  fields 
^Lth  well  developed  social  systems,  this  intensive  information  ■ 
( exchange  is  the  essence  of  what  goes  on  at  the  national  meetings 
'Since  those  presenting  papers  a'nd  those  attending-  these  sessions 
are  already  familian  with  .each  other*s  work,  little  time  is 
wasted  on  describing  the  work.    Instead,  the  buj.k  of  the  time  is 
spent  on  analysing  and  critiquing  .the  work,  exploring  its<  impli- 
coitions,  relating^^t  to  other  work  and  potential  Applications, 
etc.    Consequently^ *the  national  meeting  is  a  significant 
stimulus  for  new  research  and  an  important  scur'ce  cff  information 
for  revipin^,  refining,  or  elaborating  the  work  of  both  paper 
presenters  and  chose  who  attend  the  presentation  sessions.  The 
national  meeting,  then,  is  an  important  element  in  facilitating 
information  flow  through  a  field  and  the  social  contacts  that 
expand  and  strengthen  informal  communication  networks.    For  the 
young  researcher,  the  meeting 'pi^ovides  an  especially  Important 
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entry  poir,t  to  the  infomal  cornmunication  networks  of  his  .  ^ 
research  area .  "        '  '  '  -         *  ^ 


Tho  national  meeting  of  a  professional  association  also  functions 
as  part  of  the  formal  conmunication  niechanisms  -  of  a  field.  Pre- 
sentations at  national  meetings  anaounce  the  trork  to  a -broader 
audience  in  the  afield,  beyond  the  charmed  circle  of  the  invisible 
college  (or  othe^  informal  communication  network)  already  familiar 
wi^h  the  investigation  while  it  was  sbill  in  progress.  Papers 
presented  at  the  meetings  flow  into  the  fortaal  archival  mechaaisias 
of  a  field^  through  publicatloa  of  abstracts  or  .?rcK:eedin^s ,  ov 

through  automatic  inclusion  in  various  collections  of  papers  or 

I*  ^ 

document  st'orage^and  retrieval  system?.     In  some  fields,  one 

evea  fiads  special  consideration  given  tty^oanu'scripts  based  on 

national  m^eting'plresentations  for  publicatiod  in  the  journals 
V  '  .34  .    ■  . 

of  that  society  or*  association-.^^  ^  ' 

.  *  f  * 

D.    -"Primary  Publication  Outlets       ^     -  ^ 

In  knowledge  producing  field  with  optimal  informatjl'oa  flow, 
manuscripts  based  on  Rational  meeting  prcisentatioas  appear  in 
a  field's  primary  publication  outlets  with  a  minimum  of  delay- 
Since  fields  with  optimal  information  flow  are  generally  those 
dharacterisgd  by  a  high  level  of  intellectual  consensVs  on 
concepts ,  theories ,  methodology,  etc , ,  relatively  fewmanu- 
script3_are  likely  to  be  i^ejected  or  to  reijuire  the  time- 
consuming  revision-and-resubmissiotr  process,  / 

These  fields  with  Optimal  information  flow- also  tend  to  have 
highly  structured  ^publication  channels      ^a  relatively  small 
number  of  "core  jrournals"  and  '^'tangential  journals,"  eitiier 
covering  all  the  key  work  in  the, field  or  specialising  in'  1 
certarih  research  dVeasJ  within  the  field.    This'  structu^rir^gr  of 
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publication  ouLlets'  tends        facilitate*  Inforination  flow,  Xho 
feiJer  the  number  of  jour-nals,  ^the  easier  it  may  be  tci  locate,  all 
the^key  work  in  a  research  area  relevant  to  one's,  oim  Investi- 
gation.   All  published  articles  on  a  given  problem  are  likely  to  - 
be  found  "in  one,  twOj  or  certainly  no  more  than  a  handful  of 
journals.    Authors  who  published  one  manuscript  on  a  given 
problem  in  a  particular  journal  are  likely  to  publish  subsequent 
work  on  tha.t  problem  in  the  same  journal.    Consequently,  struQ-  ■ 
tured  publication  outlets  of*  this  kind  provide  a  sense  of  ccfVir 
tinuity  for  the  casual  browsing  re34er,  and  simplify  literature 
seai^ch  for^the  researcher  actively  seeking  and  trying  to  get  a 
firm  grasp  of j  all  relevant  previous  work  on  the  problem.  * 

E.      Secondary  Pci.bl  ions 

Even  in  knowledge  produc  ing,  f  ie  Ids  where  primary  publication 
outlets  are^less  highly  structured,  effective  inforrration  flow 
is  possible  if  an  adequate  system  of  secondary  publications 
exists  to  facilitate  literature  searches,  retrieval  of  written 

%ources  of  information,  and  synthesis  of  new  knowledge.  We 
include  here  indexes,  abstracts^,  and  review  articles,     Iigi  a 
highly- effective  information  flow  syst^m^  all  journal  articles, 
technical  reports,  papers  presented  at  professional  association 
meetings,  and  other  fugitive  literature  judged  of  high  quality 
and  relevance  to  a  given  research  ar^ea  are  both  indexed  and 

/abstracted,  using  one  comprehensive  ^nd  coUistent  set  of 
descriptors.    The  descriptors  are  consistent  with  both  general 
bibliographic  labelling  sche'nes  and  specialized  usage  in  the       *^  ' 
research  area 'concerned.    Abstracts  are  sufficiently  detailed 
to  provide  information  abovit  theoretical  frameworkj  methodology, 

,  findings,  re^OTnmendations ,  si^jnificance,  etc. 

In  an  -effective  information  flow  system,  review  articles,  covering 
>£1^e'^^<teearch  area  as  a  whole  and  specialized  concerns  are  produced 
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frequc:ntly,  on  ?  periodic  basis,  either  by  leading  men  in  the  . 
field's  invisible  college  or-under  their  editorial  supervision. 
Each  review  article  provides  a  history  and  synthesis  o£  pre-' 
vious  work. and, ongoing  work,  suggesting  the  state  of  develop- 
ment  of  the  research  area,  what  is  knovm  an4  What  is  nc^  yet  ^ 
kaown  that  needs  to  be  known,  whicti  questions  have  been^ 
answered  and  which  issues  remain  unresolved,  which  problems  in 
methodology  have  been  clarified  or  eliminated  and  which/ones 
remain,  how  our  understanding  of  the  key  problems  of^jdie 
research  area  has**  cliatlged  ovsr  time,^and  which  pieces  of  the 
literature  must  be  read  to  understand  what  we  do  and  do  not 
know  about  x  or  y^y  etc.    Each  review  article  is  sufficiently 
comprehensive  so  that  it  covers  the  entire  literature  of  the 
'research  arrea  (or  specialized  concern  within  the  research  area), 
separating  the  wheat  from  the  chaff  and  pointing  the  rea<Jer  to 
only  those  items  that  warrant  archival  status  as  important 
elements  in  the  knowledge  base  oE  the  research  area*  4 

Information  Seeking  J&etiaviors 
  >   

Personnel  in  all  R/DitI  systems  can  be  studied  in  terras  of 

their  information-^seeking  and  information-exchange  behaviors^ 

Information  ^'user**  studies  focu's  on/^uch  topics  as;  information  , 

"needs*';  infornation  utilization  patterns  Ce,g*,  preferences 

r 

among  types  of  information  sources,  frequency  of  use,,  amount 
of  demand  for  certain  kinds  of  infornation  or  types  of  sources 

or  services,  user  satisfaction  with  services);  and  sophisti- 

.  35 
cation  of  users  in  makin*g  use  of  available  channels* 

Studies  of  information  needs  and  uses  suggest  that  information 
seeking  behaviors  of  researchers  are  affected  by  a -number  of 
factors  including:  the  nature  of  the  field  of  study  (e,g-, 
hard  vs.  soft  science,  technology,  nonscience,  puTe  vs*  applied. 
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a  *'coajimctive^*      domain  such  as  education);  the  stage  of 
maturity  of  a*particalar  Research  area;  the  state  6£  devel^ 
opment  of  the  social  structure  of  the  research  area;  the 
natuer  of  the  EormSl  archival  publication  base  as  it  affects 
the  ease  or  difficulty  of  informationa  retrieval;  the  infor- 
mation  soever  s  own  research"  and  disciplinary  background  in 
gelation  to  the  research  problem  and  discipline  in  which  he 
is  seeking  information;  the  researcher's  relationship  to  the 
informal  communication  channels  of  the  rosearcji  area;  his  own 
ability  to  retrieve  and  process  information  from  different 
sources  available  in  different  forms;  the  researcher*s  purposes 
inj^eking  tlje  information  and  his^oTO  prefereiices  as  to 
so3f ces  of  information;  etc* 

This  can  be  illustrated  by  examining  the  effect  on  infd^raation- 

seeking  behavior  of  one's  relationship  to  the  informal  commun- 

37  ^  ' 

ication  channels  of  a  research  area.        The  data  suggest  that 
^  in  all^  f  ields  df  study,  interpersonal  communication  is  a  major 
source  of  information  and  generally  is  the  preferred  source. 
If  one  is  a  part  of,  or  has  access  to,  the  informal  "cbimnun ication 
network  of  a  research  area,  one^can  locate  new  leads  and  find 
information  efficiently*  without  having  to  resort  to  random 
searc^ii^lof  the  literature-    One's  sources  of  information 
(especially  if  they  include  some  of  the  more  knov/ledgeable  ^ 
leaders  of  a  fiald)  can  tell  you  who  is  working  on  what  and 
what  he*s  finding,  what  methods  lia-ve  been  tried  and  proved 
ineffective  and  why,  what  is  \jorth  reading  "to  familiarize  one- 
stjlf^wiLh  the  most  *iignificant  work  done  in  the  area  to  date, 
etc.    If  one  Is  isolated  from  the  informal  communication  network 
of  a  research  area  (or  if  such  a  network  is  diffuse  or  even 
ndn-existent) ,  \t  is  harder  to  acquire  this  kind  of  information, 
and  especially  harder  to  determine  which  leads  are  worth- 
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pursuing  and  vrhich  ones  are  likely  co  ^be  unproductive.  Muc^^ 
time  its  lost '  iir  random  searchiog  of  thv?  literature  and  in  trying 
jio  run  doyti*  leajSs  ^that  tcr^out  to  be  unhelpful.    ^  *        f  ^ 

When  the  researcher  delves  into  questions  outside  _hls  o.wti 
research  area>  he  ^is  generally  isolated  from  tlte  informal 
conr,unicatioR  network  o^ -this^obher  research' area >  and  therefore 
confro^s  the  sattie  problei^s  as  the  researfcher  isiolatod  f irpnt,  the 
inforinal  coirununication  netvorks  of  his  own  field.    But  in'tb<i- 
case  of  trying  to  locate  informatiorv  outifsicle  his  own  xesearch  \ 
are^j  ^here  is  a  further' problani  in  using  the  formal  conimuuicd-" 
tion  system  of  journals^  inde.^es,  abstracting  services^  etc^ 
'The  concepts  and  tenninology  that  researchers  use  to  think 
about  and  talk  about  their  work  (i.e.>  the  jarg^  of  a  research 
area)  change  with -advances  in  the' research  front  of  a  field. 
.Hovever>  the  jargon  in  use  tends^to  change  faster  than  the 
terrp.inology  and  classification  schemes  used  by  journals,  indexing 
0¥  abstracting  services,  or  library  tiatalogues .     The  researcher 
working  within  his  ovn  research  area  is  likely  to  be  able  to 
make  the  transition  from  current  tenninolog)^  to  the  older  labels. 
However,  as  the  scientist  gets  further  from  his  owa  field,  it  , 
is  harder  for  hiin  to  interpret  and-  translate-  the  labels  4^  the 
indexes,  etc.  into  the  current  jargon'with  which  be  is^more 
familiar,  and  he  has  less  access  to  members  of  the  informal 
connunication  network  of  the  research  area  who  c^Wld  do  this 
label  translation  for  him  or  point  him  tiirectly  to  the  information 
and/or  information  sources  he  need^ -    Consequently,  information 
see/.irig  b-2navi^r  bex,oiies  more  oriented  to^^ard  the  fori?.a-C 
archival  publications  g^f  a  field>  its  secondary  public^it;Lons>  ' 
and  its  information  systems,    \^ere  there  is  a  strong  base  of  , 
review  articles,  critiques^  ^nd  knowledge -^syntheses  that  can  be 
used^  inf ormtitfon-^eeking  is  likc^ly  to  follow  a  pattern  of 
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citation  use  and  be  r£;asona^>ly  efficient.     However,  iVhere  such 
secondary  fpurces  are  lading' or  inadequate>  more  random  sfe^rch 
behaviors  become  nece^sarry y  ^frey  are  generally  discouraging 
^tT3"^Jpen  fruitless  (or  worse,  they  lead  the  researcher  doOn 
what  tutiSy  out' CO  be  the  wrong  path?),  and  KP  activity  is 
♦   retarded .  " 


Clearly,*  then,  eyfen  where  a  researcher  is  well  trained  In  the 
inf or3tatlott''r^  oj^  his  owri'field>  information  flgw 

>dcoilfes  a  substantial  preblfem  as  soon  as  his  research  problem 
t^es  him  beyond-  the  narrow  domain  of  the  area  in  which  he  Has 
been  trained.     Development"^ of  stro\i^  social  structures  and 
"cornmur^^cation  flows  within  major  research  ar^asj  and  develop-* 
ment  "of  arrangements"  that  wouldilink  worliers  In  one  research 
area  with  the  informal  networks  In  other  areas  (as  needed)  would 
greatly  facilitate  ^mooth* information  flows,  more  efficient  ' 
ipf ormaCian-seeking  bhavlor,  and  ultimately  more  rapid  develop- 
j^ent  of  high  quality,  cumulative  knowledge  bases  dn  key 
research  areas. 

G.     Formal  Infortnatlon  --Systems  and  A^encJtes 

All  fields  have  formal  JjjrS^nrrnation -systems  and  agencies  that- 
permit  the  storage ^jp^*  re trleval  of  accumulated  knowledge  tha't 
has  achiev£d---afeKival  status  in  .the  field's  publication  outi^ts. 
Tntil  recently,  the  category  of  formal  InfQrmation  systems  and 
agencies  was  made  up  largely  of  librnrLe.^,  with  their  special-  ^ 
Ized  or  gensral 'indexing  and.  cataloguing  systcms'to  permit 


oJmati'on  to^be  readily  stored  and^us^  as  readily  ^retrieved. 


••  ■ :       ^  ' 

^Computer  tmechnologv  has  Crnnsformed  the  nature 'of  these  formal 
lUiformatipn  systems  and  agencies,  their  scope,  and  the  kinds 


38  ^ 

of  services  that  can  be  provided-        Not  only  can  enormous 
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amoancs  df  information^_bc  retrieved  iii'ajSe*:  secoi^s  by  a 
comQutierised^re tirieval  system,  but  ev^^mona^l^ivfiS^ 
di£f^ent  information  systems  can  be  hig^ed;^  larger 
necworksj  permitting  users  in  one  lacale  t^  qse  of 

information  scored  in  a  large  number  of  infonnacion  centers 
all  over  the  cou%tr^  (or  ev^n  the  world)  >  and  all  of  this  can 
he  accomplished  in  only  a  few  minutes  time.    The  computer 
capabilities  minimise  the  clerical  chores  entailed  in  Infor- 
'Nation  gatheringj  make  more  information  accessible  to  the 
user^         accor^plish  the  infomatioa  gathering  task  in  a 
miniscule  fraction  of  the  fime  that  previously  was  required 
to  amass  the  relevant  information. 


Information  networking  has  opened  an  enomous  potential, 

However,  significant  difficulties  have  been  encountered  in 

designing  and  managing  such  systems  for  wide  use.     The  crux 

of  the  problem  lies  in  the  enormous  gap  between  potential 

system  capabilities,  on  the  one  hand,  and  the  known  inform- 

tion  seeking  behaviors  of  ^researchers,  on  the  other,  Theoret- 
^  ,  * 

ically,  one  would  assume  that^the  design  and  management  of  an 

inf orijiation  system  should  proceed  smootlily  and  logically 

from  de temination  of  users'  information  needs  and  inf^rma- 

tion-seeking  and  exchange  behaviors  to  design  and  management  . 

of  a  system,  that  meets  those  needs,  and  facilitates  those 

infarnation-seeking  and  exchange  behaviors.    Howev^,  user 

^  stodfies  suggest -chat  Tt  is  difficult  if  not  impojssible  to  ^  " 

adequately  determine  user  needs*    This  is  a  result  of'  both 

Che  rudimentary  nature  *of  the  methodology  of  u5er  studies 

and  the  fact  'that  users  generally  lack' sophisticated  awareness 


lack 


of  their  needs  and  rarely  articula^fcthe  kind,  of  information 

about  their  .requirements  that  could  be  used  to  guide  tliie.des 

*        .  %  ' 

and  management  of  an  information  system.    Also>  et^ually 


importantj  since  infonnltion  users^  generally  are  unsophisti- 
.  ^  cajjed  in  info'rm^tion  seeking,  basing  system  design  on  whac 
users  do  now  instead  of  .wftdt  they  night  do  if  their  infor- 
mation'seeking  skills  were- better  (developed  wo«ld*not  lead 
to  development  of  as  good  a  system  as  might  be  developed 
simply  by  ^having  information*  specialists  coricep'tualize  and 
design  a  first-rate  information  system* 

All  infotmation  systems, /t^en,  muse  face  the  design  and 
^    oana^enieat  issue  of  ^deterraininS  the  extent /t!>  ^hich,  on  the 


ons  hand,  ^the  systeia  should  be^-suitea  tp  the  existihg  inf or- ■ 
mation-seekirig  and  information-exchange  styles  of  users,  or, 
"on  the  othfer  hand,  the  extent  'to  WKith  the  focus  should  be 
on  increasing  the  capabilities  of  users  to  more  effectively 
seelcj  exchange,  and  use  information  so  that  th^  full  poten- 
tial  utility  ot  the  system  can  be  exploited*    Cleanly,  |^he 
ideal  policy  mix' would  be  to:     (a)  try  *to  design^jthe  most 
advancefl  and  useful  system  possible-,  vhile  also  (b)  developing 
mechanisms  to  fit  the  system  to  the  information  seeking  and 
processing*styles  of^users,  and  (c)  developing  strategies  for 
increasing  user  capabilities  for  using  the  system  to  its  full 
potential*    Given- limited  resources,  however,  the  key  policy 
issue  will  entail  detenilining  how  to  allocate  fjinding  among 
program  components  oriented  toward  each  of  these  three 
objectives.  /    '   ^  / 


Summary  ,  , 

Ideally,  information  flow%  in  a  research  area  are  highly 
efficieot.    Researchers  are'well  connected  to  each  other  through 
info?pal  commun;lcat'ion  channels;  which  speed  the  flow  of 
up^to-date>  high  qu;^lit,y  Information,    The  ;innual  meetings 


,^11.  " 


o£  professional  associations  EaTiilitate  these  xnforii^al 
Information  flows  ^B,  the  establishment  of  linkages  among 


researchers  whi^^  !W»d  them  to  these  informal  communication 
channels.    The  formal  publicatfbn  channels  are  so  structured 
tfiat  cumulative  ^bodies*  of  research  are  easy  to  locate/_  and 
*  see<?nd^ry  sources  perirvtt.easy  retrieval  of  the  first**rate 

work*  in  an  area  that  forms  the  core  of  Cts  knowledge  base* 
Researchers  are  fefficien^  in  informat^;t^-seeking  and  exchange, 
having  well  developed  and  sophisticated  skills  in  use  of  ^^e 
,  existing  informal  and  fomal  infopfnation  channeTsi  And 
information  systems  and  agencies  ^permit  efficient  storage 
and  .retrieval  oihail'Tiigh  quality  knowledge-  in  an  area  by 
»user;S  adeq-uatel;^ trained  to  exploit  the  full  potential  of  the 
information  system's  design. 

Of  course*  not  all  fields  of  knowledge  show  well  developed 
information  flow  patterns.    Education  is  a  special  case  in 
-  point*  and  we  turn  now  to  consideration  Ol  information  flow 
among  researchers  in  education. 


3.  KP  Inforinatlon  Flows  in  EdiicatlPn 

Fields  of.  knowledge  vary  in  the  extent  to  which  they*  approach  the" 
description  we  have  providecf  of  optimal  infortrfation  flo^**    But  of 
all  the  fields  that  , have  been  studied  comparatively  by  researchers, 
education*  clearly  must  be  rated  the  weakest  In  information  flow. 
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A-    Research.  Areaa  *  *  " 

V 

No"  fiel(j"  has, devoted  any  energies  ,to  identifying-  and  mapping 
Its  reseai;^U\  areas.  But  clearly,  this  would  be  a  relatively 
simple  task  to  accomplish  in  m^y  theoretical  sciences*  As 


ERIC 


612 


we  shall  consider^  subsequenCly,  in  education  the  problems 

would  t>e  enormous.    The  root  of  much  of  the. difficulty  is 

traceable  to  the  inherent  nature  of  education  a&  a  conjunc- 

40 

tive  field  o£  knowledge.  "     But  this  factor  can  be  overem- 
phasized.   Xf  informal  commuhcatian  networks  were  well 
developed  in  education*  it  would.be  easier  to  define>  bound  " 
off,  and  trace  the  interrelationships  among  its  research~aVeas , 


B,     Social  Organizatoh  of  Researchers 

.  fa  ' 

Social  organization  avion^  educational  researchers  is  barely 
in  ividence*    Where  it  doe^  exist,  It  is  relatively  unstruc- 
tured and  of  limited  utility  for"  furthering  the  kind  of  infor- 
mation flow  that  sential  to  developing  high  quality  cumu- 
lative knowledge  bases.    Informal  communcatioR  networks  may 
exist  for  a  tiae  between  a  teacher  and  his  students,  and 
among  the'students  themselves>  but  most  of  these  tendto 

attenuate  and    disappear  after  time.    In  education>  there 
* 

appears  to  be  somewhat  limited  continuity  in  the  vork  of  most 

41 

individual  researchers      much  less  teacher-student  groups  who  / 
might  have  worked  together'as  a* research,  team  vhile  the  students 
were  in  graduate  school.    Much  the  sa/ie  could  be  said  about 
informal  communication  between  one-time  collaborators >  or  between 
researchers  pursuing  similar  research  problems  who  might  have 
met  at  a  professional  association  meeting  and  corresponded  for 
a  while.    Given  the  general  "lack  of  continuity  in  the  work  Qf 
educational  researchers,  these  channels  lose  their  efficacy 
for  Information  ftov  as  individuals  change  re^search  interests 
and  move  on  from  une  "one-shot  study"  to  anoth^er* 


There  are>  of  coui^ej  exceptions  —  numexous  eminent  researchers 
^jho  have  liursued  work  oh  a  related  set  bf  problems  for  many 
yenrSj  even  a  total . research  career.    They  and  their  students 
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and*  collaborators  are^mor?^  likely  Co  remain,  in  conC^ac  t  ^ajnct 
to  have  some  contact  vith  other  researchers  studying  similar 
problems.    But  this  kind  of  comraunicacion  network  Is  ac  b^esc  ' 
£  communication  network  covering  a  portion  of  those  vorking 
in  the  research  ar6a,  not  a  comprehensive  communication  net- 
work linking  all  the  researchers,  or  even  just  the  leading 
researchers,  io  that  area. 

The  creation  of  SIGs  (Special  Interest  Groups)  as  organiza- 
tional entities  i^'ithin  the  AI^RA  ^^ight  h^'ia  been  intended  as 
a  development  in  this  direction,    But»  clearly*  few  of  thes^a- 
groups  succeed  in  doing  any  more  than  providing  ex-tended  and 
continuing"  social  contact  and  communication  channels  for  those 
researchers  who  decide  to  join  these  groups  and^  take  part  in 
their  activities.    Rather  than  functioning  in  the  mnner  of 
invisible  colleges  of  the  most  eminent  and  productive  research 
ers  in  an  area,  casual  observation  suggests  that  many  of  the 
SiGs  tend  to  be  joine^  by  young  researchers  early  in  their 
careers,  interested  In  making  and  extending  their  professional 
contacts.  -  ' 

C.    Inforniation  Exchange  Surrounding  AERA  Meetings 

The  lack  of  social  organization  among  educational  re;searchers 

working  on  related  problems  has  a  pervasive  , influence  on 

information  flow  In  education.  'The  effect  is  seen  especially 

A3 

clearly  in  the  national  ^meeting  of  AERA.        Compared  to  other 
fields  tjhat  have  been  studies*  the  data  on  education  show  less 
prermeetfing  dissemination  of  information  about  the  studies 
reportea  in  paper  presentations.    Fut  even  more  important  than 
the  amount  dlf*  pre-meeting  dissemi^nation  is  £bie^elatively  un- 
structured quality  of  the  dtsfiemination  that  does  take  place  - 
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oral  presentations  to  small  informal  groups  (e.g-,  work  groups 
or  colleagues  within  their  institution)  >  or  written  p,resenta= — ^_ 
tions  in  the"  form  of  technical  reporjis  or  doctoiral  disserta- 
tions-     >Jothing  exists  like  the  Inf ormal^'comraunicdktion  network --n 
of  an  invisible  college,  or  even  a  looser  pattern  of  communicaf 
tion  networking  to  integrate  informal  commuaiccjtion  and  diffuse 
throughout  a  research  area  up-to-date  information  about  work  iti 
progress.    Consec^iently,  cotspared  to^other  fields,  educational 
researchers  who  attend  AERA  presentation  sessions  are  signifi- 
cantly less  familiar  with  the  studies  being  presented  or  the 
prior  work  of  the  presenting  suthors>  and  the  presenting  authors 
are  far  less  likely  to  be  familiar  with  those  other  researchers 
who  attend  the  presentations  or  the  work  they  ^ave  been  doing*  ^ 
Since  there  is  little  prior  knowledge  about  the  presentations 
or  the  work  in  progress,  considerable  energy  must  be  devoted  to 

absorbing  and  assimilating  an  extensive  amount  of  complex  infor^ 

■J 

mation  about  a  study  from  a  brief,  usually  Ineffective^  oral 
prefentation  —  hardly  an  efficient  medium  for  information  flow- 
At  best,  those  who  bother  to  take  part  in  these  generally  deadly 
dull  sessions  succeed  in  developing  an  awareness  of  what  Is  going 
on,  rather  than  extending  comnunjcatkm  about  the  substance  of 
investigations. 

Participants  are  ^*forced  into  ^n  unstructured  pattern  of  infor- 
mation-seeking behavior,  the'point  of  which  is  not  to  assimilate 
the  information  itself  at  the  nieeting,  but  rather  to  uncover 
sources  ot  inxornation^*  who  is  working  on  what,  whose  papers 

'to  roques:,  who  to  try  to  contact.    They  browse  through  the 
meeting  program,  check  off  Interesting-sounding  sessions,  d'nd 

/ 

wander  from  se#;?;ion  to  session  —  listening  for  a  whil&^  getting 
borodj  trying  another  session,  moving  on,  after  a  day  or  so 
getting  so  bored  that  fewer  sessions..are  attended  and  more  time 
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In  shjrtj  the  naci<>nal  meeting  achieves  little  io  the  way 
of  jg<;huine  scientific  information  exchange.     It  provides^  at 
besCj  a  medium  for  trying  to  locate,  in  a  some-^hat  random 
and  unstructured-  raanner>  the  most  superficial  kinds  of 
information  that  would  flow  through  day-to-day  informal 
cornmunication  c>hannel,s  in  a. field  uith  a  v;ell  developed  social 
organizatioTVj    And  if  the  national  me.eting  fails  to  provide 
a  foruni  for  intensive  f ace-to^-J^ce  information  exchange,  the 
extent  to  which  this  happens  at  all  in  a  field  is  bound  to 
be  limited  —  a  special  conference  or  seminary  here*  a  sec 
of  colioquia  there. 

Concern  has  been  expressed  about  this  problein  vithiiKthe  AERA 
and  federal  agencies.     Several  mechanisms  have  been  devised 
to  familiarize  educational  researchers  with  work  in  progress 
or  work  to  be  presented  at  the  national  meeting.    For  instance* 
ERiIC*s  nionthly  abstract  publi<;ation  Reg;earch  in  Education  was 
intended  to  provide  up-to-date  coverage  of  work  in  progress 
through  abstracting  technical  i^eports  and  the  fugitive  liter^ 
ature  forthcoming  froni  ongoing  projects.    And  publication  of 
AERA  paper  abstracts  prioi;  to  the  national  meeting  was  ex- 
pected to  familiarize  readers  with  presentations  prior  to  the 
meeting.    Data  suggest  that  neither  device  is  succeeding: 
Research  in  Education  covers  too  small  a  proportion  of  all  work 
in  progress  to  be  useful  for  this  purpose,  and  few  of  those 

who  attend  paper  sessions  bother  to  read  the  abstracts  prior 

46 

to  attending  the  sessions, 
« 

AE£lt\  has  also  been  experimenting  uith  a  nurftber  of  new  forniats 
designed  to  increase^the  amount  of  information  exchange 
occurring  at  itb  annual  meeting.    There_  appears,  for  itistance* 
to  be  an  especially  pronounced  increase  in  the  use  of  symposia 
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designed  to  provide  diverse  presentations  on  a  single  is$^e> 
oriented  toward  stimulating  exchanges  ancHig  participants  and 
between  participants  and  attendees*    To  stimulate  discussion 
in  certain^areaSj  sumposia  may  be  organized  by  the  Assoc^ia- 
tion;  by  Divisions*  or  by  Special  In^ere*;^  Groups >  as  well  as 
oroTJOsed  by  AERA  msmbers .    There  are  also  a  number  of  new  forniacs> 
such  as  critique  sessi"ons>  small  roundtables*  and  conversaticJ^ 
hours."  Many  of  the  syTQpoSia  are  well  attended*  the  exchanges 
are  at  times  lively,  and  much  of  the  discussion  among  parfi- 
cipf^nts  Jind  atte^nciees  does  continue  after  the  sessions  are 
concluded.    It  would  be  useful  to  have  a' formal  Assessment  of 
the  ef fectiv^Biss  of  these  new  types  of  sessions,  but- none,  has 
yet  been  made.  \ 

4 

D.    Primary  Publication  Outlets  ^  ^ 

^We  havq  noted  above  that  information  flow  in  educational 
research  is  hampered  by  widespread  ignorance  of  pertinent 
information  in  one's  own  research  area>  and  that  this  is 
attributable  primarily  to  the  relative  lack  of  social- organi- 
zati'^r.  of  the  field.    We  have  considered  particularly  how  the 
educational  researcher's  lack  of  familiarity  with  woric  in 
progress  impedes  information  flow  at  .national  meetings.  But 
this  is  only  a  small  part  of  the  problem.    Data  show  that 
ediicntional  researchers  tend  to  be  unawar.e  of  Published  articles 
relevant  to  their  own  work.    This  is  traceable  to  two  additional 
probl'Srtis  in  the  information  flow  system  of  the  field:  journal 
outlets'  for  publication  in  education  are  so  numberous  and 
diffuse  that  it  is  difficult  to  keep  up-to-date  in  one's 
research  area;  and  the  field  lacks  adequate  mechanisms  for 
providing  coniprehensive  abstracting  and  information  retrieval. 
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Unlike  iha  fields  ^'ith  highly  structured  publication  outlets 

a  few  core  journals  and  perhaps  a  handful  of  tangential 

journals  —  thcr^.arc  several  hyjidred  journal  ouclets  for  , 

educatignal  research*    One  sdtvey,  asking  562  Kpowledgeal^le  ^ 

respondents  in  the  field  of  education  tb  name  periodicals  they  ^ 

read  regularly  to  keep' up-Xo-date  in  the  fiold,^  produced^  a  list 

ol  357  periodical^  re^id  by.  at  least  two  of  th^m,^'  Clearly, 

ciany  of  the  periodicals  named  w^re  targeted  more  at  jir^cition- 

ers  th£m  researchers  adn  sh6uld  orobably  not  be  con^^idered 

jourrial  outlets  to  which  educational  researchers  ^Srould  be 

likely  to  submit  ir.anuscripts ,  or  which  educational  researchers 

vould  brovse  on  a  regular  basis.    But  in  another  study,  121 

authors  who  presented  researctf  papers  at  a  single  AEKA  meeting 

named  72  different  journals  to  which  they  planned  to  submit 

thelD  manuscripts.^       In  still  another  study,  94  authors  named 

84  different  journals  to  which  ^hey  planned  to  submit  172 

49 

different  manuscripts*        Clearly,  then,  the  number  of  educa" 
tional  research  journals  in  which  a  given  manuscript  might  be  '  * 
pubished  is  quite  large,  ,  " 

\        s  ■    ,  ■ 

The  large  number  of  journal  outlets  for  educational  research  . 

is  an  especially  serious  problem  because  the  j9urnal  literature 

of.  the  field  is  so  diffuse  and  unstructured*    There  are  $ew 

"specialized  journals  that  publish  research  on  topics  "narrow 
enough  to  approach -our  conception  <^f  a  research  area.    Most  of 
Che  journals  cover  the  field  of  educational  research  as  a  whole, 

■or  rather  broad  segments  of  the  field  as  a  whole  (e.g.,  urban 
cSuCdtion,  Che  sociology  of  education,  etc*).  Consequently,  * 
for  the  educaCional  researcher  to  keep  up-todacc  in  his  research 
area,  it  might  be  necessary  for  him  to  peruse  as  many  as  20,  , 
30,  or  even  more  joyrrtals.    Even  if  he  is  highly  selecCivW 
about "the  journals  "he  reads,  it  is  likely  that  10-20  would  be 
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a  bare  niniHiim  of  the  jouraal  literature  that  he  must  bro-^^s^. 

The  problem  is  further  complicated  by  the  limited  coatiauity 

one  finds  in  both  ^he  conduct  of  educational  research  aad  its 

publication  patterns.    Several  observers  Have  commented  oa 

the  non-cumulative  "one-shot"' study  "as  the  characteristic 

pattern  of  educational  research*  and  data  confirm  this  obser- 
50 

vation.       For  instance*  analysis  of  tht  papers  presented  at 
a  single  AERA  meeting  showed  that  88%  of  the  presentations  ■ 

described  a  single  laboratory,  field,  or  methodological  study 

"  -  5i  ' 

rather  than  reporting  on  a  program  of  studies.        Compared  to 

other  fields,  doctoral  dissertations  in  education  are  far  less 

likely  to  be  undertaken  as  part  of  a  broa4  research  program^ 

conceived  and  sponsored*  by  a  schol^r-teacher  who  serves  as  the 

doctoral  adviser.    More  typically,  doctoral  students  generate 

research  topics  on  their  own,  unrelated  to  the  work  of  their 

professors  (who  are  also  less  likely  than  those  in  other 

fields  to  be  involved  in  a  research  program  of  tbteir  own), 

and  then  e:ipend  a.  considerable  amount  of  energy  in  trying  to 

locate  a  faculty  member  willing  to.  serve  as  their  adviser- 

Educational  researchers  are  less- likely  than  researchers  in 

other  fields  to  continue  work  in  the  same  area  as  their  doctot* 

al  dissertations,  or  to  puljlish  several  articles  on  the  same 
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or  related  research  problems.        Consequently,  it  is  less  likely 
that  an  educational  researcher  working  on  a  given  problem  will 
be  familiar  with  other  researchers  working  on  that  same  problem 
or  publishing  in  that  same  area. 

Even  in  cases  where  the  wrk  of  a  researcher  has  continuity, 
the  diffuse  and  unstructured  nature  of.  publication  outlet^ 
in  educational  research  makes  it  difficult  for  the  reader  to 
follow  a  given  author^s  progress  in  answering  a  series  of 
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reiated  qyo^lons,    Teu  educational  Researchers  i,'ho  publish 

an  article  on  a  given  topic  in  a  particular  joui:[ial  arL*  likely  ■ 

to  submit  their  next  article  on  the  same  topiti  to  tlie  same 

journal.    More  likely,  the  subsequent  article  will  be  sent  to 

sotne  other  Journal*     Xn  one  study>  authors  who  had  recently 

published  articles  in  four  core  journals  in  the  field  were 

asked  ^bout  current  manuscripts  they  were  prepariag  on  thki 

same  topics  and  which  journals  th'ey  were  planning  to  submit 

them  to:  94  educ^ional  researchers  who  were  preparing  172  ^ 

!nan»jscripts  named  not  only  the  four  core  journals  but  a  total 

of  84  different  journals,  with  no  one  journal  slated  to  receive 
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as  many  as  even  10%  of  the  manuscripts*        In^still  another 
study,  these  authors  who  had  published  in  the  four  core  jour- 
nals  were  asked  to  naoe  other  researchers  working  in  the  same 
research  area,  and  these  other  researchers  were  then  contacted 
to  determine  where  they-  had  published  their  most  recent  article 
in  this  research  area;  67  researchers  reported  articles" appear- 
ing  in  not  only  the  four  core  journals  b^t  in  a  total  of  ^5 
different ■ journals* 


CJearl^j  then>  core  journals  in  education  fail  to  provi^de 
comprehensive >  up-to-date >  integrative  coverage  of  research 
areas.    And>  as  a  consequence,  it  is  far  more  difficult  for 
researchers  to  k^ep  in  touch  with  developments  in  their  research 
area  or  to  locate  important  work  that  is  potent'lally  relevant 
to  their  own  investigations* 

This  prob>n  is  unders^^orod  by  avallatrie  data.    Although  AEtv/^  , 
paper  request  patterns  are  probably  more  random  than  request  ^ 
patterns  in  other  fields>.it  seems  reasonable  to  as'sume  that 
a  substantial  proportion  of  those  who  request  copies  of  AER/V 
presentations  are  likely  to  do  so  because  they  seem  relevant  . 
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to  their  ovn  work.    But  when  requesters  of  AER/i  papers  thac 

wero  subsequeacly  publislied  were  asked  if  they  knew  of  the 

subsequent  publication,  only  11%  of  the  AEKA  requesters  were 

ablft  to  aasver  in  the  affirmative  (compared  to  A6%  of  the 

American  Sociological  Association, and  86%  for  the  Optical 

Society  of.  America) , Authors  of  these  subsequently 
i 

published  AERA  papers  were  asked  to  name  other  researchers  ^ 
doiag  research  in  the  same  area,  and  then  these  other  research- 
ers were  sun/eyed  to  determine  if  they  knew  of  the  publication. 
Only  39%  of  these  other  researchers,  actively,  working  ix\  the 
sane  re^^earcb  area  vere  aware  of  the  publi^^hed  article. 

t*     Secondary  Publications 

Because  Primary  publication  outlets  are  so  diffuse,  secondary 

publications  such  as  Indexes,  abstracts,  and  review  articles 

arc  especially  important  but  highly  inadequate  in  education. 

No  indexing  or  abstracting  service  comprehensively  covers 
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the  field  as  a  whole*  ^  There  are  19     different  services* 

58 

relevant  to  the  field  of  education,  at  least  12      of  which  are  ■ 
relevant  to  educational  research*    Many  periodicals  of  rele- 
vance to  education  and  Educational  research  are  not  covered 
59 

by  these  services\       Indexes  provide  little  information  ^ 
of  *  help  to  the  researcher  in  guiding  his  literature  search, 
and  therefore  abstracts  are  highly  preferred  by  researcjiers^ 
in  education  as  in  other  CieldSv^'^    But  abstracts  are  available 
for  only  specialized  topics  (e.g,,  Educatiomfl  Administration 
Abr>tracts)  or  ^or  the  vase  collcc^cl-on  of  fugitive  literature 
stored  in  the  ERIC  system  (which,  as  we    shall  see  shortly, 
haj;  problens  of  its  own). 
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Given  the  er.ormous  size        the  educacicJij^  literature,  the 

redundancy  of  the  blbliographica^l  tools  available  for' searching 

+ 

the  literature,  and  the  lack  of  abstracting  for  the  great  balk 
of  material  in  that  literature>  any  ajjttempt  to  compreiiensively  . 
and  thoroughly^^arch  the  literature  is  unlikelyT^^This^  is 
especially  so  if  the  researcher  has  little  more  to  guide  ht^ 
efforts  than  indexes  and* abstract3>  and  particularly  when  the 
subject  labels  used  to  xategorize  information  are  only  distantly 
related  to  the  usage  that  comes  io  nind  when  he  thinks  about 
his  research  problertK  and  his  information  needs  tor  attacking 
thci  Droblen^.  *  . 

As  if  this  situation  were  not  dreary  enough^  tho  researcher" 
who  painstakingly  does  try  to  conduct  a  thorough  literature 
search  finds  that  most  of  ther  literature  "identified  and  located 
with  such  difficulty_turns  o\>t  ot  be  of  questionabW  quality  or 
utility.     This  picture  is  no unduly  exaggerated.    OTi  is  little 
.wonder,  th^>  that  literature  search  in  educatijfa  tends  to  be 
carried  out  in  somewhat  casual  fashion>  and,  primarily  for  the 
purpose  0f  provicIiTi?g  a  scKolarly  introduction  or  framework  for 
the  work  to  be  presented.    Data  show  clearly  that  educational 
researchers  tend  to  use  literature  searches  less  often  to  shape 
their  thinking  In  generating  or  conceptualizing  a  research  ^ 
problenij  or  conducting  their  investigations >  and  consi(ierably 
ra^ts  often  to  help  them  present  their  research  formally  in 

61  '  m  * 

written  presentations.        Information  flow  in  such  cases  is  nbt 
so  much  influencing  research  as  it  is  influencing  the  manner 
in  which  r^^search  is  described  in  t^e  literature, 

-if 

Where  a  field  provides'  an  adequate  systoni  of  periodically 
written  syntheses  of  th^  licerat-jro  in  each  research  area  > 
these  problems  of  literature  search  ar^^  tninitnized.     If  review 
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^arcickis  are  comprehensive  and  detailed  enough  in  their 
coverage  and  citation  of  th^  literature^^he  researcher  is 
less  dependent  on  jndexes  or  ab^tract^adn  is  more 'likely  to 
bypas'^  "this  bibliographical  step  and  go  directly  from  the 
review  article  to  the  journal*  articles  and  other  sources  cited, 
and  probably  to  buil^  his  bibliographical  search  from  citations 
and  other  references  in  thege  sources-  "  And  where  review  articles 
are  produced  under  authoritative  sponsorship ,  the  reader^  can 
be  assured  that  litera  ture*  of  poor  quality  or  1  jfM  f  i  i1  utility 
wlli*not  b^  cited,  increasiijs  his  ov(i.  ef f iciency'in  searching 
the  liceratuer  for  inforniation  relevant  to  his  worlf- 


Uffder  AERA  sponsorship,  the  ^educational  research  field  has 

made  significant  strides  in  generating  an  extensive  and  high 

quality  review  literature  that  is  widely  used^n  th^  field. 

We  include  here  such' AERA  projects  as  the  Encyclopedia  of 
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Educational  Research,      the  fitst  am  second  editions  of  the 
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Handbook  of  Research  on  Teaching,      the  quarterly  journal 

-64 

Review  of  Educ£itional  .Research,      and  the  newest  addition,  the 
annuaV  Review  of  Rej^earch  in  Education, The  ERIC  system  has  ^ 
also  contributed  to  this  review  literature  by  producing  an 
extensive  number  of  information  analysis  products  synthesizing 
the  literature  on  specific  topics,  . 

Cl^rly,  more  reviews  of  this  kiqd  in  other  non-r^^search" 
R/D^I  sptecialit^Les  (|»g.,  development  or  dissemination)  Ttould  * 
take  the-  field  "a  long  way  toward  accumulating  the  high  quality 
knowledge  and  technology  bases  needed  to  support  these  pro^  _  t 
fessional  specialties*      '  ^  »^ 


F .    OverView  of  fn£o£TTiat:lon  Flow  Problems  - 

Given  che  diffuseness  and  che  unstruccurod  nature  of  publi- 
cation  outlets  in  education,  the  as  yet  inadequate  covaragu 

the  field's  in'creasin^ly  useful  system  of  secondary  publi- 
cations, and  Che  resultant:  'difficulty  of  keeping  up-^co-date 
or  locat-lng  informatifi  relevant  to  one's  own  work  in  progress, 
Che  weakness  of  infornacion  exchange  at  A^RA  meetings  takes 
on  added  significance.-/  If  the  researcher  does  not  adequately 
^aGiilir^ilftte  Ir.fomatlon  About  current  v'o\\\  during  c!u'  AER/J 
meeting,  'or  request  copies  of  papery  af'terwardsi  there^would 
appear  to  be  somewhat  limited  probability  chat  he  w^^ll  later 
come  across  the  study  in  print-    One  chlrd  of  che  presentations 
never  appear  in  print Ai>d  those  that  are  published  are  * 


scactered  among  scores  of  l^urnals  —  within  one  year  of  one 
parcicular  AETA  meeting,  102  of .  the  papers^p resented  had 
been  published  in  64  different  journals,  and  only  four  of 
tbese  journals  had  published  mpre  thn  two  of  these  manuscripts. 

Even  if  the  researcher  does  lacer  come  across  the  study  In 
print,  it  is  unlikely  thatf  he  will  get  the  information ' in 
time  fon^lt  to  influence  his  work-    Data  suggest  that  it  ^' 
tends  CO  take        to  3^  ye^rs  after  an  AERA  meeting  for  even**- 
half  of  the  material  presented  at  the  ineeting  to  b&  published.^ 
(Now.  'that,  an  effort  Is  b^ing  made  to  gather  AERA  pagers  for 
inclusion  in  the  ERIC  microfiche  colleciton  and  its  oocument 
reproduction  service, „  this  problem  may  be  partilaly  a-lleviated, 
&ut  this  a^sismesi  that  ^the  ERIC  system  permits  easy  access  to 
iihe  ma terial,.'stored ,  a  problem  we  shall  return  to  shortly*) 

The  question  of  whether  infori^N^n  on  current  research  is 
available  at  a  time  when  it  S\n  ihfluence  other  ongoing 
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research  returns  us  again  to  the  primary  problem  at  the^  root 

of  all  inEormtion  £lov^veaknesses  in  education.     It  is  vir- 

tua-Xly  impossible  to  have  up-to-date  information  on  work  in  ^ 

progress  circulating  among  researchers  in  a  field  without  some 

significant  degree  of  social  organization*    ^ata  suggest  that 

it  takes  approximately  34  months  from  the  time  a  study  begins 

until  it  appears  in  print  in  an  education  journal,  13  months 

before  we  find  even  informal  reporting  at  colloquia  or  pro- 

70 

fessional  association  meetings.       Generally,  by  the  time  one 
A^f  his  manuscripts  is  pub"i,lshed,  a  researcher  has^Progressed 
far  enough  along  oti  subsequently  undertaken  research  to  be 
ready  to  disseminate  findings  informally  on  the  later  investi- 
gation*   If  channels  are  lacking  for  informal  communication, 
the  only  finding  available  to  the  field  at  any  given  time  are. 
those  that  may  have  already  been  superfeded  or  tnade  obsolete 
by  subsequent  research. 


Though  the  national  meeting  is  a  link  between  formal  and 

informal  communcation,  there  is  relatively  little  flexibility 

in  AERj:\  programming  to  permit  up-Xo-d^te  information  exchanges 

,on  work  in  progress.    Paper  proposals  have  to  be  submitted  at 

least  eight  months, prior  to  the  meeting  date,  and  the  research 

to  be  reported  miist  already  be  far  ^nou^h  along  by  the  time 

the  proposal  is  written  that  at  least  tentative  findings  can 

be  included  in  the  proposal  and  their  significance  discussed. 

Consequently,  any  findings  to  be  presented  eight  months  later 

are  likely  to  be  out  of  date  by  the  time  of^th^^ meeting*  More 

current  work  is  uulikely  to  get  presented  because  it  cannot  be 

described  by  the  ttime  of  the  proposal  submission  deadline  in  a 

manner  that  is  likely  to  be  acceptable  to  the  proposal  r-eaders, 

f 
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Some  snail  .amount  o£  flexibility  is  provided  in  sessions  set 

as-ide  for  NIE-  or  some  other  priority  group>  a  few  (though^not 

many)  of  the  symposia,  or  perhaps  some  (though  not  much)  of 

^the  .program  sec  aside  for  the  SIGs  (Special  Interest  Groups). 

But^this  is  ptetty  far  fron  what  we  wo^ld  consider  ideal  —  ^ 

e.g.,  organizing  AERA  meetings  around  research  areas  rather 

than  the  current  structure  of  divisions;  drastically  reducing 

the  ampun^  of  program  time  devoted  to  presenting  unsolicited 

papers  submitted  by  reseai?chers  reporting,  oa-shot  studies 

(^^ .  g. ,  ^doctoral  clss^r tatloas  that  are  not  part  of  broader  ^ 

r&search  programs),  a>id  allocating  substantial  blocks  of  time 

t;o  commissioned  though  papers  within  research  areas  —  to' pro-: 

duce  research  area  syntheses,  and  analyses  to  stimulate  discussion, 

intensive  small  or  face-to-face  exchanges,  and  <Jelineating 

research  agendas  and  exc'hanging  ideas  about  how  they  might 

be  carried  out;  and  ^through  a  variety  of  means  devoting-  more 

time  to  cot^sciousLy  and  purposefully  stimulating  the  develop- 

i 

meat  and  expansion  of  research  areas,  developing  communication 
networks,  and  strengthening  social  contacts  within  research  areas. 

/I 

Gi     Information-Seeking  Behaviors 

Information-seeking  ^behaviors  in  educational  research  Itend  to 
be  particularly  inefficient.    In  part,  this  may  be  attributable 
to  a  lack  of  sophistication  in  the  information-seeking  skills 
of  educatiorial  researchers.    But  equally,  if  not  even  more 
importarft  *  acre ,  the  problems  attributable  to  the  nature  of  the 
domain  referred  to  ^s  educational  jfesear«vsind  the  underdeveloped 
state  of  research  areas  and  research  cotnmunibies  in  education. 

IJtiile  fundamental  researchers  in  discipline^relevant  to 


education  may 'be  ^relatively  well  linked  to 


the  research 
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coniniunicies  of  their  disciplines,  "educational  research"  as 
such  is  a  conjunctive  domain,  i-.e.,  a  problem-focused  "area 
in  which  knowledge  frpm  at  dozen  or  more  disciplines  is  br'ought 
to  b^ar  on  the  solution  of  a  given  problem^  This  is  especially 
serious  in  applied  work,  but  even  in  basic  research  done  in 
the  der.ivative  disciplines  such  as  educational  sociology, 
the  infai^i^ation  to  be  gathered  is  rarely  restricted  within 
the  boundaries  of  a  single  discipline  or  f^earch  area. 

As  s<?  noted  earlisr^-^th^  fu-rther  the  researcher  gets  froD  his 
''own  specialized  research  area,  the  mora  difficult,  it  is  for_ 

him  to  be  linked  effectively  to  the  Informal  communication 
^  chanT'.els  of  a  field  in  which  he  Is  seeking  information,,  and 
the  nore  dependent  he  becomes  on  searching  the  formal  archival 
literature  of  the  field,  the  less  able  he  Is  to  cut  his  way 
-efficiently  through  the  various  classification  schemes  for 
Storing  and  retrieving  knowledge,  and  the  less  efficient  his 
inEoriPcition  gathering.    Clearly,  the  problem  is  multiplied 
several  times  over  when  the  researcher  miist  gather  information 
from  several  disciplines  or  research  areas  as  a  basis  for  ^ 
particular  investigation>-  Since  the  f'ield  is  not  structured 
in^,a  way  that  might  permit  a  researcher  to  quickly  identify 
who  to  tall9)  to  in*  any  given  research  area  to  orient  him  toward 
the  informal  couniunication  network  of  that  area,  the  character- 
istic pattern  in  educaitonal  research  is  one  ff  random 
infonnation-seeking  behavior,  inadequate  quality  control,  and 
lack  of  adequate  focus  in  th^  investigation  that  is^based  on 
the  insights  and  understandings  gained  form  this  ine^ficient 
information  search.  ^ 
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H .     !n£orr:ation  Systems  and  A^t^ncles 


The  ERIC  system  was  established  i-n  the  1960s  to  bring  together 
the  massive  fugitive  literatuer  of  the,  field  of  education  and 
provide  a  computerized  retrieval  system  that  would  provide 
users  with  ready  access  to  the  available  literature  oa  a  given 
subject.    The  network  of^pec ial ised  clearinghouses  and 
centralized  facilitj-es  not  onlj^  d^cquired,  indexed  and  abatracted> 
and  stored  the  literature  ^n  specific  subject  areas  for  fufure 
ro^ricvalj  buc  it  also  published  annoL-^^enents  cf  materials 
received^  reproduced  and  ir^ade  available  hai^d  or  microfiche 

^cop^^o  usets  vho  requested  specific  itens>  indexed  the  journal 
literature  using  the  same  classification  scheme  as  that  used 
for  the  fugitive  literature,  and  produced  information  analysis 
prodi:cts  reviewing  and  syntliesizing  teh  material  on  selected  ^ 
topics*    Most  recently>  ERIC  facilities  hav$  been  linked  to 

♦  various  active>  information  service  capabiliities  in  SEAs>  LEAs> 
and  other  institutions >  providing  supports'especiaily  to 
practitioners  vho  need  retrieved  information  synthesized  and 
tailored  to  their"  needs  if  it  "is  going  to  be  usad,  ^ 

However,  despite  these  impressive  capabilities  and  the  enor^ 
nious  scale  of  what  the  ERIC  system  has  acliieved,  the  ERIC  system 
has  been  severely  criticized>  both  by  its  users  and  those  who 
have  given  up  on  the' system*    The  focus  of  much  of  the  criticism 
is  the  system's  orientation  toward  comprehensiveness  of  coverage 
rather  than  selectivity'and  quality  control.    As  a  consequence 
of  these  difficulties,  users  generally  face  significant  problems 
in  attempting  to  digest  the  enormous  number  of  abstracts  spewed 
out  by  the  system's  computerized  retrieval  capability,  most  of 
which  are  discarded  by  the  potential  user  as  poor  in  qualify 
Or  inappropriate  to  hlsjueeds>  or  both.    Many  researchers  who 
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Dake  extensive  use  oE  the  ERI^  collection  bemoan  the  time 
waste  resulting  frqm* their  need  to  sift  the  wheat  from  the 
chaEf>  but  continue  to  use  the  collection  because  it  remains 
the  best  source  of  ready  access  to  the  literature*  Many 
^theXSy  however>  have  been  overly  discouraged  by  the  ineffi- 
cient of  using  the  system  and  either  no  longer  use  it  or  use 
it  as  littlfe  as  possible. 


Clearly,  the  ERit  system  is  a  valuable  resource,  but  one 
that  rieeds  considerable  strengthening  if  it:  is  to  be  more 
Widely  used  by  educational  researchers. 


Conclusions 


Information  flow  remains  one  of  the  serious  sources  of 
weakness  in  educational  R/d&I,    Despite  AERA  intei^est  a  few 
years  ago  in  strengthening  research  communities  and  develop- 
ing more  effective  communication  taechanisms  analogous  to 

71  *  ' 

invisible  colleges,      neither  the  Association  nor  NIE  has  done 

much  to  strengthen  4nfomjStion  flow  in  the  field  into  more 

orderly  patterns\     There  has  been  a  vacuum  of  leadership  In 

this  critical  area,  and  in  the  absence  of  initiatives  to  improve 

information  flow  among  educational  researchers,  the  knQwlod^e 

base  of  tjfie  fi^Id  remains  weak  and  fragmentary  and  r/D&I 

functioning  remains  inefficient  and  relatively  ineffective* 


ERLC 


629 
FOOTNOTES 


1.      Thonias  S.  Kuhn,  The  Structure  of  Scienttfc  RevoXutiqns 
(Chicago:    University  of  Chicago  Press,  1962). 


4^ 


2*      For  instance,  see  K-  W*  Deutsch,  J.  Piatt,  and  D^Senghaas, 
"Conditions  Favoring  Major  Advances  in  Social  Science," 
Science,  Vol,   171,  April  5,  1977,  ^ 

3,  Kuhn,  The  Structure  of  Scientific  Revolutions,  op,  cit, 

4,  On  the  sociology  of  science,  social  and  connnanication  structures 
of  research  areas,  and  invisible  ^plleges,  see:     Paul  LazaXsfeld, 

#      "The  Sociology  of  Empirical  Social  Research,"  American  Sociological 
Review,  Vol,  27;  December  1962,  pp,  757-767;  B*  Barker  and 

Hirsch,  eds,.  The  Sociology  of  Science  (New  York:     Free  Press, 
1962);  Gunnar  Boalt,  The  Sociology  of  Research  CCarbondale, 
Illinois:     South  Illinois  Univ^sity  Press,  1969);  Warren  0- 
Hagstrom,  The  Scientific  Community  (New  York:    Basic  Books, 
1965);  Norman  Storer,  The  Social  System  of  Science  (New  York: 
Holt, -Rinehart,  and  Winston,   1966);  Derek  J*  de  Solla  Price, 
Little  Science^  Big  Science  (New  York:    Columbia  University 
Pjess,  1963);  Derek  J.  de  Solla  Price,  "Networks  of  Scientific 
^Papers,"  Science,  Vol,  149,  No.  3683,  July  30,  ,1965,  pp.  510-515; 
Jonathan  R*  Cole,  "Patterns  of  Intellectual  I^luence  in  Scien- 
tific Research,"  Sociology  of  Education,  Vol;  43,  No*  A,  Fall 
1970,  pp,  377-403;  Diana  "Crane,  "The  Gatekeepers  of  Science: 
Some  Factors  Affecting  the  Selection  of  Articles  for  Scientific 
Journals,"  American  Sociologist,  Vo^  2,  No*  4,  November  1967, 
pp,  195-201;  Diana  Crane,  "Social  Structure  in  a  Group  of  ^ 
.    Scientists:    A  Test  of  the  'invisible  College*  Hypothesis," 

American  Sociological  Review,  Vol.  34,  No.  3,  June  1969,  pp.  335- 
352;  Diana  Crane,  "The  Nature  of  Scientific  Communication  and 
Influence,"  International  Social  Science  Journal,  Vol,  22,  No.  1, 
1970,  pp.  28-%l;  Diana  Crape,  Invisible  Colleges:    Diffusiqn  of 
Knowledge  in  Scientific  Coinmunities  (Chicago:    University  of 
Chicago  Press,   1972);  Diana  Crane,  "fnformation  Needs  and^Uses," 
in  C.  A.  Cuadra  angj^  A*  W,  Luke>  ^ds.>  Annual  Review  of  Informa- 
tion Science  anrd  Tedh^logy,  Vol*  '6  (Chicago:  Encyclopedia 
Britannica,'-'IftOv; /]^^^;^  jip.  3t39;         Carnot       Nelson  and 
Donald  K,  PolLI^T^K^^^^;  Cbmmunication  Among  Scientists  and 
En;;lngers  (Le>k"flg^i3^/\^^  Lexington  Books,  D,  C. 

Heath  Ii\c* ,  1970y;);Stp4^  Ai  Nagi  and  Ronald  G*  Corwiib  eds., 
Soclal^ntexts  of  Rfese'^^ch  (New  York:    Wiley,  1972). 

5*      Johns  Hopkins  University^  Center  xflt^esearch  in  Scientific 

.Communication,  A.^ Comparison  of  the  Dissemination  of  Scientific 
and  Technical  Information,  Informal  Interaction,  and  the  Impact  \ 
*  of  informat^lon  Associated  with  Two  Meetings  of  the  American 
Institute  of  Aeronautics  and  Astronautics^    Report  No.  1 
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(Balcimore:    Johns  Hopkins  University,  1967);  Johns  Hopkins 
University  Center  for  Research  In  Scientific  Cominunication, 
A  Study  of  Scientific  Information  Exchange  at  thef  96th  Annual 
Meeting  of  the  American  Institute  of  Mining^  Metallurgical^ 
and  Petroleum  Engineers^    Report  No* j^ltimore: "  Johns 
Hopkins  University,  1967);  Johns  HopicIns)Universit"y  Center  for 
Research  in  Scientific  Conimunication,  The  Dissemination  of  ' 
Scientific  Information;  Informal  InteractjptT^  and  the  Impact 
of  Information  Received  from  Two  Meetings  of  the  Optical  Society 
of  America^    Report  No.  3  .(Baltimore:    Johns  Hopkins  University, 
1967X;  Johns  Hopkins  University  Center  for  Research  in  Scientific 
Conimunication,  Scientific  Information  Exchange  Behavior  at  the 
196j5  Annual  Meeting  of  The  American  Sociological  Association. 
Report  ^o.  A  (Baltimore!    Johns  Hopkins  University,  1967);  Johns 
Hopkins?  University  Center  for  Research  in.  Scientific  Communica- 
tion, The  Dissemination  of  Scien  Cifi#  Inf  ormation*  Informal' 
Interaction,  and  the  Impact  of  Information  Associated  With  the 
A8th  Annual  Meeting  of  The  American  Geophysical  Union.  Report 
Ho.  5  (Baltimore: Johns  Hopkins  University,  1967);  Johns 
Hppkins  University  Center  for  Research  in  Scientific  Communication 
A  Comparison, of  the  Dissestination  of  Scientific  Infonaation^ 
Infonaal  Interaction,  and  the  Impact  of  Information  Received  from 
Two  Meetings  of  The  American  Meteorological  Society^  Report 
Ko.  6  (Baltimore:    Johns  Hopkins  University,  1967);  Johns  Hopkins 
University  Center  for  Research  in  Scientific  Conounication,  A^ 
Study  of  S'cientific  Information  Exchange  at  the  63rd  Annual 
Meeting  of  The  Association  of  American  Geographers^    Report  No.  7 
(Baltimore:    Johns  Hopkins  University.,  1967);  Johns  Hopkins 
University  Center  for  Research  in  Scientific  Communication,  The 
N'ature  of  Program  Material  and  the  Results  of  Interaction  at  the 
February  1968  Semiannual  Meeting  of  The  American  Society  of- 
Heating^  Refrigerating^  and  Air-Condlt.ioning  Engineers.  Re- 
port No.  8  (Baltimore:    Johns  Hopkins  tJnlversity,  1968);  "Wil- 
liani  D.  Garvey  and  Beiver  C*  Griffith// "Scientific  Informa- 
tion Exchange  in  Fsycholoay/'  Science,  Vol.  146,  No.  3651, 
Decetnber  18,  196^^,  pp .  ^  1655-1659 ;  William  D.  Garvey,  Nan  Lin, 
and  Nelson  E.  C^mot,  "Coimnunication  in  the  Physical  and  the 
Social  Sciences,"  Science,  Vol.  170,  No.  3963,  December  H,  ^ 
1970,  pp.  1166-1173;  Carnot  E.  Niei^on  and  Kazno  Tomica,  "Im- 
pact of  the  P^oceedi/gs  on  the  AnnuaX  Meeting  of  The  Associa- 
tion of  Aj-^erican  Geographers:    A  Cio:zpari3<^n  of  ?ciencific  Iri- 
fornation  Exchange  at  the  1967  and  1969  Annual  Meetings,"  The 
ProEesglonal  Geographer,  Vol.  22,.  No.  i^,  July  1970,  pp.  221-226; 
also  some  of  the  articles  in  Kelson  and  Pollock,  op^  cit.  and 
additional  articles  cited  below  in"  footnotes?  10  and  11* 

For  Instance,  see  Richard  E*  Schutz,  "Editorial:  Educational 
Researchers  and  the  R^O  Community  in  Education,"  Educational 
Researcher,  Vol*  3,  No.  A,  April^^974(?  pp.  5-6*  ^ 


7.      Richard  DersMmerj  '*The  Colloquium:    A  Recapitulation,"  in 
Richard  Dershiiaer,  ed.  ^    The  Educational  Research  Community: 
Its  Coinmunication  and  Social  Structure  (Washington;  American 
Educational  Research    Association,  1970),  ERIC  ED  057  275, 

8»      Ibid;    also  see  th"e  pieces  published  in  the  Educational  Researcher 
and  th&  American  Educational  Resb^rch  Journal  Qited  below  in 
footnotes  9-11;  altsossee  Denig^  F*  Polit,  "The  Exchange  of 
Annual  Meeting  Reports  as  a  Link  Between  Formal  and  Informal 
Scientific  Conmunication, **  Educational  Researcher,  Vol.  4,  No.  8, 
September  1975,  pp.  14-15.  \ 

9*      Carnot  fe»  Nelson,  "Abstract  and  Information  Retrieval  Services 

in  Educational  Research:    Current  Status  and  Planned  Improvement,'' 
Educational  Researxiher,  Vol.  3,  No.   10,  November  1974,  pp.  16-18, 
based  on  the  Report  of  the  Subcommittee  on  an  Abstract  and  Infor- 
mation Retrieval  System  for  Educfational  Research  of  the  AEPJV 
Publications  Coinmictee. 

1*.      William  D,  Garvey,  Carnot  E.  Nelson,  and  Nan  Lin,  "A  Pfeliminary 
^  Description  of  Scientific  Information  E^Schange  in  Educational 
Research,"  In  Dershimer^  ed.i    The  Educational  Research  CbrnmanitVa 
op.  cit. ,  pp»  98-1^0;  Center  for  Research  in  Scientific  CoEiaaunica- 
tion.  The  Postsseeting  Dissemination  'iir  Scholarly  Journals  of 
Materials  Presented  at  the  1968  AERA  (Springfield,  Virginia:  * 
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11,      llelson,  Garvey,  and  Lin>  "Scientific  Iriformation  Exchange-Sur- 
rounding the  1968  Annual  Meeting  of  the  American  Educational 
Research  Association,"  op.  cit.;  Nelson^  |  "journal  Publication 
of  fiaterial  Presented 'at  an  Annual  AERA  Meeting,"  op.  cit.; 
Carnot  E»  Nelson,  "The  Communication  Systems  Surrounding  Archival 
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(3)  an  analysis  of  invisible  colleges  and  how  they  function 
by  WilliatE  J.  Paisley;  and  (A)  and  (5)  analyses,  by  NorJnan 
S'torer  and  Warron  Hagstrom  suggesting  that  the  nature  of 
education  as  a  problem-oriented  rather  than  a  discipline- 
oriented  field  and  the  backgrounds"  of  those  who  make  up  the 
field  create  barriers  to  an  effective  sociafl  and  communication 
system  iji  education  that  are  more  complex  than  those  faced 'by 
the  sciences.  ^ 

The  articles  in  this  volume  were  invaluable  for  providing  an 
overview  of  the  information  flow  topic,  for  suggesting  key 
contextual  factors  in  the  educational  research  community  that 
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considered  by  the  leadership  of  the  AERA. 

CranSj  "Inforaiation  Needs  and  Uses,**  op-  c^t. 

See  the  Crane  references  above  in  footnote  A* 

For  instance,  see:    Nelson  and-Pollock,  op .  ci t . ;  William  J. " 
Paisley,  "Information  Needs  and  Uses/*  In  C  A.  Cuadra,  ed.. 
Annual  Review  of  Information  Science  and  Technology,  Vol*  3 
(Chicago;    Encyclopedia  Britannica^  Inc.,  1968)-;  lliomas  J* 
Allen,  "Information  Needs  and  U^es,^^'  in  Carlos  A.  Cuadra,  ed,. 
Annual  Review  of  Information 'Science  and  Technology,  Vol*  A 
(Chicago:    Encyclopedia  BritanniCa,  Inc.,  1970);  Launor 
Carter,  Gordon  Cantley,  John  T*  Rowell,  Louise  Schulte, 
Herbert  R.  Seiden,  Everett  Wallace,  Richard  Watson,  and  Ronald  E* 
Wyllys,  National  Document  Handling  Systems  for  Science  and 
Technology  (New  York:    Wiley,  1967),  Chapter  A  review  or  user 
studies;  Donald  P.  Ely,  "The  Myths  of  Information  Needs,*' 
Educational  Researcher,  Vol*  2,  No*  A,  ApBli.  1973,  pp*  15^17; 
National  Academy  of  Sciences,  Scientific  and  Technical  Communica- 
tion:   A  Pressing  National  Problem  and  Recommendations  for  its 
Solution,  Report  by  the  Committee  on  Scientific  and  Technical 
Communication  of  the  NAS-NAE,  Washington,  1969. 

For  instance,' see:   'Catl  H*  Rittenhouse,,  Innovation  Problems  and  ^ 
Information  Needs  of  Education  Practitioners  (Menlo  Park;  Stan- 
f ord^Research  Institut^,  1970),  ERIC  ED  OAO  976;  Nelson  and  Adams, 
**COntinuity  of  Research^Ef f ort  and  Sources  o,f  Scientific  Informa- 
tion by  Educational  Researchers,*'  op.  cit>;  and  Nelson,  Cereaner, 
and  Hack,  **Educational  Researchers  React  to  the  Educational  Re- 
searcher," op,  cit.  ^  * 

See  the  Annual  Review  of  Information  Science  and  Technology,  pub 
lished  each  year  beginning  in  1966. 

For  Jnstancef^  see  Gerald  J*  Sophar  "Information  Networks, '*  in 
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Encyclopedia  of  Education^  L.  C.  DelghCon,  ed.  (New  Yo'rk;  Mac- 
mlllan  atnd  Free  Press,  1971),  Vol.  5,  pp.  79-8A. 

19.  For  instance,  see:    Bernard  M.  pVy;  Evaluation  Study  .of  ERIC 
Products  and  Services,  A  Volumes  (Bloomington;     Indiana  University, 
1972),  ERIC  ED  060  922-926";  Judith  Wanger,  Evaluation  Study  of 
NCEC  Infonnation  Analysis  Products,  2  Volumes  (Falls  Church,  Vir- 

20.  ginia:     System  Development  Corporation,  1972),  ERIC  ED  06A  527  and 
ED  06A  528;  P*        Greenwood  and  D*  M*  Weiler,  Alternative  Models 
for  the  ERIC  Clearinghouse  Network  (Santa  Monica:    Rand  Corporation, 
1972),  ERIC  ED  058  '508;  Jonathan  D*  Embry,  Wesley  T*  Brandhorst,  and 

,  Harvey  Marron,  Survey  of  ERIC  Data  Base  Search  Services  (Bethesda: 

ERIC  Processing  and  Reference  Facility,  197A),  ERIC  ED  09A  750; 
Jonathan  Embry,  Wesley  Brandhorst,  and  Elizabeth  Pugh,  Survey  of 
ERIC  Data  Base  Search  Services,  June  1976  (Washington:     ERIC,  1976); 
Richard  Brickley  and  Carolyn  Trohoski,  the  Evaluation  of  Educationr 
al  InForrnation  Centers  (Princeton:    ERIC  Clearinghouse  on  Tests, 
.Measurement,  and  Evaluation,  197A),  ERIC  ED  099  A2A);  "Clearinghouse 
Merger  Follows  RAND  Report  on  ERIC  Network,*'  Educational  Researcher, 
Vol.  1,  No.  A,  April  1972,  p.  20;  Carolyn  R*  Davis,  "GIGE:    A  Ques- 
tion of  Cost?"  Educational  Researcher,  Vol.  3,  No.  A,  April  197A, 
pp.  18-19;  J.  I.  Smith  and  Mary  F»  McCord,  eds  * ,  ERIC  Information. 
Analysis  Products  1967-1972  (Washington:    American  Society  for  In- 
formation Science  and  ERIC  Clearinghouse  on  Library  and  Information 
Sciences,  1973),  ERIC  ED  078  862;  Mary  F,  >IcCord,  ed*,  ERIC  Products 
1970-71:    An  Annotated  Bibliography  of  Information  Analysis  Publi- 
cations of         ERIC  Clearinghouses^  July  1970  through  June  1971 
(Washington!    ERIC  Clearinghouse  on  Library  and  Information  Sciences, 
.1971),  ERIC  ED  05A  827;  Mary  F.  McCord,  ed*,  ERIC  Products  1971-1972. 
An  Annotated  Bibliography  oF  Information  Analysis  Publications  of  the 
ERIC  Clearinghouses  >  July  1971  throuMi  June  1972  (Washington:  Ameri- 
can Society  for  Information  Science,'^i9 73) ,  ERIC  ED  077  512;  and  also 
see  subsequent  annotated  bibliographies  of  ERIC  information  analysis 
products  in  this  series*  .    -  ^ 

20.  Crane,  "information  Needs  and  Uses,*'  op*  cit' 

21.  Ibid. 
22-  Ibid. 

23,      RoTVil d  Corwin,  "Beyond  Bureau<^racy  in  Educational  Research  Management," 
The  Generator  (Elewsletter  of  AEEl\  Division  G) ,  Vol.  5,  \*o .  2,  Winter 
1975.  ,  ^ 

Ik.      Crane,  '*Infornati,on  Needs  and  Uses,"  op.  cit". 

25,      The  seninal  work  on  the  **invisible  college'  id^a  was  Price,  Little 
Science^  Big  Science,  Qp_..  c_lt.    This  was  expand<?d  on  in  Crane,  In- 
visible, Colleges,  op.  cit.    Also  see  two  versionJ>  of  a  paper  on 
invisible  colleges  written  for  the  educational  R6D  community: 
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William  J.  Paisley>  "The  Role  of  Invisible  Colleges  in  Dershimer, 
ed*j  The  Educacional  Research  Comiinity^  op.  cit>  and  William- J. 
Paisley,  "Trie  Role  of  Invisible^ Colleges  in  Scientific  luforma- 
tion  Transfer*''  Ediicational.  Researcher,  Vol.  1,  No.  4>  April  1972, 

Paisley,  "The  Role  of  Invisible  Colleges,"  op.,  cic. ;  Paisley,  ^ 
"The  Role  of  Invisible'  Colleges  in  Scientific  Information  Jrans- 
fer,"  op.  cic>;  and  especially  see  Price,  Little  Science,  Big 
Science,  op  >_ci t . 

Ibid.  ^ 


Ibid.;  and  also  see  especially  Diana  Crane",  "Scientists  at 
Major  and  Minor  Universities:    A  Study  of  Productivity  'and  Recog- 
nition,*' Amer^^c^yj^So^  Vol.  30,  pp.  695-714. 

On'sone  of  the  difficulties,  see  Paisley,  ^*The  Role  of  invisible 
Colleges,"  op.  cit>  arid  Paisley,  "The  Ro^e  of- Invisible  Colleges 
■in  Scientific  Information  Transfer,"  op,  cit>    However,  a  good  deal 
of  progress  in  the  gathering  of  evidence  on_  invisible  colleges  is 
noted  in  Crane,  "Information  Needs  and  Uses,"  op.  cit>  and  Crane 
Invisible  Colle^es^  op*  cit.    \^  ^ 

Paisley,  "The  Role  of -Invisible  Colleges,"  op.  c-it,  and  Paisley 
"The  Role  ol  Invisible  Colleges  in  Scientific  Information  Transfer,^' 
^P-  cit.  -      ^  ■ 

Crane,  "Inf oryirftifion  Needs  and  [J3es,y  op,  cit*    The  classical  two- 
stage  diffusion  model  has  been  de^ibed  and  established  empiri- 
cally in  such  studies  aS:    Elihu  Katz,  "The  Two^tep  Flow  of  Com- ^ 
munication, "  in  Wilbur .  Schramm,  ed, ,  Mass  Communi'oations  (Urbana^^ 
Illinois;    University  erf  Illinois  Press,  1960);  Everett  Rogers, 
Dlffusi{on  of  Innovations  (New  York:    Free  Press  1962);'  and,  James  * 
S.  CoL^man,  Elihu  Katjg^and  Herbert  i^enzel.  Medical  Innovar:ion:    A  * 
Diffusion  Study  (Indianapolis;  '  Bobbs-Merrill,  1966);  and  Cr^e, 
"The  Gatekeepers  of  Science,"  op.  cit. 

Paisley,  ''The  Role  of  Invisible  Colleg^,"  op-  cit>;  and  Paisley, 
'''The  Role  of  Invisible  Colleges  in"  Scientific  ^Information  Trarfefer>" 
op.  cit/  "  ' 

The  work  of  Garvey  and  his  dolleagues  at  the  Johns  Hopkins  University 
Center  for  Research  in  ScJ^entific  Communication  has  been  the  key  - 
source  of  this  eviSencej    See  tije  reforertces  cited  above  in  footnote  5. 

Garvey,  Nelson,  and  Lin,  "A  Preliminary  Descrip,tion  of  Scientific 
Informa^on  Exchange  in  Educational  Research,"  op.  cit^ 

Sec,  far  instance,  reference?;  citedahovG  in  footnot^'^lS.  ^ 

xN,  V/*  Scorer,  ''The  Organization  afid  Differentiation  of  the  Scientific 
Coninunity:    Basic  Pis^'iplines,  Applied  Research  and  Conjunctive 
Domains,"  in  The  Educational  Research  Community,  Borfehimer;  ed,, 
■        cit  ^  ^  * 
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'37.      Oj>  this,  see  especially  Cratie>  ''Information  Needs  and  Uses," 
.   >  '*-op\  cit.  .  ^  *  "  '  .  < 

38.      See,  fjor  instance,"  Sopbar,  ''Information  jgetworks,"  op.  cit.;  'and 
'    Lowell  H.  Battery,  ''Information  Management,**  in  The  flfccyclopedia 
of  gducationj,  Deighton,  ed^,  op.  -cit.  '  ^ 

'39.      Sfee  above,  footnote  5* 

40.     .Storer,  **The  Organization  and  Differentiation  of  the  Scientific 
^^.^   Cdtenunity,'*,    op-  cit. 
It  -  ^ 

^I'r    *6ee  :espei^ally  Nelson  "and  Mams,  "Continuity  of  Research  Effort  and 
Sdiirces  of  *3»cienti?ic  Information  by  Educational' Researchers /" 
op^  cit.  ■  . 


42.  Ibid. 


43.      Garvey,  Nelson,  apd  Lin^  "A  Preliminary  Description- of  Scientific 

Information  Exchange  in  Educational  Research/*'  op.  cit.;.  Nelson,  ^ 
^■''Garvoy  and  Lin,  "Scientific  Inf o<nnat;i,on  Exchange  In  Educational 

>      "  -  Research,"  op.^t.;    Otenter  f or^  ^ie^se^^h  in  Scientific  Communication^ 
The  Postmeetitig  Dissemination  in  SchoTarly  Journals  of  Materials 
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tibn  of  Mat;erial  Presented  at  an  AlRual  AERA  Meeting, **  op>  cit^ 


Presented  at  the  1968  AERA,  Jt>p.  cijfi;    and  Nelson,  "journal  Public^-- 

snted  at  an  Amu^ 


44^    Kelson,  Garvey,  and  Lin,  "Scientific  Information  ^Kchange  in 
Educational  Research,*'    op.  cit.  *  ' 


and  Lin,  "Scientific  Information  Exchange  in  ^ 

Re^€ 

.45.^    Ibid  * 
46.  ^  Ibid. 


47*'    Saul  Herner>  Janet  D*  Gr;i,ffi/ths*  and  Mary.  HeinSiSp^tudy  of  Periodicals 
and  Serials  in  Educafeion::/Tinal  Keport  (Washington:*  Herner  ^ind  Co., 
1968),  ERIC  FD  017  747j__ 

48.      Kelson,  "Journal  ^^IMhSS^^  9l  slateTial  Presented  at  an  Annual  AERA 
^  '   Meeting,"  op.  cit, 

r 

4^9*1      Nelciqn  and  Adams^  "Continuity  ^of  Research  Effo:^t^and  Sources  Si! 
Scientific  Ihf onr^ation /by  F,ducaCi^&"nal  Researchers,"  op ,  cU. 

50.  Ibid. 

51*  "'Nelson,  Garvey  and  Lin,^"Scie.ntif ic  Inforpiation  Exchange  Surrounding  the 
1968  Annual  Jf^eting  of  the  American  Educational  Research  Association," 
op.  cit^ 

52-  *  J^elso'n  and  Adanis^  "Cont|n'iibv  oT  RoSf»arch  Effort,"         ci_t . 

5:i.    lis  id.  ■  ■     /  . 

* 


? 


'637 


54.  Nelsorij  "The  Cofl^nication  System^Surrounding  Archival  Journals  in 
Educational  Research,"  op^cit. 

55.  WelsoTij  "Journal  Publication  o£  Material  Presented  at  an  Annual 
AERA  Meeting,"  op>  Vlt? 

56.  \'elsonj  "The  Communication  System  Surrounding  Archixffl"  Journals  in  \* 
♦  Educational  Research,"  op.  cit.  ,    '     ■         '      <  ^ 

57.  H.  Marron  and  R.  Sullivan,  (ffttoVwation  Dissemination  in  Education: 
^A  Status  Report/*  College  and  "Research 'Libraries,  Vol.  32,  1971, 

pp*  286-294,    Marron  and  Sullivan  list  18  such  indexing  or  abstracting' 
services  but  ERIC^s'  CUE  '  (Current*  Index  to  Journals  in  Education)  - 
began  publication  a^ter  the  >larron  and  Sullivan  report.    See  Kelson, 
*  "Abstract  and  Information  Retrieval  Services  in  Educational  Research,''  * 
op,  cit.  ■ 

  <^  ^ 

58/      Ibid.      Marron  and  Sullivan  iist  11  and  we  have  added  the  CUE. 

*  V  I 

59*   *  Prior  to  the  appearance  of  the  CUE, the  Education  Index  covered  more 

Journals  than  any,  other  indexing  service.    However,  even  this  source   '  . 
covered  only  slightly  Tnore  than  half  of  the  357  journals  named  by 
Herner*s  respondents  as  regularly  read  by  them  to  keep  up  to  ;date  in 
the  field,    Herner  et  al*.  Study  of  Periodicals  and  Serials  in 
*  Education,  -op,  cit, 

S 

60.  Nelson,  "Abstract  and  Information  Retrieval  Services  ^n  Educaiional 
Research, "    op.  cit, 

61.  Nelson  and  Adair^s,  "Continuity  of  Research  Effort,"  op;  cit, 

62.  Robert  Ehel,,  ed,  ,  Encyclop^ia  of  Educational  Research,  4th  Edition 
j~  (Riverside,  N.J*:   ■Mac>fcLllan) ,  _  t 

^   -63.  L,  Gage,  ,ed..  Handbook  of^ Research  on  Teat;hiiig,  (Chicago:  Rar\d 

McNally,  i963);    Robert  M*  'W*  Travers,  ed*.  The  Second  Handbook  of 
Research  on  Teaching,  (Chicago:    Rand  McMally,  1973)* 

-  64.      In  1969,  this  journal  underwent  an  important  change  in  editorial 

policy,  so  that  it  is  noK  comprised  largely  of  unsolicited  syntheses 
of  the^cumulative  knowledge  base  of  research  ^rea^,  often  new,  emerging 
*researi|h  areas.  % 


65.  , 


Th^s  has  t^n  published  fcach  year  since  ^1973  for  AERA  by  F,  E.  tPeacock 
of  Itasca ,  Illinois .    The  first  three  volumes  were  edited  by  Fj^ed 
Kerlinger  (Vol,  It  was.  edited  by  Fred  Kerlinger  and  John  B.  Carroll).- 


66*  '    See,  the  sources  cited  ^above  in  footnote  19*^     _  .  ^  , 

67.  ^  Kelson,  Gar/ey,  and  Lin,  "St:icntific  Information  Exchange^  Surroun<iing 
the^  1968  Annual  Mf^etlng  of  the  American  Educational  Research  Associa- 
tion," op>  cit*  ^    ,   ^  '      ^  / 
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Ultimately,  any  r^esearch  or  R/d^X  system  will  be  judged  on  the  quality 
of  the  outputs  it  produces.      Currently,  ^he  outputs  that  have  been 
produced  by^  the  system  have  been  receiving  very  mixed  reviews.  I^he 
tone- of  Dost  of  the  discussion  of  output  quality  that  has'appsared 
ia  the  literature  is  rather  negative.    The  repeated  theme  is  that 
most  of  the  outputs  that  have  been  produced  are  poor  in  qualit'y  and 
have  had  little  influence  on  educational  practice;     little  of  the 
system's  enormous  research  output  has  been  found  to  affect  practice 
and  relatively  few  Of  the  de velopraent  outputs  that  have  been  produced 
can  be  found  in  large  numbers  of  schools  affecting  instruction^  school 
organization^  adiainist rat  ion ,  etc.    At  the  same  time,  the  system  has 
always  produced  ^ome  outputs  o-f  outstanding  quality^    there  are^  for 
instance/ a  good  number  of  products  of  widely  reputed  excellence  that 
have  been  adopted  by  large  numbers  of  school  systeas^    And,  the  field 
has  shown  some  noticeable  progress  in  establishing  itself  and  gradually 
evolving  the  institutional^  perso.mel,  amd  knowledge/technology  base 
needed  for  longer-eerin  developnient  of  the  system's  capabilities*and 
mor^  high^^ality  outputs  in  the  future. 

We  haVe  reviewed  some  of  the  literature  helpful  for^-getting  a  sens^e  of 
what  the  system  has  produced  to  date.     In  this  chapter,  we  will  suomarize 
what  that  literature  has  to  say  about  educational  R/D£tX  outputs  what 
sorts  of  things  have  been  produced,  in  what  quantities,  of  what  quality, 
as  nieasured  by  what  criteria-    In  some  instances,  the  literature  tloes 
not  provide  sufficient  information  on  a  matter  of  importance  to  our 
analysis.    In  these  cases,  we  supplement  what  we  have  learned  from! 
the  literature  with  our  own  observations  based  on  familiarity  with 
the  field.    We  carefully  docunient  the  sources  of  our  statements^ 
making  clear  which  points  are  derived  from  our  owr*  observations, 
which  from  the  Literature, 

In  addition,  we  h^e  done  some  thinking  about  two  kinds^of  developments 
we  see  as  needed  W  improve  the  quality  of  outputs  produced  by  the 
system, 

1)      One  set  of  needs  would  seem  to  be  on  the  macro  or  system 


level  of  management .    BasecT  on  what  we  thivik  we  know  at 
this  point  about  the  outputs  that  have  J>aen  produced  t>o 
date^  what  kinds  of  policy  or  managenient  initiati^ves 
would  sfeem  to  be  rieeded  to  improve  output  quality?  And 
two^  what  would  seem  to  be  the  requirements  for  a  useful 
i?^?  t'ag*?  and  monitor Lng  system  on  system  outputs^  o^e 
^  chat  could,  permit  system  managers  to:     (a)  monitor 

p^^^ress  toward*' the  goal  of  more  high  quality,  widely  used 
outputs^  (b)  develop  policy/managernent  initiatives  to  im- ' 
prove  the  qualify  of  system  outputs  and  the  system's 
capacity  for  producing  them  efficiently,  and  (c)  evaluate 
the  effectiveness  or  particular  initiatives?    We  conside^r  i 
both  sets  of  issues. 

2)      A  second  set  of  needs  would  seem  to  be  on  the  micro  level 
of  management       i.e.^  improving  project  level  management 
strategies.    We'have  started  froai  the  assumption  that  out- 
puts with  different  K?  and  KU  requirements'  are  likely  to 
have  different  manageaent  requirements*    We  have  therefore 
proposed  a  typology  of  KP-KU  rQquiremerf^s'*TEi^<may  be  use- 
ful for  structuring  the  cumulative  development  or^n  inven- 

J         tory  of  management  strategies  appropriate  to  different  kinds 
of  outputs .     "  ^  - 

The  discussion  in  thi^s  chapter  moves  from  the  descriptive  material 
to  morje  speculative  sections  that  n^y- potentially  have  policy  or 
managetaent,  implications .    Sections  I,  II,  and  HI  deal  with  the' 
descripti/^j  ^Tiaterla  1 ;     first ,  son;e  definitional  and  usage  issues 
(Section  I);  then,  a  broad^  overview  of  the  literature,  categorizing 
the  various  types  of  discussions  to  be  found  (Section  II)';  and 
finally^  a  summary  of  what  can  be  said  at  this  point  In  time  about 
the  outputs  that  have  been  produced        iJSsues  of  output  types,  quantity, 
and  quality  (Section  III).. 


Ve  then  move  oa  to  more  speculative  discussions  —  pclicy  implications 
(Section  IV);  data  base  and  monitoring  system  reqiiireoents  ^Section  V) ; 
a  proposed  output  typology  .for  inventorying  oiitpiijt  matiagSment  stra- 
tegies (Section  VI);  and  some  conclusions  about  needed  conceptual 
work  and  research  (Section  VII). 
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I.      DEFINITIONS.  SCOPE  OF  COVERAGE.  USAGE ' 

Most  of  the  literature  that  discusses  the  outputs  of  educational 
R/D6el  focuses  on  ona  or  both  of  Xwo  categories  of  outputs  T 

1)  the  outputs  gf  inquiry:    knowledge,  findings > ^theor ies> 

conceptions^  paradigmSj  etc,^  inclu<ding  (but  not  re- 

stricted  to)  pres^tations  in, print  in  the  form  of  Journal 

articles^  technical  reports,-  papers,  books>  etc;  and 
\ 

2)  the  outputs  of  development  (or  R6tD>:    products >  programs , 
practices/ procedures,  guides,  materials >  "innovations**, 

'    etc . 

in  addition-^  one  source.  The  Oregon  Studies  in  Educatioaafl  Research^ 
Developmei>c>  Diffusion,  and  Evaluations^  describes  three  other  kinds 
of  outputs : 

3)  '^    an  intermediate  output :     i*e*,  an  outcome  of  a  particular 
*  — ^  

*         activity  undertaken  in  order  to  produce  tlte  outputs  of 

inquiry  and  development  as  listed  above        for  instance; 

progress  reports^  technical  reports^  evaluation  reports/ 

-  .  2  . 
etc*;  f 

4)  ^an  event:    defined  as  *'an  outcome  of^ork  effort  that 

results  in  the  occurrence  of  an  observable  transaction^ 
/  or  set  of  behaviors,  e.g.  ,   a  seminar, *a  staff  nesting, 
■  '  a  field  test";^ 

5)  a  condition:    defined  as'  **an  outcome  of  work  effort  that 
creates  a  desired  circumstance  expected  to  endure  over  the 
lice  of  a  prpjectj  or  as  a  result  of  itj  e*g.j^  parental. 
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involvenont  in  planning  school  curricula,  good  staff  morale." 


The  Oregon  Studies  category  schetne  was  developed  in  order  to  permit 
classification  of  R/D5tl  proc<^ss^£  and  patterns  of  ^dnctToning .  As 
described  by  the  JOregon  staff>  initially  their  scheme  had  focused 
only  on  "hard''  products,  i.e->  tangible,  concrete,  transportable, 
packaged  outcomes .    They  included  the  various  intermediate  outputs  and 
added  the  two  categories  of  "events'*  and  "conditions"  as  they  becaiae 
increasingly  immersed  in  the  patterns  of  functioning  that  characterized 
the  R/D£cI  projects  they  studied,  th'S  kinds  of  activities  that  took 
up  the  time  of  the  staff,  and  the  requisite  skills  and  competencies 
that  had  not  received  much  attention  from  the  field,  in  part  because 
outputs  had  ^feen  thought  of  only  in  terms  of  hard  end  products.  A 
good  case  could  be  made  for  including  various  kinds  of  *'soft".  outputs 
in  an  analysis  of  the  educational  Jl/D5cl  system*    There  have  been  large 
Dipbers  of  seminars  and  conferences.    And  certainly  much  has  been 
achieved  in  the  sense  of  cr"^atlng  varloas  "conditions"        for  instance, 
acceptance  of  the  idea  of  rigorous  development  and  continuous  data- 
based  refinement  irn  tfie  production  of  materials^  greater  understanding 
>  of  the  requirements  and  cociplexit ies  of  R/D£tl  funct ioningyili  the  edu- 
cational context,  creation  of  new  institutions,  recruitment  of  new 
per  Sonne  ^l,  etc- 

However,  for  our  purposes,  to  make  this  analysis  manageable,  a  more 
"boundable"  concept  of  outputs  seems  essential-    We  shall  therefore 
focus  our  attention  on  the  kinds  of  outputs  that  fall  within  the  more 
widely  used  def inition^^of  R/D6I  outputs,  i.e.,  the  outputs  of  inquiry 
and  development  or  ^'K6cD^^ 

We  shall  not,  though,  restrict  our  attention  to  only  the  **harder**j 
tangible*  concrete^  transportable  *forms  of  these  outputs.    The  category 
scheme  ue  will  consider  at  some  length  later  in  this  chapter  will  take 
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:  1" 


651 


account  o£  outputs  o£  inquiry  and  dcv|lopciient  that  covec  the  full  range 
from  the  most  amorphous  to  the  most  concrete*    To  illustrate,  the 
range  might  run  Erom:     (a)  -"research  Etndings"  learned  by  a  single- 
researcher  and  found  only  in.  his  head,  to  (b)  those  research  findlTigs 
presented  in  a  scholarly  article  and  later  perhaps  in  (c)  some  syn- 
thesis o£  current  knowledge  in  a  given  research  area.    Or,  for  develop- 
ment the  range  might  run  from  (a)  an  approach  to  teaching  a  given  block 
o£  subject  matter  developed  by  a  single  teacher  and  used  in  her  own 
classroora,  to  (b)  a  fully  packaged  set  o£  materials  embodying  this' 
a;>pro2ch,  for  us^  by  other  ne<iCiit;rs  and  studen^ib,  uidfly  disseminated 
and  used  in  other  school  systems* 

To  '^mmarize,  as  <iepic(?ed  below,  the  educati^al  J^/^ctl  outputs, we  will 
discuss  in  this  chapter  will  be  categori^zey  as  either  outpufs  o£ 
inquiry  or  outputs  of  development,    ATthq/gh  the  focus  of  our  attention 
will  be  on  those  more  concrete  output  forms  generally  construed  as  the 
outputs  of  the  system  (e*g,,    curriculum  products  or  research  articles), 
we  wij.1  also  consider  some  of  the  more  amorphous  forms  of  output  that  - 
could  potentially  become  more  concrete,  tangible  outputs  and^be  made 
available  £or  wider  use* 


amorphous  ^ 


-^concrete 


output  s^^^ 

of  ■ 
inquiry/ ' 

 {■  

[ 

ou^ipu^is 
of 

development 

I 
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II.      OVgai&^IEW  OF  THE  RELSyANT  LITERATURE 

Otir  discussion  o£  educattLoaal  R/D^I  outputs  draws  primarily  on  chree 
bodies  of  Literature ; 


Osl^  descrjlpb  ive  litera-ture  use3 

outputs  have  been  ^produced ;  ^^^^fr 


rjlpbive  Litera-ture  useful  for  gaining  some  ^ehs?-^of 


^2)      an  evaluative  liceratulie  acSlrl'Ised  "tro  che  question  "How 
*      ■    good  are  these"  outputs?'/    as  measured  by  one-  or  another 
itapLlcit  or  explicit  standard;  and  ^' 

^)  a  portion  of  th^  diffusion  research  litsrature^^that  t 
analyzW  the  characteristics  ol  innovations  which  seem 
to  be  related  to  *rates  Qf  adoption  and/or  use* 


ft. 


I,      The  Descriptive  Literature  - 

Host  o£'  the  outputs  of  the  system  have  been  produced  in  print  form 
for  instance'^j  inquiipy  outputs  in  the,  form  of  reports,  monogAphs,  or  6 
journal  articles,  or  technical  outpvi^ -in  the*form  of  curric^luc^  guide^^ 
,  or  instructional  materials,    There  i^,  thep,  a  large  litSature  "of  .out- 
puts.    How^er^  the  ftutput  has  been  enormous  in  t^rms  of  sheer  bukc  afld 
continues  to  be  produced  at  a  j>rodig±ous  rate.    Jfeier  could  probably 
.spilid  a  lifetinte  reviewing  that  ^lit'arature  of  output^and  still  fail  to 
locate  or  review^them  all-*    For  the  analyst  interested  in  gaining 
simply "sense*^ro*f  what  the  system  ha^*  produced,  the  available      ^  ^ 
ser^^iv^  .literature  about  these  outputs  is  highly  useful* 

Ue  ^ve  ^e\\  no  single  soyrce  nhat  ^Uimptis  to  provide  any.klnd  of 
detailed  dijscriptlve  (Jvervlew^of"  this  massive  dtltput       not  surprising 
^iven  the  probably^  nenr-inpTossi  ble  demands  of  a 'task.  Thereto/ 

^however'j  several  kinds  of  sources  one  mighL^  consult  to  get  a  good  sens^ 


of  what  that  output>  or  portions  of  that  output,  lool^like/ 
A.      SunLT^r'v  Tfvervlews 

There  are  useful  sutmuary  discussions  in  the  two  systeip  status  • 
reports  produced  by  OE  and  NIE  —  OE's-l969  publication  Edu- 
$  catijonal  Research  and  Development  in  the  United  States^  and 

^  NIE's  1976  Databook:    The  Status  of  Education  Research  and, 

'  6  '' 

*^ -*         '      '  Development  in  thg  United  States,      The  OE  volume  does  not 

,       provz^de  much  descripLive  material  about  outputs>  but  it  dges 

include;     (a)  a  taxonomic  analysis  bf  ft/D&I  activities>  and 

(b)  a  review  of  assessments  of  the  impact  of  various  kinds 

of  outputs  >  both  helpful  foJ?  providing  a  picture  of  some  of 

kinds  il^and  substantive  foci)  of  outputs  the  system  has  produced* 

The  ^'IE  volume  provides  a  great  deal  qf^  useful  summary  data: 

'  ,      describing  exemplary  ' products  and  t^ir  utilization  histories; 

giving  an  overview  of  the  NIE-sponsored^  products  described  in 

the  1976  Catalog  of  HIE  Education  Products  (their  developers >  - 

.distribution  by  subject  areas>  product  formats^  kinds  of  evalua- 

^  tions  c<^ducted  on  these  prodycts>  etc giving  an  overview  of 

published  educational  research  (tbe  distribution  of  articles  by 

j_  subject  area);  and  providing  some  insight  Into  the  quanti'ty*of  t- 

research  output  (numbers  of  journajt  outlets,  numbers  of  presen* 

tations  at  specific  AERA  conventions>  numbers  of  journal  articles 

and  amount  of  report  literature)*  \  ■  , 
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B>      Cuides  ,\  Catalogues 

*     7   '  ^        Many.  Individual  R/D&I  performer  institutions  publls'h  catalogues 

br'^lbliographies  of  tho  various  research  reports  and/or  dcyclop* 
ment  oOtpVts  the^^have-^^prbduced*^    In  ad3itLon>  pfodup^  guides  or 

t   .      ^        -  catalog#iss  have  been  published  by; 


■'V  ' 


a)      gr<3up3  of  K/D&I  performer  institutions  (for  instance^ 

the  CEDaR  Catalog  of  Selected  Educational  Research  and^ 

8  *  ^  ' 

Development  Programs  and  PTOducts    published  by  the 

association  which  represents  the  interests' of  the  various 

federally  funded  labs  and  centers) ; 


b)      individual  ^/DSeI  spon^OTs,  to  describe  what  has  been  pro- 
duced with  their  funds  (for  instance  >  the  .Catalog  of  HIE 
Education  Products  ) ; 


1  c)      R/b&I  contractors,  or  parts  of  the  federally  funded  network 
of /inst itut ions  given,  the  job  of  e;jtataining,  describing  aa37 
o^evaLuating  some  of  the  system's  outputs,  (for  instance^ 
the  Product  Development 'Reports  produced  by  the  American 
f*  Institutes  for  Research,      or  th«  var^us  inforniaticm 


analy'^sis  products  and  bibliographies  iof  information  aO^lysis 

^       •  11  ^ 

products  put  out  b.y  tha^ERIC  system    );  and  ^  . 


)      various  independent  organisations  working  with  or  without 


funding  fronr  R/DM  sponsors  (for  instancy  guides  produced 

^    .  ■  12 

by  the  Educational  Products  Xaform^tion  Exchange  on 

A  ConsumeV^s  Guide  to  Educational  Ir?hovations  published  by 

13 

the  Council  for  Ba^ic  Education  ). 


Review  Article^/Handbooks  and  Annual  Reviews^  Syntheses, 
Bi^bUogr^hies.  Indesres  and  Publications  of  Abstracts  of 
Research      i        *  *^  ^ 


*Tha  literature  in  this  cate^'.ori^  c^in  provi-de  some  sense  of  the 
hut'^' number  of  .topVcs  cov^ed  by  the.  Tiatd '*^if  educational  research 
arvS  the  types  of  Inqniry  outputs  that  ha^^*  been  produced.  *  ^ 

Tlie-'^ducatinnal  research  field  has  prodUcetf  .(especially  in  the 
lasL  fev%fciars)-a  liirg*e  nu^fjer  o f "  researctr  syntheses^  in  the  form 
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of  handbooks  and  annual^^reviews  containing  ^itical  reviews  and 

bibliographies  o^  the  literature  in  various  research  areas. 

14 

The  annual  Review  of  Research  in  Education      produced  by  the 

■  AERA  each  year  since  1973   is   especially  important  here,  ' 
supplementing  such  less  frequently  AERA-produced  review  sources^" 

(y^3  the  1963  and  1973  editions  of  the  Handbook  of  Research  on 

Teachinfl*^^  and  the  decennial  Encyclopedia  of  Educational  Research. 

.Of  equaf.  importance*  is  the  AERA 's 'quarter  ly  journal  Review  of 

Educati^onal  Research  (especially  since  ,it  changed  its-  policy  in 

"19,69  and, now  publishes  unsolicited  review  articles  ^on  small 
t  17  " 

activs  research  areas).       Also  useful  (if  one  cares  to  dig  a 
bit  deeper  and  get"  closer  to  primary  sources),  are  the  indexes, 

■  etCw  pf educed  by  the  various  indexing  and  abstracting  services 

,  18 
A     of  the  field  and  th^  related,  disciplines* 

In  addition  to  various ^areas  of  fundamental  and  applied  research, 
the  specialties  of  evaluation  research  and  policy- Vesearch  have 
become       prolific  that  annt^l  reviews  havs  appeared  for  these 
specialised  communities  of  rtisearcher^, '  ^ 


16 
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One  ocher  source  should  be  noted  as  well.    As  part  of  a  broader 
study  of  educatiahal  research  output  and  quality,  Caroline 
Perse]^  categorized  one  large  segment  of  the  iresearch  outpu^ 

of     given  year  iottr^  number  of  fbroad  topics  and  she  reports  ' 

20  '  '  X — 

on  their  distribution.       We  will  draw  on  this  analysis^as  }fell 

in  our  p|^sentat43n. 

The  Evaluative  Literature 


The  evaluative  literature  is  of  several  types; 


A.  ^  ^  Iftoress-ionistic  Comment  a 


TTie  li'teracure  IncLudes  a  rather  iVie  number  .of  sta'tements  about 
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the  quality  of  educational  R/D6cl  outputs^  mad«  in  the  course  of 

discussions  of  other  generally  broader  topics.    These_^ppear  to 

be  made  on  a  largely  impressionistic  basis^  without  any  documented 

evidential  basis,    However>  they  cannot  be  dismissed  easily  as 

simply  impressionistic  since  they  include  statements  made  by 

several  oc  the  experts  with  widely  acknowledged  stature  and  eni^ 

21 

nence  in  the  afield.        (Judgments  of  panels  of  such  experts  are 
the  basiis  o^ttny  of  the  more  systematic^  empirical -investiga- 
tions of  quality  of  output  cpr\sidered  below.) 

B.  t    Empirical.  Investigations  of  the  Quality  of  Research  Output 

.There  is  \  ^ubstaatial  body  of  literature  on  educational  research 
quality  that  is  based  on  examination  of  large  numbers^of  publi- 
cations and/or  systematically  selected  samples,    Benjamin  Bloom^ 
for  instance^  ba'sed  his  assessTient  of  the  research  outpjjt  of  the 
preceding  25*  years  on  an  inventory  of      *000  titles .  Other 
investigations  have  been  based  on  carefully  developed  lists  of 

journals  publishing  educational  research^  systematic  stratification 

^, 

of  research  articles^  and  systematic  drawing  of  proportionate 

■  23  * 

random  samples  of  research  articles  to  be  reviewed      (or  in  the 

case  of  the  unpublished  report  literature>  -a  random  sa^^ple  of  ^ 

docu:;ients  indexed  and  abstracted  in  ERIC ' s'.  Research  in  Educatioa 

24 

for  a  particular  year  ),  Several  of  these  investigations  used 
panels  of  judges  selected  for  their  professional  reputation's  as 
experts  in  educational  research.       One  study  used^a  pAnel  of 

jod^fiS  drawn  from  a  random^  san:?le  o5  the  membership  of  the  AERA's 

r  '  25  ■ 

^Divisiort  D  (Measurement  and  Research  Methodology).  These" 

investigabinons  generally,  make  explicit  the  criteria  used  in 

defining  ancl  judging  output  quality  as  well  'and  preyt;nt  distri- 

butions  of  ratings  m^ade^  discussions  of  weaknesse?^  etc.  . 
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C,      Analys^es  Ideatifyin^  Significant  Bodies  of. Research  and/or 
gevelopgfent  Outputs  >  * 

Several  interesting  pieces. in  th%  literature  ideatify  and  describe 
various  bodies       research  judged  b^  the  writer(s)        all  people 
of  stature  in  the  field        to  be  of  outstanding  significance • 


a)  The  report  of  the  National  Academy  of  Education's 
Cocunitcee  oa  Educational  Research  discussed  four 
significant  chains 'of  inquiry  as  illustrative  of  - 

how  disciplined  inauiry  has  had*  a  significant  impact 

*  ^        ^      '  '  26 

on  educational  , thinking  and  practice, 

*  / 

b)  The  report  of  the  National  Academy  of  Sciences' Coni- 

mittee  on  Fundaneatal  Research  Relevant  to  Education 
considered  eight  isesearch  areas  in  which  fundamental 
research  has  had  (and/or  has  the  potential  in  the 

future  to  have)  stgni^icaac,  impact  on  the  solution  of 

27  .  ^ 

high  priority  educat ional  problems .  ^  ^ 

c)  J-  W«  detzels  noted  several  paradigms  that  developed 

cumulatively  froQ  research  \nd  had  significant  impact 

by  chaaging  the  geaeral  concepti^ons  hfeld  by  practitioa^rs 

28 

and  indirectly  educational  practice*       ,  ^ 

4 

d)  In  addition,  the  196^  OE  status  reporH  identified 

lolit  areas  of  significant  research  as  illustrative 

of  Che  :A|iuner  in-*uhich  bodies  of  educational  rc-  / 

search  hid  been  applied  in  educational  development 

'  .  29 

and  could  elso  potentially  affect  educational,  policy- 


e)      Earlier >  Daniel  Griffiths  and  a  panel  6f  knowledgeable 
researchers^and  educational  administrators  Identified 
*what  they  judged  t^  be  the  con  most  signifi<*anj;  eiJu- 

*  / 


catioaal  "research  fiadiags  of  the  previo^is  ten  years. 
^  (This  article  was  published  originally' ia  1967.)^^ 

D.      Artalyses  IdeatityinR  Exemplary  Products Pro^raizs ,  or  Practices 


The  literature  includes  maay  references  to  a  £eu  of  the  early  put- 
standing  system  outputs*    Wide^ly  cited  ^s  illustrative  of  what 
the  system  might  be  Capable  of  producing  some  , day  on  a  wider 
scale  are  the  National  Science  Foundation  Course  Content 
Improvement  Program,  Individually  Prescribed  Instruction^  and 
Sesatns  Street,  * 

In  addition  to  these  References  to  outstanding  46tputSj  several 
efforts  have  been  made  to  identify,  descnibej  and  (ia  some  cases) 
facilitate  the  dissemination -of  some  of  these  products  or  programs. 

For  inst^aape  3  the  identj-ficationj  validating  (in  sorue  cases),  and 
packaging  yif^exemplary  practices"  has  become  one  of  the  in- 
creasingL^  prominent  activities  of  Wate  Departments  of  Education, 

especially  fhose  receiving  federal  funding  to  expand  their  R/D6I 

31  ^  - 

.capabilities.       A  body  of  literature  has  begun,  to  accumulate 

4  32 
about  these  practices  and  efforts  to  disseminate  them. 


In  additionj  two4>rojects  have  ^ought  t,o  identify 'pezeuzplary 
products."    Both  have  produced  information  "about  these  products 
including  information  about  the  extent  of  their  adoption  and 
use  m  school  systems. 

E.  ■    Studios  of  the  Extent,  a£  Adoption  and  Use  of  Development  - 
Outouts 


In  addition  to  the  sources  categotized  above  which  foc>is  on 

specific  selected  outputSj      the  Irteracure  includes  reports  of 

the  findings  of  survey^  which  have  been  made'  of  the  extent -of 

35 

^adopt-ion  a;rtd/or  use  of  various  categories  of  Innovations. 
T^ese  Surveys  are  useful^  both  for  noting"  the  kinds  of  innovations 

P  identified  and  for  ^riving  at  judgments  of  output  quality  (with 
'widespread  ^doptifcn  o6  an  innovation  used  as  an  indicator  of 
quality),  ;  ^         C./  *     "  *^       "  ^ 
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£vaIuatlon  Research  on  Specific  Outputs  or  Bodies  of  Outputs 
^Many  lOf  the  developmeht  products  available  for  use^  especially 

4 

those  produced  by  systematic  have  been  fornally  evaluated 

and  evaluation  reports  are  available  for  examination  by  researchers^ 
policy  makers,  or  potential  adopters.    For  instance,  of  the  776 
products  on  which  data  was  collected  for  the  Catalog  of  NIE 
Education  Products,  NIE  was  able  to  secure  evaluation  data  on 
498  (6-?^),    For  these  493j  the  following  kinds  of  evaluation 
research  had  been  conpl^ted  t 

small-scale  controlled  tests  of 

effectiveness      "  63% 

sfaall-scale  field  tests  of  practica- 

bility J  transportability,  or  * 

^  replicability  78% 

* 

-  large-scale  replications  .  42% 
follow-up  studies  of  impact     ^  '  13% 

-  marketing  or  feasibility  studies  367^ 

Many  of  these  evaluation  reports  are  available  -in  the  files  of 
R/Dc«I  sponsors  as  well  as  the  perforner  organizations.  Some 
are  available  through  the  ERIC  systeni* 

3.      Output  Characteristics  as  Analyzed  in  the  Diffusion  jflesearch 

^  + 

Literature  '  , 

\ 

There  is  a, very  large  diffusion  research  literature  which  we  draw  on 

■     '  . 

fpt  several  cjiapters  of  this  analysis.^       In  this  chaj^ter,  we  will 
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4 

ma*<5  use  ot  analyses  fron  that  literature  which  identify  specific 

characteristics  of  innovative  outputs  which  seem  to  affect  their 

38 

likelihood  of  being  adopted-       We  will  considar  thes^  (and  other) 
output^cha*racteristlcs  In  terms  of  their  policy  and  management  Impli- 
cations for  improving  the 
educational  R/D&I  system. 


cations  for  improving  the  effectiveness  of  outputs  produced  by  ^thes,^ 


4,      Overview  of  What  Is  To  Be  Found  and  What  is  Lacking  In  the 
Literature  * 

The  available  literature  relevant  to  answering  questions  about  edu- 
catlonal  R/DctX  outputs  is  large*    However,  as  we  shall  see  shortly, 
it  does  not  present  a  complete  picture  of  what  the  system  has"  produced. 
Each  source  tends  to  deal  with  only  only  a  small  portion  of  the* to%al 
output.    The  literature  is  least  useful  in  providing  an  overall  sense 
of  what  kinds  of/outputs  have  been  produced.  In  what  quantitias. 
At  best,  an  analyst  can  try  to  pieca  together  such  an'overall  picture. 
At  this  point  in  Cime,  different  analysts  would  probably  present 
raq^her  different  categorizations  of  the  system's  outputs,  and  probably 
even  bound  off  somewhat  differently  what  is  and  is  not  definad  as  an 
educational- R/D&I  output.    Efforts  to  develop  a  useful  monitoring 
system  would  be  somewhat  simplified  if  the  field  could  arrive  at 
greater  consensus  on  these  questions. 

The  literature  Is  most  helpful,  and  most  consistent,  on  questions  ox 
output  quality.    But  even,  here,  there  would  s^em  tO/^be  inadequate 
elaboration  o£  many  of  EhG  criteria  and  standards  used  In  judging  ' 
quality,  an  issue  of  some  consequence  for  identifying  Indicators  to^ 
be  rionltored*  ^ 

Before  speculating  about  some  of  the  policy  implications  and  monitoring 
requirements  suggested  by  current  thinking  and  the  present  state  of 
knowledge  about  educational  outputs,^  let  us  summarize  what  can  be  said 
aborit  these  outputs  at  this^  point  in  time. 
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III.  '    Ot/TPUTS  PRODUCED  TO  DATE 

At  least  three  questions  need  to  be  considered  as, a  basis  for  thinking 
about,  the  system's  outputs  to  date: 

1)  What  has  been  produced? 

2)  In  wha^t  quantities?  \ 

3)  Of  what  quality  as  :?»easured  by  what  criteria  or  standards? 
We  consid^sr  each  of  these  questions  in  turn,^- 

I,      What  Has  Been  Produced?  .  ^ 

Within  the  d^^finLtion  of  outputs  provided  earlier,  ^we  have  attempted  to 
enanerate  end  order  the  categories  (and  sub-categories)  of  output  forms 
discussed  in  <the  literature  and/or  familiar  to  us  froni  our  experiences 
and  observations.    As  noted  earlier,  Other  analysts  would  probably  arrive 
at  some  other  listing adding  some  sub-categories  differently.    The  in- 
tent heife  has  not  been  to  be  totally  comprehensive  so  much  as  to  be  suf- 
ficiently comprehensive  to  illustrate  the  range  and  diversity  of  outputs 
produced  -  for  it  is  this  r^ge  and  diversity  that  complicate  the  prob- 
lems of  macro-level  system  management  and  policy  development < 

< 

We  are  concerned  herewith  only  output  forms.    Any  attempt  to  categorize 
tVe  SLib?:.:in- ivt>  foci  of  eduCatzonal  K/DSI  outputs  would  likelyv  multiply 
the  compleKi'ty  by  a  near  infinite  degree.    To  illustrate  this,  we  have 
repr-^M^i-iced  from  the  literature  three  category  schemes  developed  to  classi- 
fy different  portions  of  the  universe  of  K/D6I  outputs.    Table  8,1  sum- 
marizes the  taxonoriy  developed  by  OE*s' Bureau  t>f  Research  in  the  late  *60s 

vj  analv2^*  ^o'^  OK  allocations  were  distrib^itcd  across  research  functions^, 

  *  39 

i-urriculur.  fields,  target  groups,-  etc.         Table  8,2  come?;  from  a  study 


'  TABLE  8.1 

]US0£  TAXONO>fY  OF  EDUCATIONAL  R&D  ACTIVITIBS 


Research  Functions  Supported 
a 

.Research 
Development 

Evaluation  and  achi'^^gtnen t  studies 

Demons  traCiohs 

ERIC      ■  ' 

Other  dissemination 

Research  training 

Facilities  any  equip^^ent 

Topical  Area  of  Study 


Not  applicable 

Educational  trends,  needs  and  objectives 
The  school  as  an  institution 
Educational  personnel 

Instructional  systems  and  practices*  not  further  specified 
Facilities  and  guidance 

Curriculum  ^       *         *  ^ 
Computer  managed  or  assisted  instruction 
ETV>  ITV'>  telelec^iure 
Social  ipfluences 

Individual  development  and  learning  processes,  hum^n 
Individual  development  and  learning  processes,  animal 
Information  sciences 
Combination  of  above  categories 

Age-Crade  Level  of  Target  Group ^ 

Not  applicable  or  identifiable 
Early  childhood  CO-6) 
Ele:*^atry 

Tnterntediate  or  midcJ^l^  school 
Junior  high  school 
S^-nior  hi;^,b  school 
P^lemeiitary  and  secondri-ry  cornbined 
Pos  tsesi^dary 
Under  grarfc^C^  , 
%       Grofiuatc  a 

Adiat 

Ar^ticulation  between  levels 
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Sptscial  Characteristics  of  Target  Croup 

N'ot  ^applicable  or  identifiable 
Intellectually  gifted^ 

Physically^andlcapped  (vision,  speech^  hearing,  crippled,  etc 
Culturally  deprived,  socloei^onotuically  d  ii;ad  van  tags  d ,  etc. 
Intellectually  handlcapp^ed  (retarded,  brain  damaged,  not  fur- 
ther specified,  etc. 
Emotionally  disturbed 

Foreign  language  speakers  ^  ■  .  - 

Other 

Der.ographlc  Area  of  Intended  Impact 


Kot  applicable  or  identifiable 

I'rban,  "not^  further  specified 

Centrtil  £:i ty 

Suburban 

Rural 

Curriculum  Subject  Matter  Fields 

Not  applicable 

Basic  Knowledge  and  Skills 
More"  than  ♦ne  field 
Language  arts 
Foreign  languages 
Mathematics. 
♦  Science 

Social  studies 
Other 


Acadeniic  Skills 

More  than  one  field 
The  arts 
Languages 
Human! ties 

Mathematics     *  *    -  . 

Natural  sciences 

Social  nnd  behav*ioral  sciences 

Other^ 

» 

Occupat ional  Specialized 
Agriculture  '  ' 
Business  and  office 
Distributive 
ilealth 

, Social  servioei 
Recreational  services 
Technita'l  servifes 
Architecture ,  engineering  *  e  tc . 


Home  ecor.omics 
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6.      Curr iculuni  Subject  Matter  Fields  (continued) 

EdLication  ProfeSsLons 
^Curriculum  areas  not  further  specified 
Ed .  Psychology 
Ed*  Sociology 
Ed .  Administration 
Curriculum  and  Instruction 
Guidance  and  Counseling 
History  of  Education 
Philosophy  of  Education 
Learning  Theory 
Other  curric'jlm  areas 


From  OE,  Educational  Research  and  DevlQpr.ent  in'the  Ur.ited  States 
op.  cit.s  pj>.  125-137,. 
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TABLE  8,2 


SLpBJECT  -areas  of  1,110  RESEARCH  ARTICLES;  ,1959 


^  ■  ;  /      ft    ^ ;  - 


of  i^>Ta  ' 


17 
18 
12 

%  n 

10 

0^ 

8. 

5 

J 

2 

2 
I 


ERIC 
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t    of  rese^arch  articles  pUblisKe'd  in  11-3  journals  in  1969^  or  pres^nLt^  at 


the  i£RA  co.ivGGCion  chat  vear. 


4Q 


T*able  8-3  cont^s  from  an  exaTainatlon- 
:5^and' gther  documfeatii  frW  1956 


of 'ERIC  acaessiQning  oE  research  reports 

1  '  ■  '  ' 

throu^li  197"},  Cle,^rly^  th^  substantive  foci-  of  education:*!  R/DW  out-^ 
"        -*  -     '       *- '  ^ 

*puts  cover  an  enormous  range,  ■        *         ■  ^ '  ^  - 

The  ^aT:egory  scheme  depicted  ±n  Figure  8.1  as  b^lt  abound  ioor  key 
dimensions:    ,the  tyo^'  of  R/D£il  activity  that  pro^uced^the  output;  the 
\  target  audience  for  t]^  output;  its  degree  of  coacretenftss;  and  its 
j^ooi^ehenslvene^s/complexity,   '     *  '         ^         -  ^ 


V 


■  % 
4 


*'  R;^D£fI  Ac_tivlDy :     The  outputs  we  fodus  o'n  are  t^iose  produced  as 

a  result  of/ either  systeirtatic  inquiry     (basic  research  J^apOlied  research^ 
lor, evaluation)  or  deve^lopment  work  Xsyst^matL^R^^  firactic^ba^d  RoD, 
'  01^  the  nixed  mbde^.    Although  clearly  other  R^^I  functnins  su^jfas  need  * 
'      itie^tit iGacion  or  dissentination  or  impreTneafation/utilization  suppdrt  have 
^     ef^ect^ 'andpoutcoaies  oftvariou|  kinds^  these  are  generally  in  the  Eortn  of 

evea|^;Or  conditions  created  rather  than  tangible  products  or  descripdions 
^    -of  findir[g3.,   Ue,nade  this  point  earlier  in  the  chapter.  'Aldhough 

long  ritri,  the  effect  of  new  and  improved  *'con,(i!itions'^  may  have  more  ^onsc- 
qliepct^  foe  the  R'/O^I  systenj  trfTan^  let  us  say,  a  research  article,  Ve  .can- 
in£lu<ie  these  less .  tdjgible  outcomes  and  still-'deal  with  the  syojec^^^ 


<9 


not 


in  ^  Hti^a^ 


^age^le  w.^y,..   We  do,  howler,  try  to  consider  som^kinds  of  amor- 
^  phous  fo^ms  of  oXiEput  in  our  schefi»>^and  we'-shall  gift  to  this  point  shortly* 

¥       T^-irget  Ai;d;enoe:.    Our  category  scheme  focuses  on  two  target  audiences  for  « 
R/D6I  o^icputs:  ^  operating  system  personnel,  on  the  one  jnand,  ,and  R/D6fl 


sysceri  t^ersowe 


1,  on  the  other,    .There  are>  of  cours^>  other,  potential 
airfnieni.o;>       well  -  Coagr'jss,  pLfcblic  interest  ^loups,  fete,  -  and  oiten  o:it- 
putH  are 'p-Kepcired  partiofjlar*iy  tj.^  theso  ether  guoups.     However>  almost  all 
of  C^i^^  OLitputJ^  w  ne-^d  to  coasi^ler  ^Ve  tc^rgettod  at  eithor  operating  system 
p^sOiinV'l  or  t/ol\  system  personnel],  and  therefareT/  these  apc^  the  ^'o^a'Hi^^^ 


^:nc"eb  wj  tti  which  >'^*  *are  o/>nc>^rn<:*d 


4, 


Outauts 

j>  1 

Outputs  Jargetted 
^  at  Res.rarch/R/D6.I 

•r                                                              "       *                   -        '    ^  ^ 

A5      .        A6              A7              A8;,  i 

Al  "         A2            A3  ■ 
.            •                   •        _      ^     .     .    ■     A52                       ^'                     AS^  , 

i 

Output->  'j^argetted 
ac  Practitioners 

1  

'  7  '  '  1^-  

Bl      '      Ii2            B3     .       E-i      ^  -  B5              li6  y 

i                            *  ' 

Development 

i  Outputs 
!  ^ 

! 

i  * 

( 

\  ^ 

Out:mt->  Targottcd 
at  Practitioners 

** 

Cl .           "C2          '  C3        ■     C4        -05              C6              C7  /  C8 
Dl            1)2            D3            1)4     '      .D5             *R6    '  D7 
El            E2         .    E3                           E5              E6            '  - 
.     Fl     .       F2    ■        F3             F4            F5              F6  ■ 

 —  "   •           '  '  

p-T  ■  ^ 

Outputs  Targetted 
at  R/D-SI  Commqnity 

 _,  !  2  

Gl            G2            G3  ,          G4  .    ■  ' 

Figure)  8,1 


Cagegories  of  R&D  Output^Porms 


^.?v  to  Fi^^u^e  8,1:    R&D  Output  Cat:eis;orles 


OljTPti5;S  OF  INQUIilY'  .        ■     ^        /  . 

A,     Outpubs  Targetted  at  Resea|f;ch  Cocmunicy  and  R/D^I  Syscen 

Al  =    HetljOid|^ogical  insights  about  research  approaches  that  ars 
^  net  ^^ective  for  cejrtain  kinds  of  research  questions,  ar,dj|^ 

why;    process^  learhiag  ^bout  research*  strategies  ,  what  . 

the  first^ate  reseaStchei^carries  around  in*  his  head  but 
'     does  not  prepare  ia  a  foi^^ffat  permits'disseTila^tion  to     '  * 
others) .V  *  ^ 

r  '  '  ,  U 

A2  =    Substariive  hunches  on  irquiry  riieptio^.s  (or  potential    ^  ' 
inquiry  cjuestions)     ,  '  ^  ■ 

A3  =    Research  findings  learned  by  researcher(s)  bx^  nQt 


published  or  disseminated  in  an^  forr^ 


p 


=    R^eport  of  findinjs  of  individual  piece  of  research  (in 
paper,  article,  technidal  report,  etc.) 

=    Report  of  findings  of  individual  piece  of  research > 'Vi^h 
.  review  CZ  relevant  liOerUture 
^  s-heoreirroal 

=  fhffeioretical^  oriented 

A6\=    Report  of  "fiiVirigs  of  series  jof  related  researd^inquiries*, 
'With  review  of^feievant  research         *  i>/ 

*  A6j  =■  athe,oretical  *  h  ^ 

^  A62  =  theoretically  ori^ted 


A7  -    Knowledge  synthesis  on  a  researCfT^snrea 


A7.  =  atheoretical 
i  -I 


\/  hi 2  =  theoretic:aUy  c^l^T^ed* 


AB  =    Knowledge  synth^ls  j5n  a  research  area  that  critloues  a 
^  substantive  Research  area  pr  rne£?riodol(»glcal  approach^ 
pointing  to  we^tkneS^ses ,  gaps,  and  needed  worlc 


ASj^  =  atheoretitfal 


A32  -  theore  tically '  9riented       '  -    .  ^ 

OuL:)_u"<^»Targotj:ed  a/ PrArtitioners*   ,   ^       '  ^  ^ 

Bl  T    Insights  about  areas  of  practice  (instrucrtional  .strategies  ,j 
aiiproa^'he-j; ,  teifCher  behaviors,  etc.)  tbot^are  or  ar^e  not  ^ 
^  ^£ectiv^!r  under  cert;ita  conditions,  aEi<f  why,  ^teacht/ig 


cornpetencies  ^d  sltills  (l,e.,^what  the  fir^t  rate  t^ch^:r 
or  administrator  carries  around  ia  hi^  h^ad  but  (^oes^^t, 
prepare  in  a  form  thatr^ertnit?  dissemina tion^-to  others. 
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32  -    Hunches  about  the  applicability  of  a  single  hypothesis,- 

research  findings  of  body  of  research  t^  practice  issues^ 
but  j\o^  prepared  in  a  form  that  permits  dissemination  to 
others'^  v 

B3  ^  "Report  of  inxfividnal  study,  written  for  practitioners 
=    Report  of  Retries       studies,  writter^  for  practitioners 


B5  =    KndwledgG  synthesis  'on  research  area>  written  for 
practitioners    .  ^         ■  • 

B6  ^    Knowledges  synthesis  on  specific  prac^t^^-dor^-ved  issue  ^ 

' — '  — -  9 

'  / 

0,  -D,        F.  •  Ontputs  Targetted.at  Practi tioDers 

C         Ins  ttuct'ional  Dateriais>    The  range^  here  Tuight  be  represented 
by^  on  the  one^hand^  a  single  teacher  using  her,  own  fnaterials 
for  a  single  lesson^  to^  on  the  other  hand,  a  fully  packaged 
"set  of  materials  for  a  subject  (pr  set  o^  subjects)  covering 
gr%ies  K"12,    Illustrative  of  the  gradations  of  concrete- 
*       *      neSs  is  the  follovingi 

Ci  ■    A  s?,ngie_  teacher's  ideas  for  a.  single  lesson^  used  in  her 
'  ciassroojn  but  not  contmitted  to  print  or  other  media* 

C2  =    A  lesson  plan  for  a  single  lesson'  '    ^  ^ 

C3  =    *Aii  outline  or  guide  *for  a  curAculum  unit  ' 

■C4  =^  A  curriculum  guide  for  a  single  subject  fo;r  an  entire 
^^,-^rade"  level       r  .  .  , 

C4^  -  A""curriculum  guide  fpr  a  single  subject  for  grades  K-i2 

C^y  -  A  curriculum  guide  for  all  subjects  for  grades  K-12  " 

C3  =  *A  curricui'^^guic^e  with  lesson  plans  and  other  teaci^or 
supports  ^      t"   ^  .  ^ 

C6  -    C5  with  the  addition  of  student"  toilets' "and/or  workbooks 
,   f      and/or  sourcebooks  of  Instructional  naterlaJfe  for  repro-r 
duction  on  mimeo  of -ditto  machines  '    *  , 

CZ  =    C6'"jJLth  the  addition  of  tests  and  otheii^asseissment  .supports 

C3  =    C6  or  C7  wit;h  the  addition  of  audio-vif>uai  and/or  mulximedia 
mAtorlals  nM/or  othpr^rosoui'cc  mnter^ls  (exhibltb^  d^ir^on- 
st  rat  ions  ^  specitnens  j  etc, ) 


/  • 
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D  =      "Idea  innovations'^  or  "exempl:irv- practices  or  prograns*^ 

wfiicrf  may       made  available  to  othors  in  a  rang*  oE  foray 
varying  in  concfeteness/conprehfensive;iess.    J)y.air.ples  of 
\idea  innovations"  include :  ;i»?ien  edi^ntion ,  schools 
within  a  school^  alcernative  edutation;^    tean;  teaching  or 
clus^Cer  t^Sbhingj  use  of  parapu^^essio,nals  or  aides; 
individualized  instruction,  -iiraependent  study,  directed  * 
study*  or  continuous  ^a*1^ress;    ^ungraded  school  organisation; 
courses  without  grades;    media  cenperst'  resource  centers* 
or  instructional  materials  centers;    peer  tutoring;  ^oy^ 
■libraries  and  other  materials  lending  arrangements;  or 

*  simulation  and  gaming.     (For  exanrples  of  exepiplary  practices 

or^^a^^^^s.  see  subsequent  discussion  in  this  chapter.) 
^  irSl^^rative  of  the  gradations  of  conQreteness  here  is  the  ^ 
following :  ^ 

=    icea  mr.ovat^or.sj  practices,  or  prngraris  us^ii  i::  a  seccing 
bu:  hot^descrlbed  in  print  or  through  use  of  ,otheOr  nedia* 

D2  =  innovations>  practices)  or  programs  described  in 

brie;  sanmary*  statements  to  meet  funSing  requirements. 

D3  -    Idea  innovat?ions ,  practices,  or  programs  described;  in 
evaluations  or  other  technical  reports 
^  ■      ■  * 

-    Idea^4«novatior\Sj  practices*  or  prograns  ^described  especially 
for  disseninat^!Or.  purposes  in  publisjied  articles 

r 

Idea  innovatipT^Si  pr,actices»  or  ptograras  presented 
especially  for  disseminatioTi  purpos^r's  ip  filr.,  videotape/ 
or  och^r  Tned^a  or  nultimedia  forms.  f 

)        ■  ' 

Pac^f^aging  or  idea  innovations^  practices,  or  programs  for 
dissemination)  with  descrip^tive  presentations >  materials 
for  "inscVuctional  and/or  a^i^inistrative  use,  etc. 


^  "    D7  =    E^ten^l've  ^ackeging  of^idea  innovations >  practices >,  or 

?     \         ^  '    progranSi  witlj^How-cb-do-it  infor:aation  and  other  ^?r?le- 

fientation*^pp6rts  as  "well  as  D&  packaging 

V  ^       .  In^^ruction^l  technology,  t^^chnology  for  school  managenpn^ 

■  or  ^  innovate nns  in  facilities .     Included  under  inistructional 

.        I  *   ;  ' — '  ~~  ~ 

*  '  t^z-^-'.iloZy  r:Te  ^"ic^.  hard:;-Hre  ;tnd*  rol^it^d  5oft^nro  itC:*^i  > 

*        ■  a.s  CM  (conputer  assijpted  in$tri:ction) ,  the  T^Clking  Type- 

^  vritiT  and  sirtilar  types  ^of  t^eachlng  nachinesr,  computet;s 
.   '^^^  ar.d  dat^i  processing  equipment)  aud'lo  and  videotape  technology, 

fllns,  ancj  television  (open  and  closed  circuit).  Included 
under  ta^ctkiology  for  schiiol  maaagebent  would  be  the  software 
anc  possib'ly  ^also  the  hardware*  (or  use  of  hnrd*.v-a;re  throijgh 
a  s^?rvict  bureau)  as??oc latod' vlth  Jjchecluling  innovations  * 
^escribed  as:    variable  ntodular  *;chcdullng,  ^Ic>:ib^le 
*  ■"  scheduling  and  back-tO"\back'  fcheduliug;    al'sd  educa^^on 
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FT^dgoment:  iufornation  systems,  education  planning  syy&ens> 
'  and ■  educa*t:ion  needs  assessment  systems,-  Exar>pleS"of 
facilities  innovations  would  be  the  pod  type  of  school 
design  and  the  movable  partitions  associated  with  open  / 
education.     Illustrative  of  the  gradatiotis' of  concreteness/ 
■  comprehensiveness  here  is  the  following:  ^ 

£1  =    Supplementary  4techn*o^gy  for  use       a  single  lesson  o^  * 
brief  unit  (eig.:  ^  film^  videotape^  etc*) 

^  '    E2  =    Supplementary  hardware  for  use  in  addition  to  standard 
curriculum  in  a  subject  (e.g.:    Talking  Typewrit^) 

^  *      ,  S3  =    Hardware/software  so  lundair^ental  to  instructional  strategies 

^  that  _it:  requires  new  teaching  stxategies  and  curriculum 

^ederiign  l^^nguage  laboratories^  nod-type  school 

design)  ) 

/  s  .  . 

/  *  ' 

=    E3,  type  of  output  pac'rcaged ^Ki^h^materials  and  instructional 

suppur  ts  ^(evg.. :,- coui;iuter  .assisted  instruction  packagAS^  ^ 

E5  =    EA.type  of  output^  covering  more  than  one  grade  level  and/or 
r:ore  than  ona  subject  area  (e.g.:  ,IPI) 

E6  =    Technology  ftj^  school  management  affecting  school-wide 
ahd/or  disrrict-wi^e  policies,  appi;oaches,  etc.  (e.g.: 
r^nagement  information  systems,  planning  •systems,  assess- 
ment systens »  etc) 

F  =     Miscellapeotis  OutpqjtSi    Examples  of  other  kinds  of  outputs/ 
thati  nUg?it  be  targetted  at  practitioners  might  training 
progranis  <ft  new  kin<^s  or  packages  bf\  tests  measures.  In 
either  ca^e'  tn«  ■rang'e' oi  gradations  in  concreteness  would 
represent  increase3  cover;ige  fror;j:,  single  lessons  to"' 
un^s.  to  'courses,  to  mult4.-^ade  levels,  etc.;    and  ^ 
^_   -increased  tc^jprehensivyiegs  in  packaging^rom  descriptions 

^o  models,  to  inclusion  of  ^ample  mea^urw*  to  sdC^ports 
X  *  of ,  vaciotm  kinds ^XbaWtxiVdo-it  guides,  etc*) 


Outputs  Xa^^5>tted  afc' R/O^I  Corraiuni't^.    Included  here  might 
be  various  kinds  of  ofga;ii2ation3l*or  dnter-org^nizavional 
arT*an4^^.snt0  6^^  n^'t?j»oi^  deiVeloped  to  support  R/D^J 
ful^<:t/.bglnS;    jiotv^fo-d^CLt/Cjcp^  of  materials  (for  i^^tance, 
_  ^  /  b^sed.  on  ^tMbursantiit^nr^^'lJ^  nAalysis  *of  *  teclj{3ical  assistance 
*    ^.  ■  srirategies7,or  iyc^ti^atl^  functite?t^l  or  * 

■  r  sS^jjp-fuisr^tionaZ  ^p<ic:j^*5;t3gA  d^^lofted^  ^s  tematically  into 
"    jTi'tjCeVl^ls  -fa/'  as'^^^biii^^p-  v-^tir^ining  programs;  data 
*  sy^^em^' or -p^i^nn^J^*  tjiqS^^s ^''q^.^ Hlias trat*ive  of*  the  . 

^  ^         '    y     po^?^i^)^,^-aZa^fit)f;yiti  cdoci^irji^fiy^^^onjprel^nsiveness  4of 

■  Idea  far/:sjch' A".  olJtrpMfe<trcscrty(.''d'ljiri4^J^  in  print.' 
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G2  =    Model  for  such  an  output  developed  syt|aratically  and 
described  in  detail  in  technical  repor 

C3  ^    C2  type  of  output  developed  along^'with  supporting  materials 
'     to  pemit  iniplom^^tat  ion  by  others  ^ 

G4  =    Packaging  ^^F^^Gp  typ«t  of  output  along  with  impl^^tnentation 
guides,  multimedia  materials,  plus^lists  of  contacts- 
for  .observation  of  output  itnplenented  at  various  sites, 
\         exchanges  of  information  anong^users  antf  also  betveen 
users^  and  cievelopers  and/or  fot  technical  assistance  to 
support  implementat  ion  ,*  '  .  ^ 
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Gejieraiiy,  oucpucs  of  inquiry  or  cfevelopnent  work  are  prepared  samt>what  ' 
difffcrrontly  cJcpendlr.^  on  which  of  chese  two  audiences  che>  are  intended 
to  reach.    Articles  written  for  r^earch  journals,  f  or  , instance ,  are 
likely  to  describe  a  research  study  and  its  findings  differently  froo  • 
articles  "ct^veVing  the  sa.-ne  material  ^but  written  for  the  magazlnei^  read 
primarily  by  practitidners.    Development  outputs  prepared  for 'use  by 
K/U^l  system  personnel  are  sanetimes  no  diffe^rent  in  forn  f rorn'analogous 
output3  pr^epared  for  opeVatijig  system  personnel  Ce.g.>  tjrainiiig  programs). 
But  occasionally,  they  do^  di%f^r>'  with  considerably  :?,ore  explicit  atten- 
tion  to  K/DLI  systeni  issues  and  systemic  requireT*ents  in  these  outputs 
Jt^'Sl^r^J  f-.T  K/^il  personrrsl.  si«aU  ar^jue  later  ij^trls  chapter  for  ^ 

ziore  such  system-oriented  outbiits. 

Degree. Of  Concreteoessi    El/6£tl  outputs  differ  In  the  extent  to  which  cnev^ 
jjave.been  packaged  in  concrete  f orris  whfch  can  be  passed  on  to  others  a:id 
used  by  th£;n.    Most  conceptualizations  include  -within  the  definition  of  * 
'-^outp'oxs"  only  those  lor^s  of  informatlonj  programs,  etc-  that  ^ave  be^n 
packa^jecf  in  concrete  for^i^  (In  print  and/or  throug'h  use  of  socg;  other  nedia) 
Some  TDlher  d^finltLoTis  also  include  su^jih  categories  of  outputs  as  ''ejcecipiary 
practires*'  despite  the  fact  r.any  (prob^ibly  nost)  such  practices  have 

not  bee,'^  packaged  but  exist  , only  in' derjo:istration  site?  (generally^  the 
schools  vjhere  they  were  developed)  where  they  can  be  observed* 

Our  catc^:)ry  schere  includes  not  only  concrete,  pack'aged  products  and  ob-. 
serv^lt:  but  ^unpackagtid  practices  but  also  o^Jtconies  of  R/DSI  thnt  are  even 
less  concr^^te  in  that  they  nay  exist  only  in  the  heads  of  those  who  have 
carried  om  pntXicuUir  ^/D6l  activities  -  e.;;.,  research  findings  arrived 
at  by  cL  r^he^rcher  b^it,  :iot  (as  yet)  des>:xibe;d  ir.  print;  teaching  techniques 
dt'^^ic^v',  Sy  a  tS'^cot;*'   (or  a  Leam  oi   t*r.ic4iers>  b;it  not  (as  yet)  captured  In 
^  for--  Ca   ■if!eotap'>,  .for  instan^ie)  th^it  could  be  ciisseminated  to  other;>;  or 
Kyb  pr'j  '-'-jre^  used  by  a  highly  successful  d^-^velopj^en:  organization  but  not 
(;!^  yc*  h         r ibed  in  ^  -jevy  that  couH  n*i/tc<^  this  valuable  krrpwledge  acces- 
-lihle        D^-^  r*.--.t  nf  t\ii^  RiD  conri'jnlty,  ^Al:hou>^h  it  wot;ld  pi;obnbly  b/e  note 
correct   r^o  r';fVr  to  t'hv^e  ;is  'Y'^^^?^^  i*^^^'  output.^,  we  ^Include  then  here  in 
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our  cate*;ory  scheiite,  and  will  argue*  later  for  policies  that  facilitate 
the  tr^nylatiori  of  more  of  these  amorphous  '^potential"  outputs  i[ito  more 
conrete  forms.  '      '  .  "  ^ 


Dei^rbe    of  Co?nprehens iveness/Con\plexi ty ;    Outputs  also  differ    along  a 
continuum  of  comprehend iveoei>s /cojnple>:ity .    "Comprehensiveness**  is/a  term 
we  find  oore  appropriate  for  outputs  of  inquiry.    Ue  use  it  to  try  to 
denote  th^  range  of  forns  fro::i>  let  us  say:     (a)  a  report  of  a  single 
research  finding  in  a  paper  or  an  article  in  a  scholaiJ^y  journal;  to  (b )  ^  - 
a  rcvitiw  of  relevant  literature  that  synthesizes  all^the  previously  pub- 
li=^heJ  research  relevant  to  the  framing  ^  a  particular  new  research 
c^-.-^-^-L  ;on  a:id/or  tht*  d^^si^n  of  a  particular  new'study^   to  (c)  a  review 
.ar>i:cU,  bibliographical  essay,  or  "stacfe  of  the  art**  paper  synthesizing 
and  critiquing  all  the  current  knowledge  in  a  given  research  area."  -Tlie 
particular  ip.quiry  outp-jt  presumably  becor.es  more  meaningful  to  (and 
usable  by)  the  field  the  -ore  coinplexly  ^nd  comprehensively  i  t  is  packaged 
aJPng  wi th^ Other  relevant  research  findings  and  theoretical  cons t ruccs  -that 
need  to  be  understood  to  nake  effective  and  valid  use  o  £  the  new  in f oi^i^t^ ^  i on 

In  the  case  of  d^jvelopT.snr  outputs,  both  cocprehensiveness  and  'comple?:i  ty- 
see.?  '^.-j:.>ropriate  concepts  to  focus  at ct^nt London  the  range  of  itjgms  included 
in  a  particular  output,    Tnese  \outputs  might  range  in  form  from,  for  in-* 
stance:     (a)  a  lesson  plan  for  teaching,  a  slr^gle  lesson;  to  (b)  a  curriculum 
^rjide  for- a  whole  new  course;  to  (c)  a  curricula::)  guide  fcnr  ^teachers  alo:^g 
'with  st'ident  vorkbooks  and  other  printed  learning  materials;   to  (d)  package 
c'with  th^^^addition  of  multi-media  supplenent'ary  materials  and  perhaps  too 
.1  cop.prt':it:n^LV3  ^ralninij  program  for  te^^chers;  co  (e)  d-type  package  but 
for  a  reading  prc^rar,;  to  (f)  a  d-type  package-  for  for  al^  sub- 

t  *^tter  art-a^;   tc  ^9/)  an  f-type  oir'^a^e  w'^ith  ndditionnl  ^nidf>*lir?.^  and 
plan^j  for  i^jor^aniziil^;  the*  school,  with  ad:7.1nistraciyG  supports,  accomp^my- 
ir\z  rian^i:\^'Z\ei\t  incorr^t  i  on  sys  ttm^,  measur^meat  Instrruments  j  etc .  ^ 

rlgur^     *  i  Ti'pr^f&enl^  a  first^c  at  tiie"1<Tn'i  of  category,  tsclieme  we  have  in 
n:nd.     Tiri  half  of  the  fi^-^ure  shovs  th^  ran>;0  of  inquiry  ouLputs  we 
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have  cunsiTiereci^  both  tho^e  tar^titsed  at  res^archersj  and  other  YjD^^l 
system  personiwl,  ori  the  one  hand,  and  those  tarj^etted  at;^  operating 
systtif^t  per;5onncL,  of:  the  oriier.    'fite-^bottom  half  of  the  fl^ire  depicts 
Che  range  of  dev^; Loprnent  outputs^  again  targected  at  both  group=.  In 
a  ve^y  rough  way*,  we  attempted  to  place  entries  in  the  figure  ftOTi  left 
to  right  CO  Indicate  incpeasinj;  concretenes^  and  comprehensiveness/ 
cofTiplexity . 

■  ^ 
Several  points  we  have  tried  to  shov  in  Figure  8.1  need  to  be  underscored 
before  wq  proceed  further.    One  is  the  enorr.pLis  nu:T.ber  q f^  ^yj^'gg  or  outputs 
forir^  produced  by  edijcational  RID,  which  greatly  , complicates  Sn;-  efforts 
that  ni;i:it  bt:  T.j'ie  to  i^^valop  inventories  of  ou^putii,  or  to  con^jlcier  de- 
veloping standards  or  criteria  for  assessing  the  quality  of  outputs,  or 
to  undertake  an  actual  quality  ^ontrcl  sifcing  through  the  existing  out- " 

^  puts  to  separate  the  strong  fro-  the  weak,  the  valid  from  the  invalid 
approaches,*  etc.     ^ach  type  of  output  form  needs  to  be  understood  in  teris 

'^f  its  o'ATi  reriuire.'nen::s  and  its  0".^n  use  patterns^  and'^heref ore  a  huge 
number  of  types  means  a  standard  setting  and  quality  assessment  task  of 
gargantuan  proportions.  ' 

Second^  the  r^ngin^  of  types  alon^;  the  amorphous/concrete  and  si-::ple/ 
conprehensive  dir.ensions  has  to  be  approached  carefully  to  aVoid  arriving 
ac  erroneous  policy  implications.    There  has  been  a  tendency  in  the  ed^jca- 
tiorial  r/D^C  enterpri^^e  to  equate  greater  concreteness  and  comprehensive- 
ness/cornplexity  with  "betier'\    L>  to  a  point,  we  would  not  quarlel  vith 
this.     For  instance,  unquestionably,  new  knowled^^e  that  is  generated  and  ^ 
fiew  t-jchrlq^ies  that  are  developed  are  "better"  (from  the  perspective  of 
adv?^nTlnr.  the  state  of  developr:ent  of  a  given  research  area)  whea  they    ^  ■ 
ar^'  cit's-rfS*-d  in  Drin:   (or  through  sone  other  ^ediurrt)  rather  than  s^>ply 
b-jin;;  *=;torc  1  a'^ay  in  t.ie  heads  of  those  who  ger^.erated  the  new  knovleJJe* 
'rheV  beco":e  acpessLble  for  thet  re^iC  of  the  firld  to  usfc,  and>  eqiMlly 
lini'ortant,   CO  cricLq-^e,^    Only  Wjit-n  other  knowledge  is  brou^;ht  to  bear  on 
thei.*_'  f  ir.di:i^;'5 ,  nn'J  ^iu^jstions  aboif.E  their  validity  are  raised  and  a.-.sessed,. 
can  wl  htT^n^^'^on^' >[y  certain  of  cho  soundncjo  oT  this  new  knuvlcdgf^.  Ar.d 
cl^^.^rly,  <i  r*^js^arciu  finding  bec^^^i^.-s  ■norc  useful  tht*  rsort*  il  is  pre^>€*n t'*^J 
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in  a  way  th.-it  rclact*^  it  to  che  existing  knowlec!^,e  base  in  ar^a 
and  shos*^  ho'.v  it  adds  co  chac  kn6wLedge  base\  suggests  whac  previously 
dtivelopt^l  intoranciun  it  cally  i  nt:o\Gue?;cion>  uhat  nciw^^^cfuestiofis  it 
raiseSj  and  perhaps*  too  vhat  appli'Cc^io^  implications  may  be  !unc<^d  at* 
when, it  is  related  to  other  information  alVeady  known>t;tc*  Therefore, 
the  more  coacretely  an  auiorphous>  '*poceacial"  research  output  is  ,pjre- 
'    <>eated,  iTnd  the  r,ore  conprehensively  it^s  treated  in  the  presentation, 
the  ^'better"  {l-e<,  th^'more  usable  "the  new  information)  for  the  fi^ld< 

^fowever,   this  is  not  nece<;sarily  equally  true  *for  devjlopnent  outputs. 
There  can  be  3P,o  aue^^tioa  that  in  the  case  of  developnent  technTgues 

Aa\<i  above  would  hold  true'  -  the  nori^  fully  they  ^re 

described  for  the  ft^st  of  the  field,   the  nore  accessible  they  are'  tor 
review  and  criticism,  and  the  n:ore  they  are  related  to  existing  techniques 
in  use  (and.  knowledge  about  then),  the  better  for  the  field\    "However,  in 
^  the  case  of  development  oujpu ts >  sone  of  the  uiore  amorphous  and  simpler 
outputs  may  in  fact  be  oore  usable  Cand  more  widely  used)  than  the  highly 
concrete  and  complex  products.     Part  of  the  reason  for  this  is  related  to 
costs:     the  rr.or^  concrete  and  especially  the  hore  complex  and  comprehea" 
sive  an  output,   the  rore  expensive  it  is  likely  to  be  to  produce,   to  pur-  ^ 
chase,  and  perhaps,   too,  to  use".    A  set  of  supplementary  materials  is 
likely  to  be  far  less*  expensive ,   for  instance,   than  a  multJi-media 'k-12 
instructional  progra7<,^  and  the  more  complex  products^  there*fore,  are^iike- 
ly  to  be  sinplyoui  of  reach  for'the  budgets  of  most  ^hool  systems-  In 
addition       costs,  the  increasing  complexity  and  comprehensiveness  of  a 
product  makes  iinpiementation  uq^e  difficult,  'either  bpcause  it  nray  require 
.  a  gre.it  deal  of  unlearning  and  rt^learning  by  practl txoners  and/or  because 
it  requires  a  great  deal  more'thange  of  existing  procedures^  organization- 
al  s  true  t«:ref^ ,  striffLnt^,  etc*     The  more  change  required,   the  more  difficult 
it  is  likt-l>   to  be  EO  get  the  product  adoiy^ed>  and  (if  adopted )  implemented 


ef f ec  c  i  ve  Lv 


Fh/^ySe  factors  need  to  bo  taken  into  account  when  rccomTnendat  ions  are  made 
that  call   for  increa^ln/.roiicrcl^esis  and  complexity  'in  product  develop;r.t;n t , 
Miiie  pai.ka^in^;  exemolary  practices  and  prograjns  in  more  concrete  and  mort: 
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comprehensive;  forns  (ulth  ceach^^  guides,  l*earning  n^ccrlals,  etc.)  \^ 
may        calic-d  for.  if  :>rrict-ice-based  developnieat  is  co  h.ave  subiitaiicial 
impact  outside  the  sites  where  the  work  originated,  the  greater  the 
costs  of  tht;  packaging  a;id  the  greater  the  complexity  of  the  packaging, 
the  ^ore  resiistance  It  is*  likely  to  encounter,  *and  this  Dust  be  under,- 
stood  if  v:e  are  to  arrive  at  a  more  workable  balance  among  requiromentg . 


Finally,  we  need  to  point  to  ^he  imbalaace  of  outputs  targetted  at  the 

^different  audiences  of  interest  to  us.    Most  inquiry  outputs  are  targetted 

at  researchers  directed  to^  devising  more'  effective  modes  of  presenting  this 

inforir.atLC^rL  ,x  ,>r  cor.3...rp:io.T  and  U3^  hy  practitioners^    In  ttte  case  of  gc— 

velop:T:ent  D?.:tputs,*  the  imbalance  is  in  the  other  darection*     Most  of  these 

are  targotced  at  the  operating  system,  which  isN  no  doubt,  as  It  should  be. 

However,  1:  the  stac'e  of-  the  art  of  R/D£(I  functioning  in  education  is  to  ^ 

develop  further,  and  if  the  systeiri  is  to  progress  ^o  nore  mature  patterns 

of  functioning,  niorer  attention  will  need  to  be  focused  on:  elaborating 

R/D£(I  processes  (through  state  of  the  art  papers,  guid^t^ ,  process  analyses, 

etc.)  so  as  to  strengthen  the  fie  Id '  ^(technology  base;  structuring  existing 

ft  ■  . 

kncVvledge  a:>d  technology  into  training  programs;  developing  and  nakiog 
tensive  u^e  of  cormL^nication  mechanises  for  information  flpw  in  the  field; 
etc*    We  3hall  Return  to^these  points  mter. 

Having  nSx  coftsidertid  what  kinds  of  outputs  the  s^ten  has  produced/  we 
now  iKJ-n  zo  the^'^^estiCjns:     in  what  quantity?    of  what  quality?  asCmeasured 
what  criteria  or  standards? 


S 
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2.      Quar.tities  oE  OutpLft:    How  Much  Has  B&ert  Produced? 

There  is  no  valid  way  to  answer  the  quantity  question  except  to  say, 
that  whatever  the*precise  numj)er  it  will  be  enormous  enough  to  be 
mind  boggling*    A  few  indicators  should  suffice  to  make  the  point, 

J  * 

Table    8.5    reproduced  from  KXE's  1976  Databook  is  useful  for 
illustrating  the  large  quantity  of  educationa^l  research  literature 
produced  in'rcccnt  years*    As  shown  here^  tlfe  Current  "Index ^ to 
Journals  in  Education,  which  began  publication  in  1959^  indexed  a 
total  of^  102,000  journal  articles  published  during  the  six  year 
peri'od  ^1969-I974j  an  average  annual  output  of  17,000  journal  articles 
per  year.    Research  in  Education,  the  ERIC  p^ublication  which 'began 
publication  in  1967  and  provides  sffcstracts  of  accessions  generally 
from  the  unpublished  document/report  literature  of  the  fi^ld,  pro- 
vided information"  on  a  ^^^^^       nearly  85^000  documents  over  the 
eight-year  period  between  1967  and  1974,  an  average  of  more  than 
•  10,500  reports  produced  per  year,    0£  course^  there  is  no  way  to 
equate  nunj^ers  of  reports  and  journal  articles  tb  amount  of  new 
''knowledge"  gained  by  the  field  or  significant  achievements  made  in 
understanding  or  problem -solution.  "^Thc  relationship  between  amount  ^ 
of  research  performed 'and  ^^amount  of  r>ew  knowledge  gained  is  always  ^ 
a  tenuous  one^  even  more  tenuous  than  the  weak  (and  often  inverse)  ^ 

relationship ^between  quantity  and  quality.    Bet  clearly^  a  great  ' 
*^ 

deal  of  research'output  has  b^en  reported  on  in  print. 

Since  development  outputs  have  not  gener^ally  been  indexed  in  the  manner 
that  res(?'irch  outpti'ts  have^  it  i,s  erveh  more  di icult        get  any  sense 
of  the  number  of  produetSj  prograTnSj  ^itc.    that  have  been  developed, 
even  when  we  restrict  our  attention  to  only  those  that  have  been 
developed  in  packaged  product  form  (thereby  excluding  educational 
materialdj  practices^  approaches^  programs^  etc-     that  have  not  been 
packaged  for  dissemination  and  use  elsewhere).    On^  ind\cator>  thou£^h>  ^ 
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that  canprovide  a  sense  of_  the  number  of  development  outputs  that 

*have  been  produced  is  the  number  of  products  described  in  a  source 

42 

s^uch  as  the  Catalog  of  MIE  Education  Products*       This*  catalog 
provides  informatiori  about  development  products  of  R/D&I  contractors 
or  grantees  currently  or'lormerly  receiving  NIE  funding.    The  catalog 
includes  tabular  preseatations  of  data  on  776  products  identified 
in  this  1975  survey       curriculum  materials^ " trainihg  materials, 
handbooks  and  manuals,,  tests  and  measurement  instruments,  and  modf^ls. 
To'put  that  figure  in  perspective,  it  should  be  recalled  that  NIE 
provides  at  most  167*' of '  total  federal  funding  for  educational  cl/Did, 
and  that  in  addition  to  R/o&I.in  the  strict  sense  that  it  is  carried 
on  with  private  sector  or  ope^r^Jting  system  ^unds  a  gr^at  deal  of 
more  Conventional  (what  we  have  called  elsewhere  ^'practice-based" 
or  ''practice-related**       development  work  is  carried  on  without 
federal  funding*    The  total  development  output,  then,  is  enormous* 
Even  within  any  strictly  defined  problem  or  subject  matter  area^ 
the  full  array  of  output  availab^le  .for  use  is  likely  to  be  prodigious, 

3.      Quality  of  Outputs  Produced  to  Date^ 
f 

The  assessments  that  have  been  made  of  the  quality  of  educational  \^ 
research  or  R5tD  outputs  tend  to  fall  into  one  or  another  of  two 
categories:    eithei;^a)  discussions  suggesting  that  the  bulk  of  what' 
has  been  produced  is  quite  poor  in  quSJity  and/or  of  little  signi- 
ficance, or  (b)  others  that  identify  a  relatively  small  number  of ^ 
outputs  of ,  outstanding  qua lityend:  Influence  ♦    Let  us  consider  first 
the  literature  assessing  the  quality  of  educational  research,  then 
evaluations-  of  available  development  outputs*  ^ 

A.      Educatidnal  Research 

^    a.      Research  Output  as  a  Whole 

> 


i 

9 


f1 
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i.      Assessments  of  Generallly  Mediocre  Quality  o£ 
the  Output:  as  a  WhoI& 

Negative  assessments  of  educational  research  are 
45 

quite  numerous.       The  terms  and  phrases  that  have 
been  used  include  "mediocrej"  "less  than  mediocrej" 
^'inadequate  j"  "incompetent,"  "invalid/'  "trivial/' 
"weakj"  "poor/'  and  *'of  modest  significance  and 
quality/'    Illustrative'  of  the  kind  of  ciriticism 
that  has  been  made  are  the  fol  lowing  Vxce^pts  from 
the  report  of  the  National  Academy  of  Education's 
Committee  on  Educational  Research: 

■  s 

'Not  all  that  has  passed  for  "educational  research 
has  been  disciplined  to  this  degree.  Investi- 
gators rarely,  control  ^che  instructional  methods 
or  administrative  procedures  about  which  con" 
elusions  are  drawn  sufficiently  for  the  findings 
to  be  reproduced  by  others.    Investigators  not 
infrequently  frame  studies  to  advanceVvidence 
favorable  to  a  conclusion  or  innovation  in 
which  the  investigator  believes,  rather  than 
testing  the  proposal  against  reasonable  alter- 
natives*   The  final  report  is  sometimes  little 
more  than  an  essay  expressing  beliefs  held 
before  the  study  began,  embellished  ratheT  than 
supported  by  the  study  itself*    Even  the  para- 
phernalia of  statistical  analysis  may  be  used 
to  silpport  preconceptions.    For  example,  a 
writer  may  emphasize  that  some  .experimental 
'    procedure  produced  a  '^statistically  significant" 
difference  and  ttitreby  confirtned  his  working 
hypothesis,  whereas  another  writer  who  doubt 
the  hypothesis  could  as  easily  stress- the 
smail  m^gnitud^  of  the  difference  and  question 
whether  the  hypothesis  has  any  important 
explanatory  power,  ^ 

We  believe  that  not  more  than  one-teath  of  the 
doctoral  dissertations  in  Education  an<3  not 
more  than  one-tenth  of  the  work  published  in 
the  Ie^s-well*edited  journals,  even  today,  are 
respectable  works  of  Serious  "inquiry.  The 
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rest  have  had  their  function  as  training  exer-  . 
cl^e^  and  as  tokens  required,  for  professional 
stature>  but  they  have  degraded  the  term  'con- 
tribution to  knowledge.'    Moreover,  because  the 
profession  has  not  scrutinized  new  work  ^nd 
combined  it^  into  successively  better-informed  *" 
syntheses,  htost  of  the  publications  have  made 
no  conceptual  contribution.^"^  ^ 


Note  that^he  National  Academy's  estimate  of  the 

proportion  of  educational  research  that  could  be 

considered  "respectable"  was  1  out  of  10.  Michael 

Scriven^s  estiiaate,  for  a  large  cliunk  of  the  > 

researc^i  output,  was  1  out  of  20,    Writing  in  1960, 

he  stated  that  "•  •  •  by  minimum  acceptable  research 

standards,  95^  percent  of  the  work  (on  ^ucation)  ,  .  . 

that  is  concerned  with  causal  analysis  is,  by  either 

theoretical  or  practical  standards,  invalid  or  trivial, 

After  having  examined  an  inventory  of  70,000  titles 

produced  ov&r  the  previous  25  years Benjamin  Bloom 

concluded  that  at:  most  70  of  these  titles  —  1  out  of 

1,000  —  could  be  considered  to  have  had  significant 
49 

itif  luence  - 

The  proportions  given  favorable  ratings  in  the  various 
systematic  empirical  investigations  of  research  quality 
reported  in  the  literature  are  not  quite  as  bad  as 
these  judgments  made  by  some  of  the  outstanding  leaders 
of  the  field-    Still,  the  ratings  reported  can  provide 
little  comfort  to  the  educational  research  community, 
JPor  instance,  judges  reviewing  a  random  sample  of  ■ 
educational  research  articles  published  in  1962  would 
have  rejected  40%  of  these  articles in  a  replica- 
tion study  done  for  research  articles  published  in 
1971,  the ^judges  indicated  that  they  would  haye 
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totally  rejected  27%  of  these  articles  and  would  have 

51 

published  only  9%  "as  is."        In  a  scudy  of  res^jarch 

published  in  1967-68,  43%  of  the  articles  were  raVed 

belou  average  or  incompetent  with  respect  to  one  or 

(generally)  more  of  the  following;    use  of  proper  ^ 

research  meclSds,  contribution  to  theory,  or  con- 

52 

tribution  to  practice.       The  picture  is  even  more 
dismal  when  one  examines  ratings  of  the  unpublished 
report  literature  available  through  the  ERIC  system; 
^  in  a  study  of-  a  random  sample  of  1971  entries,  in 
Research  in  Education,  a'panel  of  research  specialists 
rated  approximately  two-thirds  as  mediocre,  poor,  or 
completely  incompetent  and  similarly  negative  assess- 
ments were  provided  for  nearly  half  the  entries  by  a 
panel  of  educational  decision  makers  who  were  not 
research  specialists. 

Clearly,  whether  one  examines  the  ::-eport  literature  or 
articles  published  in  educational  journals^,  the  over- 
all assessment  seetps  to  be  that  the  quality  of  edu" 
caclonal  research  ^is  quite  poor.     It  would  be  useful 
to  have  comparable  analyses  of  more  recent  research 
output.    Still,  there  seems  to  be  little  reason  to 
believe  that  the  general  picture  has>,changed  sub* 
stantially, 


ii.      Cx^dteria  ^or  Judging  Research  Quality  ' 


Several  indicators  have  been  used  to  measure  the  qualiC 

of  intlividual  pieces  6t  scientific  research,  Caroline 

Persell  -reviewed  a  number  of  theser    citation  rates 

(i.e.,  the  frequency  with  which  particular  articles 

54      H  ' 

are  ciced  by  others);      research  productivity;  pri^e 
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wlnriing;  peer  evaluations;  ratings^de  by  use  of 
evaluation  forms;  self-^valuatLons;'*and  characteristic's 
of  journals  publtshiag  a  given  paper. 


Persell  concluded  her  review  by  noting  that  no  natter 
what  indicator  one  tries  to  use  and  even  after  con-  , 
siderable  ef^fort  is  put  into  developing  o'bjective 
instrumen^j  research  quality  inevitably,  must  be 
defined  by  judgments  of  people  in  the  field.  There 
is  no  "intrinsic ^characteristic  of  quality  whicH  cJn 
be  recognized  by,  an  objective  instrument  like  a 
_geiger  counter  *   *   *  (and)  even  when  standards  are 


made  explicritj  their  application  requires  judgments 
by  people , 


luiras 

/ 


IL  is  indicative  of  the  .state  of  development  of  the 
field  thaC'there  seems  to  be: 


a)  general  agreement  among  researj:h  specialists 
about  the  kinds  of  criteria  to  be  used  in 
judging  research  quality  (e,g,j  ''appropriate 
research  design"); 

b)  less  agreement  about  the  application  of  a 
criterion  to  judging  a  particular  piece 
of  research  (e,g,j    Was  the  appropriate 
research  design  used  in  this  particular 
study?); 

c)  more  agreement  in  judging  a  particular  p^ece 
of  research  if  the  judges  are  specialists 

in  the  substantive  research  area  rather  than 
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I 

Specialists  in  research  mechodology) ;  and 

d)'  even  less  agreement  if  the  judges  inclnade 

both  research  specialists  and  practitioners 

%  57 
who  are  not  research  specialists* ^ 

« 

An  enormous  number  oi  instruqaents  have  been  developed 
for  evaluation  of  the  quality  of  research  outputs*  In 

1969,  one  analyst  identified  48  different  forms 

58  *  * 

available  for  this  purpose,       A  largs  literature  of 

checklists  or  guide-lines  has  been  published  for  use 

by  researchers  or  practitioners  to  help  them  sift 

through  available  research  and  separate  competent 

59 

from  incompetent  work*     ,  pther  evaluation  checklists 

have  been  developyed  by  researchers  who  have  empirically 

60 

investigated  educational  research  quality* 

Generally,  these  forms  elaborate  ^(in  more  or  less  detail) 
on  several  criteria  involving  either;     (1)  the  method- 
ology used  in  carrying  out  the  research  (and/or  the 
manner  in  which  the  research  is  reported),  or  (2)  the 
signific^ce  of  the  research*    Illustrative  of  the 
kinds-of  criteria  used  in,  these  f^rras  is  the  listing 
in  Table  8*6, 


The  greater  degree  of  detail  il^strated  here  under 
the  headings  of  Methodology/PreSentatiPn  and  Signi- 
ficance is  typical  of  the  amount  of  elaboratio[> 
provided  in  the  evaluation  forms*    In  one  case,  for 
instance,  significance  of  the  problem  area  is  1  ou^t' 

of  25  items  on  a  checklist  hestvily  weighted  toward 

,61 

research  methodology  and  style  lOf  presentation. 
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Table 

> 


'Criteria  Used  in  Judging  the  Quality 
of  EducaCiofial  ^Research 


1*      Methodology  and  Presentation 

a ,  Methodology 

-  Appropriate  research  design,  and  lack  of  specific 
weaknesses 

-  Appropriate  sampling 

-  Appropriate"  data  gathering  methods  or  procedures 

-  Validity  and  reliability  established 

-  Appropriate  data  analysis  methods  selected 

-  Data  analysis  performed  currently 
Conclusions  substantiated 

b.  Presentation 

-  Clear  statement  of  probl€:ni>  hypotheses,  assumptions,  etc* 
Good  review  of  the  relevant  literature  j  with  problem 
under  investigation' clearly  related  to  state  of  existing 
knowledge 

Research  design  fully  described 

-  Population  and  sampring  fully  described 

-  Data  gatheritig  rrrethods  destril^ed, 

-  Analysis  presented  clearly 

-  Results  presented  clearly  - 

-  Conclusions  stated  clearly 

2,  SLgnLficaiice 

a.      Significance  of  the  problem  selected  for  study 
b-      Significance  of  the  results  i 

"7-    Contribution  to  theory  ^ 

-  Contribution  to  practice 
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Even  where  "significance'*' is  given- considerable 

weight       as  in  one  seudy  wher^ '^contribution  to 

theory*'  and  "contribution  to  practice"  are  two  of 

the  three  dimensions  of  research  quality  rated 

(use  of  appropriate  research  methods  is  the  third 
6  2 

dimension)      —  "contribution"  is  not  defined. 
Clearly,  it  is  a  matter  of  pure  judgment;,  the  more  ^ 
expert  the  judge  selected*  the  more  confidence  we 
can  probably  have  in  the  assessment  made  of  the 
*  "     *  likely  contribution  made  by  a  given  piece  of  work* 

Some  evaluation  checklists  take  note  of  the  significance 

of  the  problem  selected  foiT  study,  while  others  focus 

on  the  signifi'cance  o£^ the  research  results  *    This  is 

an  important  distinction  since  in  education  it  has 

been  noted  frequently  that  researchers  often  select 

-significant  problem  areas  but  the  research  that\they 

produce  contributes  little  to  the- solution  of  those 

63  * 

problems  or  even  our  understanding  of  them+ 
i£i.  Summary 

^/  \ 

In  summary,  most  educational  research  has  b^en  described 
poor  in  quality,  as  judged  by  'eitfer  methodological 

rigojr  or  the  contribution  made  to  theory  or  practice* 

\ 

b>      Significant  Bodies  of  Research 

Up  to  this^  poknt,  we  have  'noted  how  little  of  the  prodigious 
quantity  of  edUca(:^or^r  research  |hat  has  been  produced  has 
been  judged ^to       o^^good  quality,    However,  included  in  the 
educational  R/D&t^  literature'  are  several  analyses  that  frame 
the  quality  quest^^n  somewhat  differently  and  arrive  at  a 
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ERIC 


considerably  more  favorable  asi>essment . 

The- qi/estion  addressed  by  these  analyses  generally  takes 
,the  form  of  either;    "Has  research' affected  practice?" 
or  "Has  there  been  quality  research  which  haathad  (and/tir 
potentially  could  have)  significant  impact  on  educational 
policy  or  practice  or  contributed  substantially  to  theory 
err  understanding?'*'> 


isstt^ by  d 


Getzels  approached  the  isswe  by  describing  how  educational 
practice  at  different  times  over  this  past  century  has 
largely  reflecteti  dominant  conceptions  of  the  nature  of  th^ 
learner,  and  how  these  conceptions  were  derived  In  part 
from  accumulated  educational  research.    He  traced  the 
changed  emphasis  in  educational  practice  from  teacher- 
centered  learning  to  student-centerefl  learning  to  approaches 
geared  to  social  Interaction,  and  relate^J  _  each  of  these  to 
shifts  in  the  dominant  paradigms  stimulating  psychological 
and  learning  resesrtrch. 


Griffiths^  list  of  the  most  significant  pieces  of  educational 
research  produced  in  the  previous  ten  year s^^  included 
publications  in  the  follo\)ing  research  areas; 


Studies  of  the  ^quantitative  development  of  human 
characteristics  (Bloom) 

Studies  of  the-siature  of  intelligence;  the 
structure  of  /  iprte  llect  (Guilford) 


Studies  of  individual  development  (Piaget) 

Effects  of  the  environment  on  individual  development 
(Deutsch  et  al-) 


/ 
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Application  o£  computer  technology  to  studies  in"" 
Learning  theory  (Suppes) 

s  ■ 

Biochemical  approaches  to  learning  and  memory  (Gaito) 

i  '  ■ 

Characteristics  "and  styles  o£  administrators 
(Hemphill  et  al.)  \ 

s 

t 

Talents  o£  Young  People  -  Project  Talent  - 

\ 

(Flanagan  et  a,l, )  ^  * 


^n  their  report  on  educational  Research,  lehe  National' 

Academy  of  Education  identified  four  chains  of  significant 
'  V        i,  -  ■ 

inquiry  as  illustrative  of  the  influence  of  fuftdament^L 

J  1  ;      66  ' 

research  on  educatj-onal  practice; 


The  body  oj^  work  don6  on  mental  tests  and  pupil 
classification,*  as  the  basis,  for  'the  omc^presence  * 
of  standardized  testing  to  assess  student  progress; 


-    The  philosophy  of  pragmatism  and  its  influence^ on 
curriculum  reforms  reorienting  learning  away  from 
the  goal  of  learning  for  its  own  sake  and  toward 
the  goal  of  learning  to  facilitate  pro^bl^m  solving; 


Thornd ike's  w</rk  on  reinforcement  in  le^trjilng  and 
its  impact  on  the  use  of  drill  in  the  i^Mrohing  of 


ar  ithmetic ;  and 


Views  of  the  politics  of  education  derived  from  ^ 

body  of  historical  studies  that  have  influenced  - 

educators'  thinking  about  the  forces  chat  affect 

I 

educational  chaijge.  -     ,  ^ 


6a4 


Another      example  comes  from  ^tl^  recent  report  of  the 

National  Academy  of  Sciences  Committee  dn  Fundamental 

r  .  67  " 

Research  Relevant  to  Education.       They  describe  eight 
resei^ch  topics  on  whict^  fundamental  research  has  had 
/and/or  potentially  could  have^  slgni  f  icant  influence  on 
t^e  solution  of  educa,tional.  problems:  \ 


.  -    Cognitive  development 

-  Info^ial  education  and  life-long  edacability 

-  Literacy 

"    The  brain  and  neural  processes;  increasing  learning 
capacity 

b 

*•    Change  and  innovation  in  organizations  ^ 


Higher  Education 
r 


(cult 


Cultural  Pluralism 


School  environments 


"Our  final  e^niple  should  be -noted  as  well.    In  the  1969 
atus'^eportj  Hendrik  Gideonse  and  his  staff'*at  the 
then-eKtaj^  National  Center  for  Educational  Research  and 
Development  identified  four  are^s  of  research  as  illus- 
trative of  research  that  h^d  significant  implications  for 
educational  policy  and  development  work:  *       '  • 


EMC 


"    early  learning  (research  on  cognitive  growth  and 
child  devlijpment  Showing  the  critical  importance^' 
of  the  early  years) 

Ct4 
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-    ladividuai  differences  (in  mental  abilities,>  achieve- 
ment_  aptitudes ,  cognitive  styles,  and  motivational 
factors) 


^  prof^essional  roles  of  educators  (research  on  teacher  / 
effectiveness,  teacher  role,  and  teaching  jr.ethGCs) 


< 


noni nstructional  variables  (research  on  the  powerful 
eifects  ^of  socioeconomic  variables,  peer  influence, 
political  structure,  cultural  variables,  and  the  like) 


Included  ip  the  presentation  were  specific  examples  of  ac£ual 

cfr  potential  applications  of  these  bodies  of  research  to  de- 

68 

velopment.  ac tlvities  and  to  areas  of  educational  policy. 


These  various  listings  of  areas'of  outstanding  research  are 
impressive.    However*',  at  least  two  points  must  be  underscored 

about  the  research  outputs  noted  here. 

.  i  '  ■ 

First  and  most  obvious,  almost  all  of  the  entries  are 
drawn  from  the  disciplines  (especially  psychology)  rather 
than  from  educational  research  per  se.    They  reflect  the 
contributions  made  by  fundameatal  research  relevant  to 
education  rather  than  outputs  of  the  field  of  educational 
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research*    Little  o£  it  has  been  carried  out  by  .researchers  " 
who*idenCify  themselves  as  educatipnal  researchers,  or-. 
Who  are^cf iliated  with  educational  research  a^sociatiorts, 
or         publish  in  educational  research  journals,  etc. 
These  listings  indicate- that  many  fundamental  researchers 
ojr  outstanding  ^quality  are  carryin^out  wor!^,  relevant  to 
efiucation>  ^and  at  least  some  of  these  (.e.g*,    Bloom,  ^uppes) 
have  become  active  in  leadership  roles  in  the  field  of 
educational  research*    Perhaps  this  says  something  about 
Che  supply  of  research  talent  from  other  fields  who  might 
be  attracted  to  educational  research.    But,  few  of  these  , 
listings  c^n  be  pointed  to  as  proof  of  ^e  quality  or 
vitality  of  educational  research. 

A  second'  point  suggested  by  most  of  these  items  is  made" 

parcicula*:ly  well  in  several  of  the  discussions  in  the  . 

literature  of  how  research  influences  practice  and  therefore 
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wh^t  criterion  should  be  used  in  judging  its  sigo^^cance. 
Research  of  a  fundamental  nature  generally  becomes  influential 
as  part  of  a  cumulative  body  of  knowledge         ,  ,  a  siagle  ^ 
finding  is  rarely  important  in  itself,  but  acquires  importance 
because  it  £it:s  a  system  of*  findings  .  .  ,  major  contribu- 
tions are  usually  series  of  interconnected  studies  conducted 
by^  a  number  of  investigators"^^).     Such,  research  influences 
practitioners  not  by  pointing  to  direct  applications  to 
specific  practices  but  rather  by  changing  their  ways  of 
thinking,  affecting  their  conceptions  of  schools,'  learners^ 
education,  etc^yThus  the  importance  of  the  ''contribution  to 
theory"  qriterion  of  research  quality  noted  earlier*  And, 
the  "contribution  to  practice"  criterion  must  be  understood 
in  these  terms,  an  understanding  which  seems  little  in 

^evidence  when  practitioners  are  asked  in  survey  research 

71 

to  describe  how  reisearch  has  affected  their  practice. 


Oo.e  might  argue  ^  thea^  that  there  tnay  be  sigaificant  bodies" 

^       '    of  educational  research  that  have  affected  practice  but  ' 

are  not  identified  by  the  empirical  methods  generally 

used  to  rate  the  quality  of  educational  research  outputs. 

Existing  methods  may  be  weak  in  focusing  too  heavily 

individual  research  publications^  or  in  misconstruing  how 

<  ■ 

research  contribu;;es  to  practice, 

^Stillj  the  overall  judgment  of  educational  research  as 
pooir,  to  mediocre  in  quality  s^eems  little  changed  even 
after  we  take  thefse  factors  into  account-    Clearly,  little 
of  the  research  of  significance  that  can  be  identified  has 
been  produced  By  the  .educational  research  community. 

Development  Outputs  '  ■ 


^nt 


gmetits  of  the  quality  of  educational  development  outputs  fall  , 
nto*  a  pattern  quite  simj.].ar  to  the  pattern  described  .for  researc 
quality*  *  / 

a.      Assessments  of  Generally' Medioc'ire  Quality  of  Most 
Development  OStputs 

In  general^  the  development  outputs  that  have  been  produced 
are  judged  to  be  disappointing  in  quality.       These  general 
judgments  tend  to  be  made  about  outputs  producejt^rj^ acti- 
vities and/'^project^  specifically  labelled  as  "R6tD"  (for 


instance » Itt/e  development  outpi^ts  of  the  labs  and  centers 

I  /  ^ 

or  the  wotM  of  private  sector  contractors  performed  in 


response'9(^  federally-initiated  RFPs)  *    The  materials  pro- 

:amtdevelopmant  activities  of  operating 
system  personnel  and  units  are  generally  not  conceived  of  as 
ft&D  (or  R/06<I>  or  KPU)  outputs  by  most  writers  who  make 
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these  judgments.    The  judgQients  are  ofteQjnade  in  a  context 

of  assessitig  what  return  has  been  forthcoming  on  the 

federal  investment  that  has  t>een  laade  in  educational  R&D 

(i*e.j  development)*.  The  field  has  not  as  yet  reached 

consensus  on  the  boundaries  of  educational  ''developmTEtt^n 

we  tend  to  include  "practice-based/practice-related"/ 
72 

development  work;     most  others  tend  to  restrict  their 

usage  to  only  rigorous,  systematic  development, processes 

as  they  are  found  most  often  in  specialized-'aevelopment 
73  * 

organisations*.  *     But  certainly,  if  the'rnateriaiSj  pro- 
gramSj  teaching  approaches,  etc.    developed  by ^school 
systems  (and  their  practice -related  arms  in  schools  of 
education,  state  departments  of  education,  publishing 
houses  and"  the  like)  were  generally  regarded  as  first  rate, 
v?e  would  not  find  so  much  emphasis  on  "imjfroving  educational 
practice."    Therefore,  it  seems  safe  to  conclude  that  most 
develepment  outputs  produced  by  the  educational  R/d6I 
system  —  whether  by  specialized  R6D  organizations  or  by 
practice-based  or  practice-related  operations  are 
regarded  by  and  large  as  -poor  in  quality. 

b.    Identification  of  Exemplary  Outputs 

While  most  development  outputs  are  viewed  as  poor  in  quality, 
there"  are  clearly  a  significant  number  of  programs,  products^ 
p^ckaged'practices,  e'^c.  that  have  bee_n  Judged  by  one  or  anoyie 
group  to  be  of  outstanding  quality* 

Exemplary  Outputs  o£  Systematic 

During  the  late  *50s  and  ^rly/'60s,  the  NSF  Course  Con- 
tent Improvement  Program  brought,  together  eminent 
schfrtars  to  develop  new  high  school  science  and  mathe- 
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matics  curricula  and  materials  designed  to  .bring  ,to  the 
high  school  level  student  insight  and  understanding  of 
these  subject  ^reas,  -the  structure  of  these  fields  of 
,  knowledge, /and  their  tnethods  of  inquiry.  Utilization 
data  gathered  in  the  '60s  indicated  that  the  materials 
were  used  by  hundreds  of  thousands  of  student^s^jj^^, , 
NSF  "estimated  that  50%  of  all  high  school  chemistry 
students  in  the  country  in  1968  were  using  the  CHEM 
study  program  and  materials).    The  impact  of  these  pro- 
grams was  seen  not  only  in  the  revision  of  high  school 
science  and  maLj^a[?-aric^  programs  but  also  in  introductory 
college  courses,  revised  to  take  into  account  the  know- 
ledge high  school  students  brought  with  them  as  a  result 
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of  using  these  materials.        So  much  excitement  was  gener^ 
at^  by  these  new  jfrograms  that  they  stimulated  similar 
projects  in  such  diverse  subject  yareas  as  the  social  sci- 
ences and  English  and  produced  n^W^urricula  and  materials 
for  the;^  elemenatry  as  wel-1  as  the  s*fecondary  levels.  * 

More  recentlor,  exemplary  R&D  products  have  been,  identified" 

and  described  in  reports  produced  by  the  American  Insti- 

tutes  for  Research  and  the  Far  West  Laboratory  for  Researc^ 

and  Development.        Table  8.7  reproduced  from  NIE's  1976 

Databookj  was  put  together  from  information  in  these  re- 
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ports.        Examination  of  the  entries  in  the  table  suggests 
several  observations  that  need  to  be  underscored.  First, 
the  products  cover  ^  wide  range  of  the  RdD  output  spectrum* 
rxum'^umcuium^^D^scheduling  systems  and  new  organization- 
al arrangements,  from  toy  lending  librar^s  and  preschool 
s^television  programming .  to  teacher  training  programs,  from  ' 
career  education  and  drug  abuse  to  more  traditional  subject 
areas  such  as  reading^  science*  mathematics,  and>  social 
studies*  from  preschool  through  secondary  school  and  includ- 
ing pre-service  and  in--service  teacher  training  as  well. 


TABLE  8,7 


V 

(  U*itcc  Concept  L'fo^r  (socj'.riiiji 

turn  jf  U'i^h  i:  idT(Us) 

r  .  :■:  of  *      ^  jf.TK^      racy*  ^rt  -'n;- 

I'jzz^Ip*^  Sy^H*  1,  i>r  tin.  "J  -Jkii-^  T>  p> 


i\:<du  nj*yni'::ir^ Corpus I'^m), 


LO:^,  NrfW  V^rL, 


400*000  sJuJ^^timaj)  hi^c  y^'d  i'. 
At  !t?A-:  ISO  t>pi^-ri\ rs  irc 


hjvc  alsc  *id*jp[rd  ilii  iiia^^ruJ^ 
Nfi»lL';ijli  SJJv^  up  to  1970 
^:udcnls  had  h^-zti 

mtijivcd. 
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Ov*^^  C'^i^^of  ^ 


\  ■ 

2tJ0/*  A^iT  »LV>ri.  vVl  i-     .  :[i 


h-ve  \      vyj  iIir^Lt^;ho.i[  the 


ERIC 


and  ^  . 

NMftt  '**.j'>  u>         /c  \t;iuti^^)i:,  vr>;i* 

t£)  ckm^r^*^!)  ^^Jl'vI  *cKfi^:o  ih-.**:^li  j 

T.iJ  ,  S  .  ^  ^  Tjit.'  ■  I  -  f 
pfcjt  1 1 .   !    ■  -r  '  '/  ,  ^  !^| 


University  of  C^lifvrnu, 


M**'^        l^'L^**  jltm^i>*jr> 


hb:  *fnn  in^rtu  *1>  bjvri  been  4oUt. 
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TABLE  8.7  (cont.) 

C'jrilJJutcr  {s/*t.*iii  UH  ^Llo(.L*:irisd  Cijordirjj!*;  \,  Pitlo  Alto  ^nJ 

*  These  III.  ilic  30  prc^Lic;*  ivpoilcJ  m  the  joaic^j  tcSyv/.  Drt?cr:f  iioas  arc  rneant  only  lo  fili^iiacttfriiC,  not  to 

d^^wx  (.1  <i'*tit.,;u»'fcli  tl.c  pij^Iacu  Spict  dots  not  in'tmii  monrnjnLnj  the  jrary  pubIiiiwi*4i;J  Khooi  s>  si^ruivthat 
pdriici'f^jL:(.i  in  Ltif  phi!,_j  ct  di'i*lupni;nL  Uldii.ui'^M  hi*tomi       yentrdiy  out  ot  <lale»  the  cxti.*r»i      Uic  h 

J>our(.i.\,    JJ.".  ki.'l  wlivjl  ci  jL.  Vf^Ji^ct  />  'teh;tm\'nt  Reports  fP.iIo  Alu,  CuLf..  Anccrivasi  Irni^iut^s  ft^r  Kciv^jrch. 


ERIC 


«^  6'':;:: 
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from  haifdvare  to  simulatioa  games*    Second^  the  materi-    '  ^ 
als  have  been  developed  ia  almost  *everf  typ<^  of  iasti- 
tutloa  ia  the  educational  'R/DfitI  systeitf  -  universities  > 
labs  and  cftr\ters>  other^  non-profit  organizations  >  for- 
profit  corporations,  an4  SEAs,     Finally*  the  estimated 
utilization  histories  (which  ar&-out  of  date  and  therefore 
undejrestimate  the  extent  of  use\)\''su^ges t  that  some  of  these 
oatputs  are  used  by  millions  of  students* 

li*    Exemplary  Practices  from  School  sWtems 

Iftnovative  school  districts  have  long  been  developing  their 
own  programs >  curricula,  and  learning  materials*  Federal 
funds  were  infused  into  this  process  by  the  passage* of  Title 
III  of  the  Elementary  and  Secondary  Education.  Act  in  1965* 
Title  III  was  designed  to  create  *S_uppL6mentkry  Centerg^to  ' 
deliver  innovative  services  to  school  distti'^s*    >  good 
deal  of  the  money  has  *been  us^d  to  support  trt^  development 
and  dissemination  of  '^exemplary**  "jgractlces  developed  by  and 
for  school  districts*    Various  state  mechanisms^^d  been  es- 
tablished to' identify,  validate,  and  disseminstt^  Title  HI 
projects  that  were  judged  by  state  agencies  to  be  successful 
programs  worthy  of  diss'eminafeton  for  wider  use* 

WitKiri  states  with  strong  dissemination  programs  (for  in- 
stance. New  York  State),  the  identification,  validation^ 
anS  dissemination  of  exemplary  practices  and  programs  have 

V       received  considerable  support,   *Some  states  have^  put  together 
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compendia  of  effective  programs      and  developed  various  ap- 
proaches  to  stimulate  aWareness  of  these  programs  and  inter- 
est in  their  -adoption*    In  addition,  in  1974  OE  created  the 
National  Diffusion  Network  ''to  encourage  a  free  flow  of  ^^^7 
ce§^ful  ideas  / products >  techniques^    and  practices  across 


state  lines  and  to  facilitate  the  replication  of^exem^lary 
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programs  bfy  school  discricts  who^  determine  that  ^  giveit 

78 

educational  activity  meets  their  needs". 

Table- 8*8>  reproduced  from  a  recent  evaluation  of  the  Ka- 
tional  Diffusion  Network,      lists  the  innovations  selected 
V  the  National  Diffusion  Network  for  dissemination  during 
the  19  75-76  school  year.^^  This  listing  should  suggest  some- 
thing of  Che  range  of  types  of  program  and  practices  in-, 
eluded  under  the  "exemplary  practices"  rubric  -  early  child- 
hood programs  to  promote  ^earning  "readines;?  (including  par- 
ent training  programs);,  basic  skill's  programs  in  reading, 
language,  and  mathematics;  special  programs  for'studeats 
with  learning  disabilities;  programs  in  specialized  curricu- 
lum areas  (^/|".  ,  i^us trial  arts>  physical  education*  mass 
media);"  alternative  programs  for  secondary  schools  needing 
some  alternatives  to  the  traditional  curriculum  for  stuJents 
experiencing  difficulties  in  conventional  school  environ- 
ments; programs  , to  stimulate  environmeii^tal  awareness;  and 
organizational  arrangements  and  training  programs  emphasiz- 
ing such  strategies  as  open  education,  team  teaching*  and 
use  of  the  community*    For  over  a  decade >  Title  III  publi- 
cations  have  been  describing  innovative  programs  developed 
by  local  districts*    Clearly*  the  inventory  of  such  programs 

available  for  dissemination  and  wide  scale  use  is  enormous. 

*- 

c^    Criteria  Used  'in  Judging  Quality  ^ 
< 

■s  * 

A 

Three  different  kinds  of  criteria  seem  to  be  used  in  the  judg- 
ments of  output  quality  appearing  in  tpe  literature. 

First,  we  find  judgments  made  on  the  basis  of  evaluation  research 
data  and  review  of  the  validity  and  reliability  of  the  evaluation 
findings*    The  criterion  in  these  cases  is  that  the  ptogram>  ^ 
materials,  or  whatever  is  being  evaluated  does  in  fact  produce 
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TABLE  8.8 

VKOM'.c'c:^  bv:.\}Ei)  ks  n'dm  D:^V£:LOP:;.vj)EMo>f.si":-i.ViORj  (1975-76} 


Al tcrnative/ Second  aiy 

Project  Adv^MitULX*  , 

Currlculi'.nt  for  Meetutt;  Ilo'.iern  Probl3[ns  X^cw  Mod^I  Mo)] 
Higa  School  in  the  Co:::ni(iaJ.t>;  /  ^ 

In5;titute  for  Pollticr.l  anJ  Legal  Mucation  (tPLE)  / 

Atitl.M]  DiMonsLon'i  to  Pnri^nt  am*  Prcsschool  Kducatio:i 
Coj'^nltlvely  Oric^nied  PrcKinuergartea  E;<p&rLOnf:e  (COPE) 
Dcjje  Avenue  Prt;j*ict 

)i^.r}y  Chiid-iooJ  Preventive  Curriculun  (iXPC) 

Early  Preveatioa  of  School  Failure 

Fa;nily  Oriented  ^j'tmctarcti  Preschool  Activity 

Parsonali        (Seton  Hall  Freschoo].) 
Project  Hoini  Bnso 
Horie  Start 

Parc'nt  kctidineis  Ec^acriLlon  Project  (T^lEP) 
Saturday  School:    Parent-Child  Early  Education 
Project  SEE  (Specific  Educ^tioA  of  the  Eye) 
StraLefiios  in  Early  C^jJ.i'tfT^ood"  Education 

i 

Environmental   '  ^ 

ECOS  Trauiiriy  Institute  . 

Project  ICE  (Inst" "uc tion-Ciirr iculum-fEnvironnent) 

Project  IC^VIIE  (Knowledge  Action  to  Restore  our  RnvironTP,ent) 

Pollution  Control  Education  Centcj/ 

Reading/Languaf^e/tlath 
Project  Aloha 

Alphaphonics  Reading  Readiness  Training  Progran 
Project  'Cnl^;h-uo 

foiicepLually  Ori'mLod  .^^ithe:?,atlcy  Program 

Diaj^i^or.:  ic/Prcv-,.  il-tjva  Arit^iVLlc  (I^r'A) 

Hel.p  One  S"-ii-:e[:f.  to  Succeed  (HOSTS) 

Project  K'TSTHUCT  (Instruct  i on?il  Systc-ni  for  Teaching 

head  ti^^^  uijing  CO'itlnuoti.i-i*rccfif;.T  Tc^chnoiogy) 
Li^nrning  Lo  }Xzp-<\  by  R^iidiij;:  *  + 

New' Advent Mrc:;  in  Learning  (fJATL) 

Projf^ct  PKGASt?f^-PAC:K ;     C^ni  i i^.uou'^  Vro»re,t>s  Rt;jding  Progran 
Pu^i  i  I:;  A'N.i^^c  i.>\%  U\  i/j-trn  i  w;^  (i*Aw) 
Right  ;  Q  K^.Kl 

Pr')']*,s'^t  y  -  2:     Rt:^dinf\^y  J  Jlc I '^vanc.*,  aiK^  He lufforcf^^r^nL 
SDK:     Sy:.ve"fis  j)irc<tf^f!  i:*7'->d  tuf* 
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TABLE  8.8' 
(cont . ) 


ludiv Ltlua J  j Hticl  T*anguage  Arts 
K-3  Steading;    Prograin  3?oveJ opi-ioric  Thix-ugh  Vrocc^^s 

Con:»njnlty  Plaanin^,  Council  on  Kduc^ciL ional 
AUGrnatlvei*  (Cl^C::;A) 

HnalCh  and  Optiiriuin  Physical  Kducation 

^Occupational  Verf^atilLty 
Talents  Unliniit<adr 
Urban  Arts  Profiraia 


ERLC 


special  EducAtion/Leacning  Disabilities 

AU  Children  ToEiaily  Involved  K:j^orcising  (ACTIVE) 
Contract  Learning  for  Kducable  i-lentally  Retarded 
Students 

Ln^lineercd  Ciassroon  for  Sti;dciits  ^;ho  are  both 
Educ^ibiy,  i'^entally  H^inciicapped  and  Behavloraily 
Maladjusted 

Project  FAST  (Functional  Analysis  Sytftems  Training) 
Project  FOC^S 
Project  IDEA 

Pro^ct  Ltriarning  Disabilities;    Early  Identification" 

a^  Intervention 
Northwest  Special  Education 

Pilot  Project  [Jt'Jlizing  Supportive  Personnal  uJiing 
Behavior  Modification  Technique^  v;ith  Articulatory 
Disordocfid  Children 

Pre-K  prescriptive  Teactung  Project  fdr  Disadvant/iged 
Children  with  Learning  Disabilities 

pc-Kd  Schooi 

Ktnv,»(j LQt^on  for  Ciiildren  uith  Learning  Deficits  through 
Pr^xi*^LOii  Tcacliing;    The  Sa^caja'^c^a  Plan 

Project  SHAi^.K:    Sharing  High  Yield  Accountability  with 
Rei;ouriX  Kducators 

Projoct  Jiuccoss  for  the  SI.D  Child 

Train  lng/Orj;jnization^il  Arrangeniontri 
Demons tra Lion  J^/aJ yaCion  Center 

DLSCeminat        Coi%puLcr*-JJ:jst*d  Plannirifr  RcsourctiE;  through 

Project  Snmi-J^;chool:    Thf*  Dallas  Ccriponent 
Project  L'^arni;>^>  K;'.ptiripncc  not!?ilo 
PATL;     Po5iMvt>  ALtituc>o.s  Toward  Loarniug 

Paul  Op'^n  School 
Project  fjjccjos.s  iinvf  conment 


\ 
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the  ki^ids  of  desirable  results  claimed  by  its  developers* 
An  example  of  use  of  this  criterion  would  be  the  products  cer-^ 
tified  by  the  Joint  (OE/>]'lE)  Dissemination  Review  Panel  (JDRP)  * 
This  panel  was  establShed  to  examine  products  developed  with 
OE  (and  later,  pE  or  NIE)  funding  and  relevant  data  on  effective- 
ness submitted  by  product  developers-    After  scrutiny^  of  the 
evaluation  procedures,  data,  etc-,' this  panel. makes  judgments  on  ' 
product  effectiveness  and  certifies  that  those  products  which 
pass  their  review  warrant  dissemination,     (All  programs  or  prac- 
tices' disseniinated  by  the  National  diffusion  Network,  for  instance, 
r^st  first  be  validated  by  the  JORP-)    According  to  KIE's  1976  ^ 

Databook>  75  of  the  100  products  submitted  to  the  JDR?  as  of  the 

80 

end  of  1975  had,  fceen  certified  as  effective. 

Secondhand  most  couunon,  we  find  judgments  of  quality  with  large- 
ly unspecified  bases',  compaj^lile  to  the  "expert  opinion"  we  noted 
earlier  in  our  disciission  of  judgments  of  research  quality*  In 
one  study,  for  instance,  a  panel  of  experts  were  asked 'to  examine 
a  set  (3f  innovations  and  respond  to  the  following  rather  general 
question  of  quality;    "Indicate  what  you  believe  to  be  the  educa-. 

tional  worth  of  each  innovation  when  properly  installed  from  (l) 

81    ^  f  ' 

low  to  (5)  high/'      Interestingly  enough,  in  the  one  study  in 

which  this  amorphous  criterion  was  use^,  thei;e  was-  a  reasonably 

high  degree  of  consensus  among  the  judges  on  the  ratings  of  in- 

,  .  82 
novation  quality- 

Generally  what  seems  to  be  operative  in  these  cases  Is  expert 
or  user  judgment  of  "comparative  advantage,"  i.^t^that  some  T^eQ' 
product  or  program  is  clearly  superior  in  content,  presentation, 
etc-  to  existing  outputs  that  would  be  used  to  meet  the  same  need* 
Both  th^NSF  Course  Content  Improvement  Program  outputs  (PSSC 
Physics,  BSCS  biology,  CflEM  chemistry,  etc-)  and  Sesame  Street 
were  widely  acclaimed  (a(si^^ast  $arly  in*their  histories)  based 
largely  on  this  somewhat  atnorphous  kind  of  qriterion-     In  both 

r 
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casesj  chese  outputs  were  judg^cTbyfrvarioas  experts  (and  others) 
to  be  superior  in  content>  presentation >  etp*    ^he  judgments 
were  made  even  Ix^foire  evaluation  data  on  effectiveness  were 
available.    And  thes^jud'ggients  Have  continued  to  hold'^^and 
^ajge  ev^n -a£ter.  evaluation  data  suggested  that?  they  might  not 
e  been. as  eff^ective  as  some  of  the  initial  claims  >  or  they 
may  have  been  effective  with  only  certain  segments  of  the  popu- 
lation and  not  wijth  .others  for  whom  they  were  intended.  Given- 
.the  state  of  evaluation  research  methodology  >  such  expert  ^udg-  ■ 
ments  may  in  fact  have  more  validity  to  them  than  all  the  evalua- 
tioa  data  that  have^a^  yet  -been  assembled,  ^ 

^  Although  product  quality  and  extent  of  Otilization  are  two  vari- 

*  ^83 
ables  that  are  not  necessarily  highly  correlated  >      one  indirect 

/  '  ■ 

criterion  that  is  often  used  is  extent  of  utilization.    No  doubts 

the  wide  usage  of  this  criteriorfcis  attributable  in  part  to  the 
ease  of  collecting  and  reporting  utilization  data.    But  ^so>  , 
perhaps>  the  us^of  these  data  may  reflect  an  ^assumption  that 
market  forces  are  valid  as  measures  of  what  schools  want>  and 
that  (at  least  in  some  rough  way)  what  schools  want  is  programs 
^'that  provide  a  degree  of  quality  without  at  the  same  time  being 
incongruent  with  the  school's  organizational  and  environmental 
consti;aints*    It  should  be  notedc^  though>  that  the  one  study 
that  gathered^ata  on  both  intVovation  quality  and  frequency  of 
use  concluded  that  there  are  four  types  of  schools;     (a)  pace- 
setter schools >  which  adapt  large  numbers  of  ^innovations^  includ- 
ing mQst  high  quality  ones;  (b)  faddi'lt  schools  >  which  aSopt  large 
i^umbers  of  innovations  >  but  few  of  these  are  high  quality  one^ ; 
Cc)  selective  schools  >  which  adopt  fewer  innovations  >  but  ^those 
^hey  adopt  include  most  of  the  h^^ph  quality  ones;  and  (d)  bacl:- 
ward  schoofe>  which  adopt  few  innovations>  and,fqw  of  those  are 
among^  the  high  quality  ones,  ^  As  shown  in  Table  8.9  reproduced 
.from"th*is  study-^-- .   22%  of  schools  are  categorized  ,as  pacesetters> 
24%       faddist-^  24%  as  selective>  and  40%  as  backward,  Clearly> 
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*  , then  J  Che  correlacioa  between  quality  and  frequency  of  use  is 
high  only  in  certain  schools  and  is  particularly  low  in  the 
;:!>/    "^y^.     24%''of  schools  labelled  as  "faddist". 


d.  Summary 


Cl'early;  then,  although  "the  prevailing  view  seems  to  be  that  ^ 
most  of  Che  outputs  of  educational  R^D  to  date  have  been  poor^^ 
in  qua^cy ,  "^thei^e,  are 'also  a  good  number  of  exemplary  products 
chat  are  .widely  use^  \flien  Che  outpucs'  of  practice-based  de- 
velopment are  also  cmsidered,  it  appears  that  large  numbers  of 
exemplaty  programs  and  praccices^ have  been  idencified  various 
age^ciea^',  and  many  of  these  have  been  validated  ^  and  certified  by 
reviewing  bodies.    The  ke>t  problem  in  the  c4se  of  practitioner- 
developed  outpucs  may  be  in'^adequate  visibility  and  dissemina** 
*    tiQn,    In  t^e  remainder  of  thi^  chapter,  we*f5rn  .t<)  sora*  of  the 
implications  of  this  state  of  affairs.         \  ^ 


ERIC 


 1 


IV.     POLICY  IMPLICATIONS 


Based  on  our  analy^SjSj  WRre  would  seem-to  be  a  need  for  policy  inltta- 


tives  toward  at  lease  three  objecti-ves;.    (1)  capturing  in  usable  form 
much  of  the  **lnvlsible"  knowledge  accumulation  and  innovation  to  be 
found  In  the  educational  R/D&I  and  operating  sy^ems;  (2)  establishing 
more  effective  quality  control  mechanisms  to— distinguish  between  high  and 
".low  quality  outputs  and  increase  the  likel^ood  that  only  the  high  quality 
outputs^  get  disseminated  for  wide  scale  use;  and  (3)  raising  ohe  quality 
of  the  research  and  R^D  outputs  produced  b^  the  educational  R/D&I  system* 

1,    IncrsasxnR  the /^Visibility^'  and  Usability  of  "Invisible*^  Outputs 


"^Ssjf  Strong  programs  and  practices  de^loped  In  schools  are  to  be  used  effec- 
tlvely  In  other  schools,  and  if  new  techniques  and  understandings  of  R/D^I 
processes  carried  around  in  the  heads  of  first-rate  r/D6I  personnel  are  to 
be  available  for  use  by  others  >  attention  will  have  to  be  focused  Increas- 
ing the  concreteness  of  many  more  amorphous  outputs, of  R/D6I  functioning. 

At  the  very  least,  what  we  have  in  mind  Is  the  packaging  of  exemplary  prac* 
tlces  and  programs,  to  a  point  that  will  permit  their  effective  use  by 
others  without  driving  the  costs  too  high  or  producing  overly  complex  out- 
puts  that  discourage  adoption  or  Implementation*    If  we  are  to  be  in  a  posi- 
tion tc  further  this  'mixed  mode"  of  development  Cl*e,,  development  activity 
in* the  practice  setting  but-external  validation,  packaging,  etc,)>  we  will 
need  to, develop  considerably  more  understanding  than  we  have  now  about  what 
kinds  of  process  Information  practitioners  need  to  effectively  Implement 
varlo^is  kinds  of  programs  or  make  effective  use  of  various  kinds  of  products, 
^We  also  need  to  learn  more  about  the  output  fornts  that  are  most  cost-effec- 
tive f(^r^  providing  this  Information,  and  the  degrees  of  concreteness,  com- 
plexity>  etc*  most  preferred  by  practitioners.    To  produce  this  kind  of. 
Information,  what  would  saem  to  be  needed  is  the  development  of  an  Imple- 
mentation research  specialty  and  a  personnel  base  of  researchers  who  focus 
their  attention  oa  the  practice  setting.  Its  needs>  requirements >  constralnts> 
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and  preferences  and  are  gifted  observer^  and  analyses  of  clasSropm 
behavior  and  school  scruccures  and  processes.    Hie  collaboration  of.. 
Such    researchers  wich  ceams  of  instructional  packaging  specialists 
might  produce  the  kinds  of  cost-effective  output  forms  that  would  pto- 
vide  evidence  over  time  of  both  high  quality  and  wide  use* 


For  r/D£(I  system  personnel /  other  kinds 'of  amorphous,  invisible  out-  • 
puts  need  to  be  captured  in  more  concrete,  usable  forms*  Relatively 
little  exists  In  the  literature  about  r/D£(I  processes  -  the  "how  to" 
inf ortiiation  carried  around  in  the  heads  of  first-rate  developers,  dis- 
semination specialists,  change  agents,  imple^Pentation/utilization 
support  personnel,  etc,    Tnei^e  is  considerably  more  of  that  kind  of 
information  available  for  various  research  specialties  and  evaluation, 
but  even  here  we  sense  considerably  more"  process  information  and  "ways 
'of  tHinking"  could  be  captured  and  made  accessible  for  use  by  the  field* 

Some  talented  R^Dfid  specialists  could  probably  put  some  of  this  down  in 
sprint  or  show^some  of  it  through  use  of  videotape  or  other  media*  Others, 
howler,  probably  could  not  explain  what  they  do,  but  still  are  models 
^  from  whom  the  fLeld  could  learn.    To  capture  what  it  is  these  people  do 
that  accounts  for  the  quality  of  their  efforts,, we  probably  need  to  de-  / 
velop  a  "process  analysis"  research  specialty  and  build  into  the  awarding 
of  various  kinds  of  grants  $nd  contracts  a  provision  for  these  process 
researchers  to  study  how  the  work  is  carried  out,  to  explore  and  elaborate 
on  the  processes  and  patterns  of  thinking  used, ^ and  to  produce  outputs 
which  make  what  they  learned  accessible  to  the  re^t  of  the  field.    We  are 
already  beginning  to  see  some  developments  of  this  kind,  for  instance 
awards  to  "third  party  researchers"*    We  would  call  for  considerably  more 
of  this,  along  with  concerted  attention  to  developing  the  social  and  cor^- 
munication  mechanisms  an3  information  flov  structures^pf  the  various  spec- 
ialties and  making .use  of  these  mechanist*  and  structures  through  commis- 
sioning state  of  the  art  papers,  publishing  annual  state  of  the  art  re- 
views and  handb^oVs,  etc.     Such  policies  would*seem  to  be  essential  if 
we  are,  to  speed  the  maturation  of  the  educational  R/D£(I  system  and  thereby 
raise  the  quality  of  R/D&I  outputs «  ^ 
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2.    Establishing  More  Effective  Quality  Control  Hechanisros.  -  ^ 

Given  the  enormous  quanti,ty  of  rearearch  and  R^^D  outputs  and  the  medi-- 
ocre  quality  of  most  of.  these,  there  is  a  serious  need  for  more\effec- 
tive  quality  control  mechanisms,      When^potential  users  are  overwhelmed 
by  the  quantity  of  what  is  available,  and  find  much  of  what  they  try  to 
use  poor  in  quality,  they  tend  to  stop  using  the  available ^search  mecha- 
nistas  as^'w^teful  of  their  time,    Thus>  the  high  quality  outputs  get 
buried  in  the  voluminous  quantities  of  poor  qualit)^  outputs,  and  are  no 
better  disseminated  and  perhaps  no  more  widely  used*     (ERIC  would  seem 
CO  be  a  good  illustracion  of  this*)  • 


early,  tsore  effictii 


Clearly,  tsore  effective  quality  control  mechanisms  will  need  ta  be  de- 
veloped*   They  will  have  to  be  used  more  aggressively  to  separate  out  the 
high  quality^utputs,  and  the  message  will  have  to  get  out  J^oud  and  clear 
that  this  has  been  done  and  that  the  outputs,' thac  successfully  pass  through 
the  screening  process  are  worthy  of  consideration  and  use* 

This  willj  however,  be  an  enormously  complex  process  given  the  diversity 
of  output  forms,  the  broader  range  of  substantive  foci,  and  the  fact  that 
different  criteria  will  have'  to  be  developed  for  each  output  form  and  dif- 
ferent substantive  specialists  will  have  to  be  involved  in  making  these 
judgments  for  the  outputs  in  each  substantive  area.    Also,  it  would  seem 
essential  to  develop  criteria  of  quality  that  take  into  account  who  the 
usjer  of  each  set  of  outputs  is  likely  to  be  and  wbat  that  kind  of  user's 
rei^uirements  are  liK^ly  to  be,        .  *  - 

To  accomplish  this,  'it  would  seem  necessary  to  develop  a  much  better  data 
base  than  we  jiow  have  available  to  us  about  the  practice  setting  and  the 
requirements  kor  effective  implementation  and  use  of  various  kinds  of  pro- 
grams and  products,  by  various  k^nds  of  users,  in  schools  with  varying 
implementation-relevant  characteristics*    We  wilL^j^^refore,  need  more 
practice-ba^ed  research,  and  we  will  need  to  include  practitioners  in  any 
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efforts  to. develop  or  apply  criteria  of  output  quality. 

Quality  control  m^chaftisms  are  already  operative  in  the  research  con- 
munity  -  in  flie  form  o£  journal  revieners ,^  syntheses  an^  critiques  in 
review  articles,  etc*    Still,  considerably  more  o£  this  would  seem  to'^be 
needed,  especially  to  insure  the  cumulative  development  of  a  quality 
knowledge  base  for  each  research  area-    Also,  we  need  to  establish  these 
^mechanisms  for  other  K/D&l  areas  -  development,  dissemination,  implementa- 
tion/utilisation support,  etc,  and  make  certain  that  the  process  analyses 
and  other  outputs  produced  to  develop  the  state  o£  the  art  in  these  speci- 
alties; are  subjected  to  the  sa&e'  kind  of  careful  quality  control  screening 
as  the  development  outputs  produced  for  practitioners, 

3.    Raising  the  Quality  of  Outputs 

While  the  measures  we  have  suggested  above  should  indirectly  raise  the 
overall  level  o£  quality  of  the  outputs  the  system  produces,  some  other 
more  direct  steps  would  also  seem  to  be  necessary  i£  significant  improve- 
ment  Is  to  be  seen  in  the  quality  of  these  outputs. 

First,  it  seems  essential  to  make  program  and  project  s.elections  on  the 
basis  jjf  criteria  ^at  include  an  assessment  of  the  state  of  development 
^f  the  underlying  knowledge  and  technology  base  to  support  a  given  type 
Si£_  projected  output.     Is  existing  knowledge  and  technology  adequate?  Or, 
must  development  work  in  a  given  area  be  viewed  as  premature  given  the 
remaining  unknowns  at  the  current  time?    In  the  case  of  fundamental  in- 
qulry.  Is  a  proposed  research  question  the  right  question  to  further  the 
state  of  knowledge  in  a  given  area?    Doss  It  adequately  take  into  account 
what  Is  already  known?    In  the  case  o£  a  proposed  evaluation,  is  existing 
evaluation  methodology  and  Instrumentation  adequate  to  satisfactorily 
answer  the  questions  posed?  And  so  on. 

/r 

If  these  kind  of  criteria  are  to  be  developed  and  used,  we  will  need  to 
develop  ^  much  better  Information  base  than  we  have^vai*lable  to  us  now 
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about  the  state  of  development  of  each  segment  of  the  field's  know--  , 
ledge  and^  technology  base.     It  would  seem  advisable,  too,  to  have  avail-- 
able  for  policymakers  an  assessment  of:     (a)  which  knowl^dge/techncjlogy 
bases  are  best  developed  'at  this  point  in  time,  to  support  what  kinds  o£ 
needed  development  work  or  applied  research;     (b)  which  evaluation  tech- 
nologies are  developed  to  a  high  enough  level  to  provide  strong  results 
CO  inform  policymaking;  (c)  which  areas  of  fundamental  inquiry  merit 
priority  attention  -  whether  because  of  their  potential  for  shedding 
light  on  issues  of  fundamental  signlTicance,  or  because  of  the  signifi- 
cant  kinds  &f  applied  work  that  cannof  be  undertaken  until  further  prog- 
ress  is  Titade  in  answering  fundamental  quest  Ions,  in  these  area&,  etc.'  - 

Other  direct  steps  to  raise  quality  would  seem  to  be  needed  as  well  -  for 
Instance,  making  ^pertain  that  government-funded  work  Is  auaf"<Jed  only  to 
quality  Institution^  and    first-rate  personnel  (possibly  through  increas- 
ing use  ol  s61e  source  procurements  and  "special  relationships**,  matters 
we  consider  more  fjAly  in  our  chapter  on  funding);  or  increasing  the  man- 
9  datory  us^/Lf  advisory  panels  throughout  the  life  of  funded  projects  to 

insure  ongoing"  review  by  those  with  strong  expertise,  in  a  given  ar^ 
(researchers,  practitioners,  R&D  specialists) ,  considerable  feedback  on 
^         needed  improvements,  ongoing  modifications,  etc* 

Clearly,  more  direct  attention  needs  to  be  focused  on"  the  quality  issue. 
Indirect,  after-the-fact  quality  control  and  screening  mechanisms  are  a 
wasteful,  inefficient  approach  to  upgrading  overall  output  quality.  Ifliat 
would  seem  to  be  called  for  are  more  iisjaginative  and  more  forceful  poli- 
cies to  insure  that  funds  are  awarded  to  only  those  proposals,  institu- 
tions >  and  personnfel  that  seem  to  offer  from  the  Very  outset  a  strong 
likelihood  of  producing  quality  work.f 
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DATA  BASE  AND  MONITORING  SYSTEM  REQUIREMENTS 

Ideally*  we  would  like  to  see  the  development  of  a  data  base  and  moni- 
toeing  system  t^at  would  allow  us  to  accomplish  s^eral  purposes:  to 
Inventory  outE^uts;  relate  quantities  of  ^utputs  to  areas  of  need;  ref- 
late outputs  to  quality  criteria;  relate '^utput^  to  inputs  (funds,  per- 
sonnel,  time' in  terms  of  both  elapsed  time  and  man-hours,  state  of  de- 
velopment of  relevant  knowledge/tecliinology  bases,  etc.);  relate  quality 
of  outputs  to  information  about  management  strategies  used;  relate  out^ 
put  information  to  utilization  data;  assess  the  extent  of  change  over 
tine  in  quality  of  outputs,  lobslances  in  meeting  diff^reat  needs,  ^tc. 

To  achieve  at  least  some  of  these  objectives,  it  would  seem  necessary  to 
gather  on  a  periodic  basis  data  on  all  the  outputs  produced  hy  the  various 
R/D6fl  performer  organizations  and  perhaps,  too,  all  the  various -kinds  of 
outputs  used  by  school  systems  throughout  the  country.    We  would  want  to 
be  able  to  determine  who  is  producing  what,  and  who  is  using  what ,  how 
much" of  what 'is  being  produced  is  being  used,  who  is  producing  most  of 
what  is  being  used  the  nibst,  and  what  kinds  of  outputs  are  getting  the 
greatest  amount  of  use,  by  whom. 

We  have  already  noted  in  an  earlier  section  how  the  large  numbers  of  out- 
put  types  and  substantive  foci  of  outputs  are  likely, to  complicate  any 
afttempts  to  develop  a  useful  data  base  and  a  monitoring  system  for  output 
production  and  use.     Still,  if  some  ideal  system  were  to  be  developed,  it 
would  seem  to  require  the  development  of  quality  criteria  for  each  output 
category,  and  the  development  of  a  system  to  apply  these  criteria  to  exist 
ing  outputs  in  each  category  and  to  new  outputs  being  developed.  Estab- 
llshing  the  criteria,  setting  up  the  review  mechanisms,  and  applying  them 
.for  the  first  time  to  the  existing  body  of  outputs  are  likely  to  be  e- 
noriaously  complex,  difficult  and  tiae-consuming  tasks.    But  after  this 
'is  done,  the  system  is  likely  to  operate  with  far  less  difficulty.  Uhat 
^would  seem  to  be  called  for  would  be^eriodtc  assessments  of  the  quality 
of  all  outputs  in  each  category  produce^  since  the  last  assessment  cycle. 
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Periodically^  too>'  these  quality  criteria  would  probably  need  to'be're- 
viewedj  perhaps  along  with  soiae  of  the  earlier  assessments  of  the  exist- 
ing outputs . " 

Having  chis  quality  informacion  'in  che  data, base  and  monito ring  system 
would  enable  us.  to  examine  such  quesclons  as:     Is  quality  increasing? 
How  much  of  whac  is  being    used  is  qualicy  taaterial?    Is  chis  showing  any 
improvemenc  over  cime:    l^ho  is  producing  che  quality  oucput^?  \Is'this 
changing  over  cime?    WhQ  is  using  the  quality  oucputs?    Who  is  using  ouc- 
puts  of  lessee  quality  (and>  perhaps  in  a  subsequent  sfudy>  why)? 

A  data  base  and  monitoring  system  of  this  kind  could  ^abj-e  us  to  assess 
the  effectiveness  "of  various  policjc  initiatives  that  might  be  pursued  in 
an  effort  to  raise  output  quality.    Tor  instance>  if^the  infonaation  on 
who  is  producing  most  of  che  quality  outputs  of  a  given  type  was  then  used 
to  shift  from  open  competition  to  sole  source  procurement  for  contracts  ^ 
to  produce'  such  outputs>  the  monitoring  data  over  time  could  ^e  analysed 
to  cjetermine  whether  or  not  the  effect  was  to  raise  the  overall  quality 
of  outputs  of  that  type>  whether  or  not  this  meant  increased  use  of  R£(D 
outputs  in  school  'districts>  and  perhaps  too  even  whether  or  not  this  pro- 
duced  any  measurable  increase  in  cost-effectiveness  or  any  measurable  form 
or  degree  of  school  improvement.     (This  latter  is ,  no  doubt>  somewhat  far- 
fetchedj  but  it  should  be  taken  as  at  least  suggestive  of  what  becomes 

possible  when  a  good  data  bas?e  and  monitoring  system  are  developed.) 

*- 

\ 

Another  possible  use  for  a  data  baSe  of  -this  kind  would  be  for  the  develop-* 
ment  of  sampling  frames  for  in-depth  studies  on  particular  policy  questions 
'For  instance>  if  we  wanted  to  assess'what  it  takes  to  produce  quality  out- 
puts of  a  given  type>,we  miglit  use  this  data  base  to  identify  the  quality 
producers  of  these  outputs  and  then-  study  these  organizations  in  depth  to 
learn  more  about  requircmerits  for  quality  work  of  a  given  typ*^^  what  level 
of  fundingj  tcr  what  specific  task9>  carried  out  by  what  kinds  of  personnel> 

using"  what  standards  of  quality,  over  how  long  a  time  period>  working  - 
■ 

through  what  standards  of  quality>  over  how  long  a  time  period>  working 
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through  what  kind^  of  collaborative  relationships  wi^th  what  other  kinds 
of  institutions  or  personnel,  using  what  kinds  of  strategies  to  manage 
the  enterprise  and  to  insure  quality. 

t 

We  have  been  brief  in  sketching  some  of  our  thoughts  about  the  type  of 
data  bastt  and  monitoring  system  we  think  is  called  for  to  ultimately 
improve  system'^quality.    In  the  next  section  of  this  chapter,  we  I'ocus 
in  some  detail  on  one  small  piece  of  this  larger  data  base  -  i*^*,  in- 
formation  about  output  attributes  and  the  nDnner  in  which  theytnay  affect 
KPU  processes  and  require  different  kinds  of  manageaent  strategies  if  the 
outcoiue  is  to  be  a  first-rate,  widely  used  program  or  product.  con- 
sider this  small  segment  of  the  broad  data  base  in  considerable  detail  be- 
cause developing  effective  R/D6[I  management  strategies  is  a  matter  of  keen 
interest  to  us,  and  also  because  we  think  this  discussion  should  illustrat 
'the  kind  of  thinking  that  may^  be  needed  as  a  basis  for  determining  what 
categories  of  data  need  to  be  gathered  and  what  sorts  of  analyses  nay  be 
needed  to  make  the  iofofmation  useful  for  improving  the  quality  of  system 
outputs. 


r 
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VI.       IMPROVING  OUTPUT  QUALITY;    AN  OUTPUT  TYPOLOGY  EOR  THINKING 
ABOUT  NSEDED  M^?;aG£M£NT  STRATEGISS 

Throughout  this  volume,  we  tend  to  direct  our  attention  toward  macro  ' 
(system)  level  policy  and  manageoient  initiatives  our  analysi-s  suggests 
are  needed,    We  give  less  attention  to  management  strategies  on  the 
micro  level  of  individual  institutions,  projects  or  programs,  did 
not  see  micro-level  analysis  as  feasible  within^ the  scope  of  this 
particular  analysis,  fc^  it  opens  up  a  whole  vast  new  and  undeveloped 
area  in  need  of  exploration,'   Howevei:,  since  we*are  aoncerned  in  this 
chapter  with  output  quality  and  its  Iraprovenient,  and  since  the  improve- 
ment of  management  strategies  on  the  institutional  Ipvel  would*  seem  to 
be  of  considerable  importance  here,  we  have  given  some  consideration  here 
to  the  Qatter  of  micro-level  management  strategies  needed  to  improve  out- 
p^ut  quality  and  haw  we  might  usefully  think  about  the  body  of  management 
I  know-how  that  needs  to  be  developed. 

In  some  never-to-be-realized,  idealized  f uture'^Jfetate  of  development 
of  the  now  virtually  non-existent  specialty  of  educational  R/D&I 
managesient,  there  might  exist  a  body  of  knowledge  that  would  suggest 
"management  strategies  applicable  to  each  set       R/D6eI  functions  and 
processes,  carried  out  in  order  to  bring  about  the  dev^opment  and 
utilization  of  each  type  of  R/D6tl  outputs  unde^various  conceivable 
contextual,  en^?ironmental,  or  organizational  constraints.  Other 
chapters  in  this  volume  consider^  the  various  R/D&I  functions  and 
processes  as  well  as  various  kinds  of  constraints  to  be  taken  into  ac-^ 
count.    In  this  section,  we  focus  dhly  on  R/D£(I  outputs  and  consider  the 
kind  of  output  ^ypology  that  might  be  usefu;^  for  inventorying  outl>>H: 
management  strategies. 

Since  this  is  intended  to  be  only  illustrative,  we  restrict  our 
attention  here  to  development  outputs.    Clearly,  other  dimensions 
would  be  relevant  to  a  typology  of  research  outputs  and  other^kinds 
of  considerations  would  enter^into  strategies  for  research  management- 
We  shall  also  restrict  our  attention  to  externally  developed  R/D&I 
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outputs.  We  recognize  that  products  or  practices  deve loped  within 
the  operating  system  and  then  selected  for  wider  dissemination  are 
likely  to  entail  somewhat  different  management  requirements, 

1,  Assumptions 

Different  kinds  of  development  outputs  have  significantly  different 
R/D$tl  requirements^--  different  resources  to  be  assembled^  different 
otganizational  arrangements  to  permit  the  most  effective  and  efficient 
use  of  these  resources,  different  R/D6(I  activities  to  be  carried  o\it, 
different  standards  to  be  applied  ia  evaluating  product  effectiveness, 
different  production  processes^  etc.    On  the  utilization  end  of  the 
KIE/u  spectrum^  different  k>nds  of'externally  developed  r/D6(1  products 
are  likely  to  require  different  sorts  oi  dissemination  and  marketing 
strategies  and  pose  different  sorts  of  problems  for  operating  systems 
confronting  decisions  about  adoption,  implementation,  and  utilization* 

Several  analysts  have  distinguished  among  types  or  attributes  of 

innovations  or  R/D6(I  prod\icts>or  outputs*    Some  of  these  distinctions 

are  applicable  to  innovations  in  general;  others  are  specific  to 
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educational  products  and  innovations.       Most  of  the  literature  that 
considers  the  attributes  o£  innovations  falls  within  the  diffusion 
research  tradition*    The  properties  of  primary  concern  to  these 
analysts  are  those  that  facilitate  or  hinder  the  adoption  and  spread 
of  the  innovation. 

Our  concerns  are  w^th  the  entire  creation-to-utilization  life^  cycle 
of  an  output^  beginning  with  need  identification,  continuing  orT'tKrough 
the  KP  functions  of  research  (or  idea  generation),  development  >  and^\^ 
evaluation,  then  on  to  production^  disseraination/Enarketing,  and  distr'i- 
bution^  and  finally  through  the  knowledge  utilization  end  of  the  KPU 
spectrum,  including  not  only  the  adoption/acquisition  process  but  also 
impltinenLation  and  utilization  as  well.    One  of  the  themes  that  appears 
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throughout  this  volume  is  the  need  to  Increase' the  degree  of  Inte- 
gration that  exists  between  the  1CP  and  KU  ends  of  a  product's  history. 
Therefore^  in  tjeveloping  our  typology  we  ^ave focused  put  attention 
on  both  the  KP  and  KU  requirements  of  educational  R/D&I  outputs • 


For  simplicity  of  usage,  we  shall  refer  to  all  outputs  as  "products/* 
though  clearly  the  term  is  not  appropriate  to  all  outputs  wejuight 
consider.    We  shall  also  often  use  the  term  "innovation/'  but  much 
thiat  wa  say  here  is  equally  applicable  to  conventional  outputs  that  are 
not  particularly  innovative, 

\ 

'*  '  ■ 

It  should  be  possible  to  classify  any  given  educational  product  in 

terms  of  Its  various  KP  and  KU  requirements.    Various  comblna'tions  of 

KP  and  KU  ^requirements  should'^ccur  wltH  notable  frequency,  yielding 

a  number  of  product  types*    Outlined  in  the  remainder  of  this  chapter 

is  our  initial  thinking  on  th€  K?  ^nd  KU  requirements  anl^ttributes 

that  seem  significant  enough  In  th^ir  impact  on  KPU  processes  to 

warrant  inclusio^  in  the  A^rmulation  of  this  typology*  and  the  coijrtbi-. 

nations  that  seem  to  suggest  what  such  a  typology  might  look  like, 

2.      KP  Requirements   "  ^ 

The  KP  requirements  of  any  product  can  be  described  in  terms  of  the 
quantity  and  types  of  resources  that  must  be  organized  and  managed 
to  bring  about  its  design,  development*  evaluation*  and  production. 
These  requirements  can  be  visualized  along  a  continuum.    On  one  end, 
we  would  place  a  10*page  set  of  learning  materials  designed  by  one 
teacher  \/orking  alone  as  an  addition  to  the  materials  she  uses  in  * 
teaching  a  single  unit  In  a  single  classroom  In  a  single  school.  On* 
the  other  end  of  the  continuum*  we  would  place  a  hypothetical  multi- 
media K-12  Instructional  systfem  for  teaching  reading  and  then  pro- 
viding substantive  instruction  in  the  full  range  of  subjects  taught  ^  ^ 
^in  elementary  and  secondary  schools  across  the  nation.    The  latter 
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example ^ould  entail  managing  KP  resources  of  considerably  greater 
scale  and  complexity       an  extervsive  amount  of  dJfrelopment  funding,  a 
broad  personnel  skill  mix^  a  wide  .range  of  fuactional  and  subject  \ 
matter  specialties,  an  extensive,  aifiount  of  research  and  numerous 
lengthy  development  and  evaluation  cycles^  collaborative  arrangements 
among  various  organizations  |nd/or  divisions  of  a  single  organization 
(e,g,,    hardware/software  subcontracting  errangements) >  etc* 

Our  schame^  therefore^  calls  for  aj^lyzing  the  KP  requirgmenUsf^of  any 
given  type  of  product  in  t^rmsyc^I  the  quantity  and  typeS*K  KP  resources 
to  be  assembled  and  manag^ji^ncludlng  funds ^  personnel,  functional 
and  subiUf  matter  sj>gcializations ^  and  ^echn61ogv.    The  frequently-*  - 

e  distlEictions  between  hardxi^are  and  software^  and  between  package-   ^  ^ 
le  products  and  less  tangible  processes^  would  be  subsumed  und^ 
^hese  resource  headings.  ■         /         .       ^  . 

KU  Attributes  that  Sj^^fiest  KPtJ  Requireml^ts 

^JWe  distinguish  two  partially  overlappihg  sets  of  attributes  ti^a^-^^ 
influence  the  jfate  of  an  innovation  in  the  KU  system;     (A)  attributes 
that  affect  the  willingness  of  school  officials  and  school  personnel 
to  adopt  and  try  an  ihnovation;  and  (B)  attributes  that  affect  the 
abilities  ot  scho^  personnel  tt)  implement  and  utilise  th^  innovation 
effectively.    The  first  set  Sug^s^  important  requirements  tO' be  met 
primarily  hy  the  packaging  and  dissemination/markfiting  functions^  But  y 
certainly  c<^nsideratioa  of  these  ^flpiirements  throughout  the  KP^lfe    ^  ^ 
cycle  of  a  product  would  minimiz^dif f  iculties  in  packaging"  and 'disse- 
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mlnation*    The-  second  set  of  attributes  point;    to  implementation  ^ 
supports^  that  may  have  to  be  investigated^  Mesigne'd,  developed,  and 
evaluated  as' carefullyas  tlie  innovation  itself, 

^  A>   .  Attributes  that  Affect  Willingness  to  Adopt 

r   '  ^ 

In  his  c  lassifc*  ana  lysis  of  the  diffusion  of  innovations^  Rogers 
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identified  five  characteristics  of  innovations  that  accounted  for 

.variance  in  their  diffusion,  rates :    relative  advantage,  communi- 
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cabilityj  divisibilityj  complexity ,  and  compatibility*  All 
five  are  useful  for  predicting  the  degree  of  difficulty  a  given 
iiyiovation  is  likely  to  encounter  in  the  adoption  process,  and 
therefore  what  KP,  packaging,  a^id  dissemination  strategies  might 
be  required.     (As  we  shall  see  shortly,  some  of  these  attributes 
are  also  useful  for  predicting  implementation  problems,  and 
therefore  for  sVggestingr  implementation  supports  to  be  developed 
?\oE\s- Uith  the  innovation  itself.) 


aV'    Relative  Advantage 


Is  a  paifticular  product  Qlearly  superior  to  the  product  or 

practice  that  it  would^eplace  (e.g*,   in  effectiveness,  cost, 

durability,  ease  of  use,  etc,)-    Not  all  products  in  the 

educational,  marketplace  are  int^ended  to  displace  existing 

« 

.products  or  pract^pesi    Maoy  are  intended  as' additions , 
to  si3pplemertt  what  is  used  curnently.    But  given  limited  time 
for  instruction  and  limited  resources  to  purchase  materials, 
most  additions  are  bound  to  displace  something  in  current 
use,^and  therefore  questions  of  relative  advantage  are  bound 
to  arise,  "even  with  seemingly  supplementary  materials. 


Questions  of  relative  advantage  are  often  difficult  to 
answer  in  relation  to  educational  products*    Give^  the 
nature  of  the  educational  knowledge  and  technology^  base, 
and  especially  th&  relative  immaturity  and  underdeveloped 
state  of,.*the  evaluation  research  function,  it  is  often  not 
•possible  to  get  a  clearcut^appraisal  of  the  effectiveness 
of  a  given  product.    Even  in\the  relatively  rare  cases  » 
whsre  evaluation^  have  been  conducted  and  evaluation  data 
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are  made  available  Vo  the  user  system,  the  product  competes 
with  estrablished  practice  or  other  products  in  the  marketplac 
that  have  not  been  so  evaluated^    Few  mechanisms  exist  to 
provide -comparative  evaluative  "inforn^tion  about  the  com- 
plete range  of  products  of  a  given  type  oa^peting  for  ^ 

87 

given  use  in  the  educational  market.       Therefore,  the 
school  board,  administrator,  or  teacher  considering  Adopting 
and/or  using  a  particular  product  has  little  strong  evidence 
on^irf^  to'^ake  a  judgment  of  relative  advantage. 


ffiiten  the  financial  problems  of  school  systems  in  recent 
years,  cos^  considerations  have  become  a  factor  of  major* 
importance  in  the  adoption/acquisition  stage  of  a  product's 
life  cycle*    If  a  new  product  is  less  costly  than  the  one 
it  replace,  adoption  probability  is  enhanced.    3ut  inno-^ 
vations  are  rarely  cost-reducing.    Often,  they  are  <iuite 
costly,  and  the  problems  are  complicated  by  the  "soft" 
money  funding  patterns  frequently  used  to  encourage  the 
diffusion  of  certain  types  of  innovations*    Federal  mona-y 
may  be  offered  as  an  incentive  fo^  school  system^  to  adopt  ^ 
and  utilise  a  complex  instructional  system  that  requires 
major  restructuring  of  a  school*s  instructional  and  admlni- 
strative  processes*    The-  federal  money  pays  for  all  costs 
for  a  three-year  installation  and  trial  period^*  However, 
after  the  trial  phase  is  ended,  the  federal  money  flow 
terminates  and  the  costs  must  be  absorbed  ^  the  local 
school  d^trict.    The  school  faces  a  serious  dilemma: 
either  it  must  take  the  added  cosfcc  out  of  its -already 
tight  operations  budget,  or,  after  having  restructured  the 
school's  instructional  and  administrative  processes  in 
accord  vi^h  the  innovation's  rec^uireq^ent"^,  it  must  drop  the 
program  ^nd  perhaps  again  go  through  the  strains  ^  restruc- 
turing,' this  time  to  retuXn  to  the  oW  patterij*^  Unhappy 
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experiences  of  this  kind  make  school  districts  wary  of 
adopting  innovations  supported  by  "soft"  funding.  ^ 


Xf  the  educational  marketplace  is  to  become  more  orderly^ 
innovation  management  wi\l  have  to  take  the  relative 
advantage  criterion  iato  account  throughout  R/D£tl  functioning 
—  in  the  questions  asked  during  need  i<fentif ication,  in 
the  kinds  of  research  quest  ions  investigated  as  a  basis  of 
product  development,  in  the  evaluation  standards  used  to 
judge  prototypes  and  Versions  of  the  developed  product,  in 
the  evaluative  data  disseminated  to  uger  systems,  in  the 
packaging  and  marketing  of  a  product,  and  in  the  macro- 
system  efforts  to  bring  structure  and  order  to  the  acqui- 
ts 

sition  function* 


Comraunicability 


How  easy  or  difficult  is  it  to  communicate  the  effects  of 
an  output  to  a  potential  adopter*?    Commuriicabilit^y  poses 
serious  problems  for  most  educational  innovation^*^  They 
tend  to  be  harder  to  evaluate  than  technological  innovations*^ 
The  <*lassic  example  used  to  illustrate  this  attribute,  is  the 
farmer  who  experiments  with  a  new  hybrid  corn*^    He  plants 
the  seeds,  and  withtn  a  reasonably  short  period  of  time 
gets  'a  crop  of  hybrid  cornT    The  superiority  of  the  hybrid 
corn  is  clearly  visible  and  ea^y  to  communicate.    The  rela- 
tively .contriSlled  conditions  under  which  the  experiment  was 
performed  permit  the  farmer  to  conclude ■  confidently  that  the 
new  seads  he  planted  were  indeed  responsible  for  his  improved 
corn  output .  .  - 

■   '  ■  /• 

The  effects  of  educational  innovationsiare  less  visible, 
E'ducational  goal^  are  less  tangible,     educational  effects 
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are  harder  Co  measure.     (And  the  statistical  jargon  used  ^ 
by  those  who  do  try  to  measure  those  effects  generally 
fails  to  enhance  an  innovation's  communicability*)  It 
taay  take  years  before  the  full  ef^^ts  ot  an  innovation 
become  visible.    And  so  many  influences  interact  in  the 
uncontrolled  conditions  of  classroom,  school,  home,  and 
community  that  it  is  rarely  possible  to  trace  an  observed 
^'effect"  to  a  particular  program  oVynnovation.  Conse- 
quently, ^it  ^s  more  difficult  in  education  to  provide  the 
potential  aS^pter  with  c learcat  inforcsation  about  an 
^rnnovat ion's  effects • 

Some  kinds  o£  educational  innovations  have  more  measurable, 
visible,  and  obvious  effects  than  others,  and  therefore 
pose  less  of  a  conjmunicability  problem.    It  vould  be  rela- 
tively easy,  for  instance,  to  cona^unicate  the  superiority 
of  a  low-cost,  computerised  scheduling  and  record-keeping 
'  system  over  conventional  clerical  procedures.    But  for  most 
educational  innovations,  especially  those  targetted  at 
instruction,  it  is  generally  difficult  for  developers  to 
Igtate  unequivocaUty  what  effects  the  adopter  can  expect  from 
implementing  a  given  innovation.    Consequently,  the  adopter 
is  ^ikely^to  be  hesitant  about  risking  resources  on  so 
uncertain  an  outcome.' 

f 

Communicability  barriers  are  being  overcome  where  the  develop 
ment  function  is  oriented  towards  producing  products  "with 
known  outcomes"  i»e,,  testing  a  product  Sufficiently  to 

be  confident  that  it  will  reliably  produce  a  specififi^ 
amount  of  a  specified  effect  under  specified  implementation 
conditions.    Effective  management  of  educational  innovations 
requires  this  careful  attention  to  communicability  issues  in 
both  the  development  and  dissemination  functions. 
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c.  Divisibility 

Can  an  innovation  be  divided  into  components  or  phased  that 
can  be  adopted  and  Implemented  on  a  stage-by-stage  basis? 
Or,  must  the  adopter  make  an  all-or-nothing  decision  and 
attempt  to  implement  the  entire  innovation  aC  once?  The 
^  less  commitmenr  an  a^pter  must  make  to  a  novel  approach, 
and  the  less  change  to  be  attempted 'at  any  one  point '^n 
time,  the  nore  likely  he  is  to  commit  himself  to  the 
innovation-  "  ^ 

'^I^i.  education  J  divisibility  takes  on  particular  significance 
vhen  the  innovation  under  consideration  Is  a  wholly  new 
instructional  approach,  of  considerable  scale  ^ind  complexity 
covering  several  grade  levels  and  subject  areas,  perhaps  ^ 
requiring  changes  in  school  organization  and  administration 
as  well  as  instruction  —  conceivably  even  requiring  modi- 
fications in  physical  facilities,    (Th^  transformation 

required  by  shifting  from  conventional  to  "open  education*' 

y 

'    is  illustrative  of  a-pervasive  kind  ^of  innovation  of  this- 
kind-) 

Where  these  complex  innovatitons  can  b^  designed  and  imple- 
mented in  stages  --  grade  by  grade,  and/or  subject  area  by 
subject  area       adoption  and  implementation  problems  are 
minimized.    Such^taging  needs  to  be  planned  for  ^throughout 
the  development  function-    Evaluation  data  need  to  be 
^  generated  on  the  consequences  of  different  patterns  of 
staging.    And  implementation  supports  consistent  with  the 
staging  need  to  be  designed  and  provided  as  pfirt  o^the 
innovation  "pacTcage"  to-be  adopted*  ' 

d.  Complexity 


I 

How  easy  or  difficult^,  is  it  to  use  a  new  product?  ^How  much 
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new  technology  is  required^  by  its  use?    How  much  staff 
training  is  necessary?    A  new  film  that  depicts  a  labora- 
tory experintent  previously  performed  by  the  classroom 
teacher  involves  little  complexicy.    Replacing  conven- 
tional ,inatheEnatics  instruction  with  the  **new  math**  or  with 
use  of  interactive  computer  consoles  involves  far  more 
complexity. 

Complexity  has  obvious  implications  for  the  design  of 
implementation  supports.    But  it  has  equally  significant 
effects  on  the  willingness  of  school  boards  and  school  per- 
sonnel to  adopt  different  inaovations  .    The  more  difficult 
it  is  for  school  personnel  to  understand  how  to  use  a  given 
innovation,  the  more  likely  they  are  to  ri^st  its  adoption 
and  use*    Even  when  they  are  Trilling  to  try  it,  gireater 
complexity .entails  greater  uncertainty  about  how  well  the 
Innovation  will  "work*'  with  these  teachers  in  this  setting, 
Therefore,  decision  makers  are  likely  to  be  more  hesitant 
to  conmit  scarce  resources  to  a  complex  innovation  with 
ambiguous  prospects  for  success.    Also,  greater  complexity 
requires  more  staff  training  and  other  implementation 
supports,  which  are  bound  to  further  complicate  school 
functioning  *    Consequently,  even  where  implementation 
supports  are  provided  to  overcome  the  complexity  inherent 
in  an  Innovation,  resistance  to  adopting  and  implementing 
the  innovation  is  likely  to  remain  to  «ome  extent.  These 
problems  suggest  requirements^  that  must  be  met  in  the 
course  o£  product  design,  development,  packaging,  and 
dissemination,  so  as  to  minimize  the  perceptions  of  com- 
plexity and  the  resultant  resistance  to  adopting  and  imple- 
menting the  Innovation*  ■ 
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ej  Compatibility 


To  what  degree  is  the  innovation  compatible  with  the  atti- 
tudes,  values,  moresj  'sensitivities,  past  experiences,  working 
styles,  current  practices,  capabilities,  etc.    of  user 
system  personnel  and  the  organizational  structure  and  work 
patterns  of  the  user  system?    To  what  extent  does  it  require 
unlearning  of  old  thought  and^*behavioral  patterns  as  well 
as  learning  of  new  ones?    Xo  what  extent  does  it  require     '  * 
changes  in  the  user  system  chat  are  incremental  vs.  radical?  . 
Does  the  new  practice  provj^de  additional  new  resources,  or 
does  It  require  a  change  in  the  resource  mix  (e.g^,  from 
labor-intensive  to  techno logy -in tensive)  that  creates  con- 
flict with  vested  interests? 

The  more  compatible  the  innovation  with  ^e^cisting  arrange- 
ments, the  more  likely  the  innovation  will  be  adopted,  imple- 
mented »  and  utilized  as  intended.    The  less  compatible  with 
existing  practice,  the  less  lilSly  it  will  be  adopted,  and 
regardless  of  official  adoption,  the  less  likely  it  will 
be  implemented  and  utilized  as  intended  rather  than  emascu- 
lated into  ''the  same  old  thing"  that  was  done  before-  Of 
all  the  attributes  affecting  what  happens  to  innovations  in 
the  user  system,  compatibility  is  generally  considered  the 
most  critl^cal  (especially  for  radically  new  R/D6el  outputs) 
and  is  given  the  most-  attention  in  the  literature.  ^ 


Gradations  of  compatibility/incompatibility  can  be  illustrated 
along  a  continuum^  from  most  toAeast  compatible,  and  zero  to 
incremental  to  radical  changffrequirements*    Fot  instance, 
^PQint:  1  mi^ht  be  represented  by  a  new  set  of  additional 
learning  materials  of  the  same  type  already  in  use  in  ^ 
given  uni^  of  a  particular  course,    ^int  2  might  be 
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illustrated  by  a  neu  textbook  covering  a  whole  course, 
consistent  in  approach  with  the  textbook  currently  used,  but 
requiring  some  new  lessoti  preparation.    Point  3  might  be' a 
wholly  new  unit  or  course,  const^e^t  with  ejcistlng  instruc- 
tional  approaches,  but  requiring  some  ^^ministrative  restruc- 
turing of  curriculum  offerings,  scheduling,  etc,    Point  4 
^could  be  illustrated ^by  a  oew  curriculum  for  a  given  subject 
area  on  a  given  grade  level,  requiring  some  training  of 
teachers  in  the  use  of  new  niaterials  and/or  instructional 
procedures,     In  instances  vhere  the  teacher  training 
requires  teachers  to  unlearn  ol5  thought  patterns  and 
behaviors  as  well  as  learn  new  ones  (e*g*,     learning  the 
"new  math"),  we  would  categorise  the  innovation  on,  ^et  us 
say,  point  5.    Point  6  might  carry  this  pattern  even 
further  —  e*g.,    an  innovation  requiring  teachers  to 
unlearn  old  thought  patterns  as  well  as  learn  new  instruc- 
tional  procedures  covering  not  simply  one  subject  but 
perhaps  several  subject  areas  or  even  all  subject  ^reas * 
Point  7  could  be  represented  by  an  innovation  that  is  not 
only  comprehensive  In  subject  area  and  grade  level  coverage, 
and  not  only 'requires  extensive  unlearning  of  old  patterns 
and  learning  of  new  ones,  but  aHto  runs  counter  to  Strong 
feelings  about  eEnotionally-ladenyissues        e.g-,  questions 
of  power,  authority,  and  toie  expectations  for  teachers  vis- 
a-vis students ,  administrators  vis-a-vis  teacher^ ,  school 
personnel  vis-a-vis  parent s^^jid^comnunity  residents ,  This 
extreme  ^degree  of  incompatibility  can  be  illustrated  by 
the  shift  frcm  conventional  education  to  "open  education," 
or  from  traditional  patterns  of  school  system  governance  in 
large  cities  to  "community  control." 

Innovations  targetted  at  different  school  system  functions 
tend  to  entail  differeat  degree^'of  compatibili^  or 
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incompatibility.    Innovations  in  physical  plant  are  least* 



likely  to  run  counter  to  established  attitudes',  practices, 
etc.     Innovations  in  the  a^tninlstratlon  function  (e.g., 
a  new  system  for  inventory  Vnd  distribution  of  books  and 
learning  materials)  are  only  slightly  more  likely  to  be 
incompatible  with  strongly  held  views  about  the  vays  schools 
should  function*    (An  exception  here  might  be  an  innovation 
like  a  management  inform^ition  system  that  could  be  used  in 
a  manner  having  significant  implications  for  the  instruction 
and  governance  functions  —  e.g.,    using  the  data  generated 
by  the  system  to  demand  teacher  ^"ccountablllty  for  student 
perform^ce.)    Innovations  in  the  instruction  function  are 
very  likely  to  b^  incompati:b*le  with  existing  pra^Jtice  if 
they  are  truly  innovative  and  require  radical  change  in  the 
manner  in  which  teaching  and  learning  are  carried  out*  And 
most  likely  of  all  to  generate  resistance  are  innovations 
in  governances  conceived  broadly  here  as  'changes  in  power, 
influence,  and  authority  relationships  aciong  teachers, 
^       students,  administrators,  parents  and  other  community 

residents.    The  fate  of  the  tuition  voucher  idea  illustrates 
the  Substantial  resistance  likely  to  be  generated  by 
radically  new  approaches  to  the  governance  function. 

The  greater  the  inherent  incompatibility  of  an  innovation 
with  existing  practice,  attitudes,  etc.,  the  more  this 
must  be  taken  into  account  in  KP  functioning  --^  in  the  way 
the  innovation  is  designed,  developed,  and  evaluated J^nd 
especially  in  the  way  it  is  packaged  and  disseminated* 

B.      Attributes  that  Affect  Ability  to  Implement 

Three  of  the  sstributes  we  have  analyzed  affect  the  ab^^rTt'ves  of 
school  personnel  to  implement  a  gS^ven  innovation,  as  t^ll  as 


"\  i      \  their  uilliagaess  to  adopt  it.    We  shall  consider  these  again 

briefly,  suggesting  for  each  the  kinds  of  impiementation  supports 
that  are  required  and  therafore  must  be  designed,  developed, 
tested,  packaged,  and  disseminated  along  with*the  innovation 
itself.    ■  ■  ^ 

a.  Divisibility 


Complex  innovations^  are  likely. to  be  implemented  more 
effectively  if  they  are  divisible  and  can  be  installed  in 
stages*    Staged  implementation  sjjggests  KP  as  ^i^ell  as 
requirements        research  on  the  njost  effective  patterns  of 
staging,  design  and  testing  of  implementation  supports  for 
installing  each  stage,  packaging  and  disseminating  the 
staged  implementation  supports,  and  perhaps  providing 
implementation  specialists  to  giVe  technical  assistance 
during  the  staged  implementation. 

^b  >  Complexity 

The  greater  the  inherent  complexity  of  an  innovation,  the 
more  implementation  supports  are  likely  to  be  needed 
more  teachers*  guides  or  how-to-do-it  films;  perhaps 
progracnned  instructional  materials;  certainly  more  teacher 
training;  and  perhaps,  too,  implement-ation  specialists 
to  work  with  teachers  and  administrators  during  the  instal- 
lation and  trial  period.    If  these  implementation  supports 
are  to^be  tQa3y.Riairy  effective,  we  would  argue  strongly  for 
int^^ating  their  design,  development,  and  testing  into  the 
design-development-and-evaluation  activities  that  are  focused 
on  producing  the  innovation  itself. 


s 
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c .  CoT-DatlbilitY 

All  that  we  have  said  about  the  KP  and  KU  requirements 
suggested  by  an  innovation's' coraplexlty  applies  also  to 
comfJatibility  *  but  perhaps  to  an  even- greater  extent- 
Overcoming  incompatibility  requires  a  special  sensitivity 
to  user  system  attributes,  the  kinds  of  changes  in  user 
system  functioning  made  necessary  by  an  innovation,  and 
the  kinds  of  problems  these  changes    pose  for  user  system 
personnel  *    The  greater  the  incompatibi^lity  between 
existing  practices  and  attitudes,  on  tbe  one  hand,  and  the 
demands  of  a  given  innovation,  on  the  other,  the  more 
attention  must  be  directed  not  only  to  developing  an- 

:  '  understanding  of  th^  changes  required  but  acceptance  also. 

\  ^  Iniplementabion  supports  must  be  targetted  at  not  only  the 

technological  aspects  of  atr  Innovation  (e,g,, '  changes  In 

S 

Instructional  procedures),  but  perhaps  also  differences 
required  in  attitudes,  valuer,  authority  relationships, 
organizational  arrangements,  etc.    The  greater  the  incom*- 
patibility,  then,  the  more  essential  it  would  seem  to 
provide  implementation  specialists  to  work  with  school 
personnel  during  the  installation  and^rial  periods. 
Whether  or  not  implementation  specialists  are  provided, 
implementation  supports  need  to  be  carefully  deslgnexi, 
developed,  and  tested  during  the  KP  phase  of  the  innovation 
cycle  rather  than  generate^d  intuitively  during  implementa- 
tion.   There  is  little  evidence  in  education  of  this  kind 
of.KP  activity  directed  toward  KU  requirements. 

4.      KP-KU  Attribute  Combinations?    The  Basis  of  an  Educational  R/D&I  * 
Output  Typology 

We  have  considered^ three  dimensions  on  which  educational  r/d&I  products 
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and  innovations  can  be  analyzed:    KP  requirements;  KU  attributes  that 
affect  the  willingness  of  operating  system  personnel  to  adopt  an  inno- 
vation; and  KU  attributes  that  affect  the  abilities  of  operating 
system  personnel  to  implement  an  innovation  effectively.    We  have 
assumed  that  these  three^ dimensions  o£  analysis  are  quantifiable  in 
some  rough  way  "or  other,  and  that  any  innovation  can  be  placed  somewhere 
6n  a  continuum  for  each  attribute  or  KPU  requirement. 

As  a  basis  for  developing  a  typology  from  these  dimensions,  we  made 
two  further  simplifying  assumptions*.    First,  although  ue  acknowledge 
that  there  are  methodological  problems  in  converting  quantitative 
dimensions  (e*g.,    degree  of  compatibility)  into  typological  categories 
(e.g.,    high  vs.  low  compatibility),  we  assume  that  it  is  both  possible 
and  reasonable  for  us  to  follow  this  procedure*    Second,  we  assume 
that  various  output  attributes  and  resultant  KPU  requirements  tend  to 
go  together  and  have  the  same  implications  for  integrated  KP-KU  product 
manageaent  strategies.     (For  instance,  relative  advantage  and  communica- 
bility  are  likely  to  go  together  and  suggest  similar  kinds  of  KP  require- 
ments and  management  strategies.    High  levels  of  complex  KP  requirements' 
are  likely  to  be  correlated  with  high  deg^^s  of  KU  complexity  and  in- 
compatibility.)   Enumerating  these  combinations,  then,  and  considering 
the  kinds  of  management  strategies  suggested  l^y  each,  should  be  useful. 

The  procedure  we  followed  in  formulating  our  typology  was  quite  simple. 
We  dichotomized  each  of  our  three  dimensions  of  analysis  into  high  vs* 
low^categories:     (1)  high  vs.  low  KP  requirements  inherent  in  the 
innovation  itself  (i.e.,  number  and  complexity  of  types  of  manpower, 
functional  specialties,  subject  matter  specialities,  funding,  and 
technology);  (2)  high  v3.  low  KPU  requirements  due  to  KU  attributes 
likely  to  make  school  personnel  more  or  less  resistant  to  ^adopting 
the  innovation;  and  (3)  high  vs.  low  KPU  reqiureraencs  due  to  KU  at- 
tributes likely  to  make  it  more  or  less  difficult  for  school  personnel 
to  implement  the  innovation  effectively. 
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We  thea  generated  all  possible  combii^ations  from  these  dichotomized 
dlmeaslons>  and  thereby  produced  our  eight-category  typology* 

^    a\      Prod'jcts  with  High  Inherent  KP  Requir$.meats  and  High  KPU 
Requirements  Because  of  Attributes  that  Pose  Difficulties 
fot'^^th  Adoption  and  Implementation 

An  example  of  a  type  A  output  night  be  a  coaiprehansive  K-G, 
multi-media  instructional  system  with  unclear  relative  ,advaatage 
*3p.d  co'nmunicabili^y,  and  substantial  complexity  and  incoiap^^^^ 
ability*    kpU  matla^ement  of  this  kind  of  product  woul<f  require 
assembling  and  organizing  a  wide  range  of  resources^  especially 
complex  personnel  skill  mixes  and  extensive  funding.    It  might 
necessitate  tfollaborative  relationships  among  various  contractofT- 
and  subcontractors/  posing  significant  coordinatioa  problems.  J 
The  KU  barriers  to  su^ccessful  adoption  and  implementation  suggest 
the  need  for  KPU  management  that  focuses  specialized  KP  activities^ 
on  these  problep^/ while  the -;Substan9e  of  the  product  is  being 
developed.    Th4se  activities  might^ include  evaluation,  packaging,  . 
and  dissemination  activities  directed  at  identifying  aad  describing 
the  innovation's  effects^  and  especially  its  advantages  over 
existing  products  an<i^^actices.    Thfese  KU-oriented  KP  activities 
^        might  also  include  development  of  teacher  training  and  support 
materials  and  programs  (teachers'  guides,  how-to-do-it  filmsj 
training  programs),  perhaps  too,  supports  for  'administrators,  and 
maybe  even  packages  for  use  by  implementation  specialists  in 
technical  assistance  teams  assigned  to  work  with  school  personnel 
during  the  installation  and  trial  period. 

Products  with  Hi^h  Inherent  KP  Requirements  and  Moderately 

HiRty  KPU  Requirements  Because  of  Attributes  that  Pose 
   ^  

Difficulties  for  Implementation  But  Hot  Adoption  ^ 
An  tixample  of  a  type  B  product  might  be  a  comprehensive  grad^^ 


1-^  system  of  indi\^iduati2ed  instruction  in  reading  andfbther 

subject^,  requiring  the  same  extensive  ragge  of  KP  resources 

and  implementation  supports  as  our  type  A  example.,  but^dif- 
•        ^  -  ■ 

feriaf^from.  the  type  A  example  by  being  readily  communicable 
and  having^  a  clear  relative'advantage  over  existing  practice. 
A  well  designed  array  of  interrelated  teaching  machines  and 
^^rogrammed  instructional  materials  fiiight  fall  into  this  category' 


INE  availaiSe  at      low  ct)st. 


Tyne  3  output  management  requires  the  same  kinds  of  KPU  resourced 
£ind  managemsntr  strategies  ^escribgd  above  for*.type  A  —  asseqt- 
b-ling,  orgaaizmg,  ^  and  coordinating  an  extensive  array  of 
^^fesources,  developing  collaborative  relationmips  ^mong  various 
■  Subcontractors ,  ^nd  de\%loping"  a^  wid^'^^nge  of  i-ntensive  imple- 
mentation supports.    Type  B  differs  Q^ly  in  tequiring  less 
attention  to  the  set  of  evaluation,  l^ckaging,  and  dissemination 
activities  directed  at  overcofiiing  the  relative  advantage  and 
commuiiicability^  barriers  that  characterize  t^pe  A  but  not  type 
B  Outputs • 

*A  type  A  product-^tnlght  be  shifted  into  the  type  fiVategory  if 
certain  conditions  were  met  iA  the  design  of  th^i^icoduct ,  For 
instance,  if  an  insttiJctio;ial  system  was  conceptualized  and 
designed  with  narrowlxyjhg^if ied  performance  objectives  and 
frequent  diagnosticT^MWi^'iv^  Interventions,  student  gains 
would  in  all    likeljJB^BDecome  mcfre  -vi^i^ffble,  and 'the^conununi- 
cabiliJiy  and.  relative  advantage  "problems  inherervt^  in^  the  initia 
coftciiption  9f  the  innovatiorfe  might  be  overcome.* 


Products  with  High\nherent       Requirements  and  Moderate 
KU-Or'ient&d  KP  Requirements  Because  of  Attributes  that 
Pose^  Difficulties  for  AdQpt.ion  But, Not  Implemeo^ation 


An*e:jample  of  a  typ^  C  output 'mlgly:  be  development  of  a  series 
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of  extraordinary  films  relating  human  functioning  biological, 
psychological,  so«;io logical,  and  ecological  to  similar 

patterns  in  other  species  of  the  animal  kingdom,    "^^a.  films 
might '  require  assembling  expensive  talent  and  equipment,  .and 
costly  filming  in  remote  l^^ions  of  the  world  or  inside  the 
human  body  winh  exf^ensive  equipment.    -Though  easy  to  implement, 
serious  barriers  to  adoption  might  be  raised  in  some  comniunities 
because  of  the  basic  conception  of  the  films  —  likening  human  ^ 
and  animal  beWvior,  considering  evolution,  showing  reproductive 
and 'oc her  functioris  still  controversial  in  public  c'Uucation. 

Products  of  this  kind  might  be  managed  more  effectively  if  the 
kinds  of  adoption  problems  they  are  likely  to  pose  are  thought 
through  during  the  conceptualization  and  development  of  the 
product  itself-    Packaging  and  promotional  activity  after  the 
product  is  fully  developed  are  likely  to  have  limited  ef fectivetffess 
irt* overcoming  these  barriers.    Given  the  extensive  KP  require- 
ments of  this^type  of  innovation  and  therefore  thfe' high  KP  costs 
to  be  expected,  adoption  planning  can  be  absorbed  without  undue 
strain  if  these  acttvities'^re  planned  at  the  outset.    This  is 
especially  true  sihce  implementation  problema  are  minimal  or 
even  nonexistent  and'  therefore  plaice  no  additional  strain  on  i 
available  KP^ resources . 

D.   ^Froducts  with  Hi>ah  Inherent  KF  Requirements  But  Attributes  ' 

that  Pose  No  Difficulties  for  Either  Adoption  or  Implementation 

An  exatnple  of  a  type  D  innovation  mighty  be  a  series  of  films  or 
printed  materials  similar  in  quality  and^scope  to  our  type  C  " 
example,  but  having  no  inherently  controversial  subject  matter  ^ 
or ^other  attributes  that  would  pose  adoption  barriers.    The  material 
would  simply  be  used  as  additions  ,to  existing  materials,  or  would 
perhaps  replace  a^textbook  chapter  or  a  set  of  teacher-made,  material 


ol  lesser  quality.    At  most,  the"  new  materials  might*  require  soiue 

new  Lesson  plans  >  but  certainly  no  signifiCfipc  ctiange  in  gracti'c<is^; 

or  instructional  strategies*    The  materials,  mlght-'be^a^  costly 

to  deveTop  as  those  in  our  type      example,  but''Vide;.sCale'Ntdop- 

»        .  .  *" 

tion  and  implementation  wouid  likely  permit  low  "Uifif  costs  to   ,  " 

adopting  school  systems*    Given  this  comhinati,oji'of  ^ittribute^i 

effectyje  KP  management  of  a  type  D  produtt  woul'd.  eai^J,; for- care* 

fully  controlled  development  and  production,  costfr,  and  broad-based" 

marketing  and  promotion  to  permit  pricing  fpr-mass  dis-tributiori*  ^ 

E*      Koducts  with  Low  Inherent  KP  Reqaire^ent^  But  High  Kft 
Requitem&nts  Because  of 'Attributes  .that  Poge  i)if ficulties 
for  Both  Adoption  and  Impjlempntation  ^  '  " 

.  -    :  ' 

Typ%  E  can  be  illustrated  by  a  trairtlng  program  to  increase  racial 
sensitivity  and  improve  intergroup  relations  ia  racially  tense 
school  districts.    Training  programs       this  kind  can  be  developed 
at  little  cost  by  ^s  few  as  one  or  two  Sf^ecialisti*  ■  KP  require- 
ments are  minimal.    The  difficulty  is  persuading  school  systems 
to  adopt  such  threatening  programs,  with  unclear  advantages,  and 
'unclear  effects,  of  any  kind,  likeiy*to  threaten  existing  sensi- 
tivities,  practices>  etc-    With  such  programs,  even  if  adoption 
problem^  are  overcome  (perhaps  with  the  incentive  of  £SAA  funding 
or  under  the  pressure  of  a  court  order)*",  implementation  problems* 
are  likely.' to  be  enormous  >  especially  if  implementation  is 
defined  as  not  simply  providing  training  in  workshops  but  also 
carrying  yit  into,  and  monitoring  effects  in,  classrooms  and 
administrative  offices. 

Programs  of  this  kiftd^re  rarely  el||(cfcive.    We  would  argue  that 
part  of  the  problem  is  attributable  to  the  way  they  are  managed. 
Development  costs    tend  to  be  use^.as  the  yards^tick  for-determining 
totaI_  allocations  for  such  programs*    Since  development  costs  are 


■Tow,  l'i?t;j:X^  money  i^  '.ay^ii^le*\'^j^y6^^i^ome  '^the '  px<^&TamW.  /■  .-^  ' 
^sulyst'an^ial  KU/ requirements,  ,,:Jh'i"^''5U^gest?'^'t^  manage' 
.meat"  3trat.egies''ifor  type  E  pr,i?duciJ^,^>ttSxy^  the 
.approprlafo^^tt'.' yard^tj^^   to  ;ConsidS:>-kU  ^  well,  as       costs,  ,or 
that  plkit'Xpt.YM  reqai^tdenlss^  ^*pa?t  of  KP  davelopmetit  vork 
,and  KP  deve  I'opmenj: 


Products  "vlth  Uo^  Irthera^cit  KP -Re^tJ-li^eWnt;]^  arvd  Moderate 


KFU  Requlr^ents  Because 'ol^TTy^rlbut^a  that^ose  Dlfflcurtrt^s 
For  Implementation  3ut^  ii>:>t 'Adoption  '    '  * 

Team  teaching,  ungrade'^iS  , classrooms-,  -aad  opten  ^uca^tion  are  exatople 
of  irmovatiorts  thit  have  low -BCH  r6qolrementa  aad  are  readilj^ 
'  adopted^,  but  are  difficult  tp  jLmp'1'efnen.t.    These  are  the  *'idea*' 
ionovatlons"  that,  are  rarely  ^'deyetoped'*  infthe  R&D  sense,  even 
more  rarely  "packaged'^  for  utilization,  but  become  popular  arvd 
spjread  as  fads.    Because  there  is  so  ],ittlfe  development  afid 
packaging^  the  idea  means  different  tfiings  to  different  people 
and  is-  implemented  quite  differently  from  place  t6  plhce  often 
emasculated'  into  *^more  of  t^e  same  old  thing-**  ^Implementation 
problems  tend  to  be  considerable       both  because  'there  is  so 
little  development  an^  packaging,  and  b^i:ause  these  ideas  tend 
to  be  incompatible  with  conventional  practice  and  with  strongly 
held  ylews  about  what  schools  should  look  like  and  how  they  should 
func:fcion: 

> 

Effective  KPU  tpanagem^n^  o£  type  F  innovations  would  seem  to 
require  focusing  on  the  implemen!;ai^ion  process-  Essentially 
what  we  have  in  mind  is  developing  and^^^p^ckaging  these '*'idea** 
Irtno vat  Ions       researching,  developing,  evaluating,  and  packaging 
these  approaches  and  strategies  *in  a  manner  that  provides  a  range 
of  stipports  to  facilitate  their' implementation.    Such  packaging 
might  include  print  and.  media  descriptions  of  these  innovations 
in  operation,  detailed  how-to-do-it  guides,  evaluation  checklists. 
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training  prdgraras  for  school  personnel,  and  tooj  ideally,^  pro- 
vision  of  implementation  specialists  in  technical  assistance 
teams.    Appropriating  significant  sums  to  this  kind  of  imple- 
raeatation^oriented  development  is  uncommon  in  education,  though 
not  unknown*    If  educational  practice  is  to  be  significantly  ^ 
affected  by  idea*  innovations,  it  seems  to  us  that  type  F.  inno- 
vatiPns  will  require  this  kind  of  KPU  management  focus. 

Systematic  development  of  Idea  innovations  would  also  seem 
essential  to  serve  anothe^r  purpose  —  reducing  the  faddish  nature  \ 
of  the  acquisition  process 'for  type  F  innovations.    The  develop- 
ment function  geneifates  extensive  amounts  of  evsJtiaCion  d^ta  that 
c|in  provide  acquisition  personnel  with  comparative  information  on 
competing  strjategies  or  variations  on^  a  single  type  of  innovation. 
Once  comparative  evaluation  information  is  widely  available,  the 

/acquisition  function  is  less  likely  to  be  subject  to  fads  and  ^ 
mpre  likely-  to  be  influenced  by  data  on  product  effectiveness, 

G,      Products  with  Low  Inherent  KP  Requirements  and  Moderate 
KPU  Requirements  Due  to  Attributes  th^t- Poge  Difficulties 
for  Adoption  But  ^fot  Implementation 

A  classic  type  C  innovation  would  be  a  new  unit  ^or  course  on  a^ 
controversial  subject  such  as  sex  education.    Development  of  the 
course  or  unit  would,  probably  be  inexpensive  and  require  few  KP 
resources.    Implementation  would  be  relatively  easy.  Adoption 
barriers,  however,  might  be  considerable  in  a  conservative  com- 
munity with  strong  reservations , about  the  propriety  of  the  subject 
matter  for  public  education,      *  -  '  *  * 

Effective  KPU  management  of  an  innovation  of  this  kind  might 
require  extensive  attention  to  adoption  (i,e,,  marketing) 
problems.     Ideally,  we  would  envision  developers  working  with 
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mrketicig  personnel  ta  predetermine  the , segments  of  the  overall  ^ 
market  to  be  reached 'by  this  product,  to  accommodate  the  product's 
design  to         likely^ concerns  of  these  dlffereat  segments  0^;here- 
ver  possible  without' IrtiRalring  the  product's  integrity),  and  to 
design  differentiated  market ing' strategies  targetted  at  these  ^ 
different  segments  of -the  overall  market.    Integrated  product 
and  marketing  planning  of  this  kind  is  relatively  rare  in  edu- 
cational r/dSeI,  but  it  is  especially  rare  with  products  that 
require  such*  lo^ KP  investments.    Appending  aa  expensive  narketlag 
apparattis  to  lanovatrons  i;lth  lov  KP  co^ts  :;ould  ieem  dlfftcelt 
to  justify.    Therefore,  this  set  of  conditions  suggests  the 
need  for  a  specialized  marketing  apparatus  able  to  handle  large 
numbers  of  suth  products,  reducing  the,  per  product  and  per  unit 
costs^.of  the  marketing  operation.    An  organization  of  this  kind 
might  be  public,  quasi-public,  or  private,  subsidized  or  self- 
support  lag  ,"  or  perhaps  changing  in  status  over  time.  But 
clearly,  type  G  outputs  will  need  some  such  marketing  support 
if  they  are  ever  ^  be  diffused  widely. 

H.      Products  with  Low  Inherent  KP  Requirements  and  Low  KPU 
Requirements  Due"  to  Attributes  that  Pose  Ho  Difficulties 
for  EitYier  Adoption  or  Implementation 

^Most  conventional  learning  materials  are  of  this  type.  They 
are  relatively  sipiple  and  therefore  require  few  resources  for 
development  or  production.    They  can  be  used  easily  in  any 
classroom,  without  requiring  any  new  learning  or  conflicting 
with  existing  practice.    Ihey^re  uncontroversia  1 ,  and  there** 
fore  pose  few  barriers  to  adoption.    Their  effects  niay  not  be 
known  in  advance^  but  that  is  equally  true  of  competing  sets  of 
materials  on  the  market.    There  may  be  no  haVd  evaluation  data 
to  prove  the  relative  advantage  of  this  set  of  materials  over 
another,  but  the  adopter  perceives  thetr^^lJp  be  better. 
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Educational  products  of  this  type  are  the  least  costly  and  easiest 
to  develop  and  disseminate.    But  so  many  products  of  this  type  are 
available  on  the  market^  and  so  little  comparative  evaluation  in- 
formation is  available  about  them, 'that  the ''educational  marketplace 
is  rather  chaotic  and  acquisition  processes  are  somewhat  random* 
|f  this  situation  is  to  be  remedied,  a  mechanism  is  needed  to 
ac,quire  and  disseminate  uniform  descriptive  and  evaluative  infor* 
mation  on  comparable  outputs.    We  gave  some  attention  to  this 
matter  in  our  chapter  on  the  acquisition  function*  ' 

I.  Sumnjary 

We  have  '<fjnsidered  eight  combinations  of-pro^uct  attributes  that 
seem  significant  enough  in  their  impact  on  KlPtf  processes  to 
require  different  overall  KPU  management  strategies,  Within*each 
of  these  eight  product  tyt)es,  we  can  envision  subcategories  by 
differentiating  patterns  within  each  of  our  three  basic  analytical 
dimensions  —  different  combination  of  KP  resources  to  be  assem- 
bled and  organized,  diiferent  types  of  adoption  and/or  implemen- 
tation problems  to  be  overconie,  etc.    Just  as  the  eight  basic 
categories  suggested  (differences  in  overall  KPU  management 
strategies,  each  of  these  subcategories  would  suggest  difference's 
in  fitanagement  requirements       Q-g*,    differences  in  management 
strategies  foir  hardware  vs*  software,  innovations,  or  for  different 
personnel  skill  mix^s,  or  for  different  organi^a^tional  arrange- 
ments, etc.    The^complexity  could  be  carried  to  a  considerable 

^eg^ee  with  greater  and  greater  specificity  of  combinations. 

Ifovever^  this  analysis  was  not  undertaken  to  generate  thi^^Sj^^d 
of  complex  typology.    Rather,  we  were  concer^ned  with  suggesting 
the  kind  of  typology  we  see  as  useful.    The  intent  of  our 
approach  has  been:     (1)  to  suggest  how  important  it  is  to 
analyze  a  product's  KP  and  KU  attributes  and  requirements  at  the 
outset  of  R/D6I  decision  making  on  a  given  project  and  to 
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integrate  KU  planning  into  KP  activities;  and  (2)  to  emphasize 
the  need  for  adequate  allocation  of  resources  to  both  KP  and 
KU  requirements  throughout  a  product's  conception-to-insti- 
tutionalxz5ttion  life  cycle* 


4 

VIII.  .CONCLUSIONS 

Our.  analysis  in  this  chapter  has  focused  on  the  outputs  produced  by  the 
educaticJnaX  r/D^I  system  in  this  country.    We  have  noted  that  some  high 
quality  outputs  have  been  identified  and  some  of  these  are  widely  usedV 
and  that  in  addition  there  have  been  many  significant  bodies  of  research 
that  have  had  a  substantial  impact  on  the  improvement  of  educational  prac- 
tice.   However,  we  ha\?e  also  considered  the  generally    "mediocre*'  rating 
given  CO  most  of  the  research  and  most  o£  the' development  work  thac  have 
been  carried  out,  %nd  we  have  suggested  several  kinds  of  steps  we  see  as 
needed  co  improve  output  quality. 

Before  these  steps  can  be  taken,  however,  a  considerajble  amount  of  con-  " 
ceprual  work  would  seem  to  be  called  for  as  a  basis  for  designing  the 
kind  of  daca  base  and  mohicoring  syscem  we  believe  to  be  essential  to 
assist  policymakers  in  fornualting  and  assessing  policy  initiatives  to 
iii$>rove  system  functioning  and  raise  output  quality.    And  wxch  that>  we 
have  called  for  a  substantial  amount  of  data*gathering  and  analysis es^ 
IJecially  process  analyses  of  quality  functioning  and  creative  observation- 
al analyses  of  the. practice  setting  for  which  development  outputs  in  par- 
ticular are  "being  designed. 

We  have  tried  to  suggest  the  kinds  of  thinking  we  see  as  needed  and  the 
kinds  of  research  we  beliave  needs  to  be  supported.    However,  we  see  very 
little  evidence  at  this  time  that  the  sponsors  of  educational  R/Dfirl 
activity  appreciate  the  systemic  requirements  for  improving  quality  and 
therefore  the  significance  of  developing  the  suggested  data  base  and 
monitoring  system  to  inform  policymaking  on  these  matters.  Clearly, 
cher^  "ire  a  ntimber  of  reasonable  approaches  to  improving  output  quality^ 
and  developing  a  data  base  on  outputs  may  well  seem  too  indirect  and  long^ 
tern  an  xippraach  to  meeting  that  need.    However^  the  more  direct  approaches 
suppr>rtC'd  over         last  two  decades  do  not  seem  to  have  had  a  sufficiently 
powerful  effect        output  quality,  and  we  seem  to  know  as  little  now  about 
tht?  s;)eciflc  requirements  for  quality  work  of  each  type  as  we  knew  a  de- 
cade or  two  ago.    The  Peeson,  we  would  argue,  is  that  we  have  not  made  the 
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effort  CO  Increase  our  uaderstandiag  of  the  R/D&I  processes  thac  are 
cdrricid  out  to  pr^odtice  outputs  or  the  sys^tem  of  perforniers  who  carry 
them  outp    Until  we  develop  a  better  understanding  of  those  processes 
*  and  their  requirements  in  the  setting^  where  they  are  carried  out->  we 
will  be  in  no  better  position  to  fashion  effecti've  policies  to  improve 
output  quality  and  tliereby  produce  significant  improvement  in  educa- 
tional practice. 
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FootTiotes 


3. 
4. 


Del  Schalock,  Gregory  P.  Thomas,  Kevin  A,  Morse  ,^Clark,  A  • 
Smith,  Harry  L-  Ammerman,  The  Oregon  Studies  ir^ducatioaal 
Research)  Developmedt,  Diffusion^  aad  Evaluation)  Volume  It. 
Summary  Report  (also  see  Volumes  II-V)     (Monmouth,  Oregon; 
Teaching  Research  Division,  Oregon  State  System  of  Higher 
Education,  1972) •  ^ 

Intermediate  outputs  ar^ *not  a  separate  category  in  the  Oregon 
Studies  scheme.    Rather,  they  include  these  among  others  in 
their  broad  "products"  output  category, 

Schalock  et  al,,  Oregon  Studies:    Voludie  I)  o;>^  cit . ,  p.  104, 
Ibid. 

Office  of  Education,  Educatit/nal  Research  and  Development  in  the 
United  States     (Washington,  D..C,;    U,S,  Government  Printing 
Office,  1969), 


6,      National  Institute  of  Education,  1976  Databook:    The  Status  of 
Education  Research  and  Development  in  the  United  S-tatgs 
'     (WashiP^gton;    NIE,  1976), 

p    7.      Virtually  all  of  the  layer  research  organizations  (and  many  of 
the  smaller  ones  as  well)  print  and  distribute  pamphlets,  bro- 
cht^es,  or  other  forms  of  publicatioa  lists  enumerating  the 
various  published  and/or\inpublished  research  reports,  articles, 
monographs ,- etc , ,  produced  by  their  staff.     Illustrative  of  the 
range  of  organizations,  we  note  some  few  of  the  organizations 
whose  lists  of  publications  we  have  seen  recently:    The  University 
of  Michigan^'s  Insfit^vte  for  Social  Research,  (and  within  the  ISR) 
The  Center  for  Research  on  the  Utilization  of  Scii^ndific  Informa- 
tion, The  Bureau  of  Social  Science  Research,  Abt  Associates,  The 
Center  for  Kfew  Schools,  and  The  Institute  for  Responsive  Education, 

8.  Council  for  Educational  Development  and  Jle search  (CEDaR) ,  CEDaR 
Catalo;^  of  Selected  Educational  Research  and  Development  Programs 
and"  Products    (Denver;    CEDaR,  1972)\ 

9.  National  Institute  of  Education,  Catalog  of  NIE  Education  Prodticts 
(Washington:    NIE,  1976), 

10.      D.        Kratochvil  et  al,.  Product  Development  Reports  (Palo  Alto; 
American  Institutes,  for  Resea-rcK,  1972);  also  see:    S,  Henrie, 
(ed*)  ALERT:    A  Sourcebook  of  Elementary  Curricula  Programs  and 
Pro  ject^  (San  Francisco:    Far  West  Laboratory  £or  Educational 
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Research  and  Development,  1972);  and  Brenda  J.  Turnbull  et  al. , 
Projgotina  Change  in  Schools:    A  Diffusion  Casebook  (San  Francisco 
Far  West  Laboratory  for  Educational  Research  and  Development, 
1974),  ^  ' 

For  instance,  see:    J*  I*  Smith  atid  Mary  F*  McCord  (eds*)*  ERIC 
Information  in  Analysis  Products  1967-1972  (Washington:  ERIC 
Clearinghouse  on  Library  and  Information  Sciences,  1973) 
ED  073  862;  blary  F*  McCord  (ed,)  ERIC  Products  19^0-1971:  An 
Annotated  Biblioaraphy  of  Information  Analysis  PuSlications  of  ^ 
the  ERIC»Clearin^ous»-;^July  1970  through  June  1971  (Washington: 
ERIC  Clearinghouse  on  4-ibrary  and-Information  Sciences,  1971) 
ED  054  827,  "  y 

I^ducational  Products  Information  Exchange,  New  York  City. 

Mortimer  Smith,  Richard  Peck,  and  George  Weber,  A  Consumer ' s 
Gulcie  to  Educational  Innovations  (Washington:    Council  for 
Ba^ic  Education,  1972)* 

Fred       Kerlinger.  (ed.)  Revi^  of  Research  in  Education: 
Volume  ^  (Itasca>  Illinois:    F.  E*  Peacock,  1973);  Fred 
Kerlinger  and  John  B*  Carroll  (eds*)  Review  of  Research  In 
Education:    Volume  II  (Itasca,  Illinois:    F*  E.  Peacock,  1974); 
Fr^d  I?*  Kerlinger  (ed*)  Review  of  Research  in  Education: 
Volume  III  (Itasca,  Illinois:    F*  E*  Peacock,  1975);    Lee  S* 
Schulmany  (ed*)  Review  of  Research  In  Education:    Volume  IV 
(_Xtasca,  Illinois:    F*  E*  Peacock,  1976);  and  Lee  S*.Schulman 
(^d*)  Review  of  Research  in  Education:    Volume  V  (Itasca, 
IlliRbis:    F,  E*  Peacock,  1977). 

N.  L*  Gage  (ed*)  Handbook  of  Research  on  Teaching  (Chicago: 
Rand  McNally,  1963);  Robert  M*       Travels  (edO  The  Second  ^ 
Handbook  of  Research  on  Teaching  (Chicago;    Rand  McMally, 
1973)* 

The,  most  recent  of  these  multi-volume  sejts^ls  the  fourth  edition, 
R*  L.  Ebel  (ed*)  Encyclopedia  of  Educatjjfeal  Research-  4th  ed* 
(New  York:    Macmillan,  1969). 

Prior  to  the  REE  policy  change,  this  quarterly  published  only 
brief  commissioned  reviews  on  a  series  of  standard  topics  'focused 
largely  on  educational^  practice  (e*g.:    curriculum,,  guidan<;e, 
administration,  testing,  school  organization)*    The  topics  were 
rotated  so  that  everjr  few  years  the  same  topic  reappeared  (e*g*: 
a  full  issue"  on  curriculum,  with  separate  reviews  on  each  subjecJt 
matter  field),  reviewed  significant  research  and  other  develop- 
ments that  appeared 'since  the  last  review,  and  may  also  have 


17.  provided  an  integrative  status  report  on  ^the  state  of  knowledge 
(cont'd)    on  that  topic  at;  the  time.    The  RER  was  subjected  to  a  good  deal  ^ 

of  criticism  by  Vesearchers  for.  failing  to  provide  much  of  a 
^ense  of  what  was\ happening  in  the  live  research  areas  of  the 
field-    This  change  in  AERA  policy  has  trans foj^in^  the  RER  into 
a  journal  oriented  prifnariiy  to  researchers  aiid.to  KP  concerns 
rather  than  practitioners  and  KU  concerns, 

18,  For  instance,  12  journal  abstractory  and, indexing  services 
relevant  to  educational  research  are  listed  in  Carnot  E,  Nelson, 
"Abstract  and  Information  Retrieval  Services  in  Educational 
Research:    Current  Status  and  Planned  Improvement,"  Educational 
Researches,    Vol,  3,  No,  10,  November  1974,    Kelson  lists 
Psychological  Abstracts ,  Mental  Retardation  Abstracts,  Exceptional 
Child  Abstracts,  dsh  Abstracts,  College  Stiiclent  Personnel  Abstracts, 
Child  Development  Abstracts  and  Bibliography,  Educational  Admini- 
stration Abstracts,  Sociology  of  Education  Abstracts,  Language  and 
Language  Behavior  Abstracts,  Current  Index  to  Journals  in  Educa- 
tion, Educational  Index,  and  Current  Contents  in  Social  and 
Behavioral  Sciences,    In  addition,  there  are  services  which 
abstract  research  in  progress  and/or  the  fugitive  literature 

(e.g,:    The.  Smithsonian  Institution  Scientific  Information 
Exchange ^or  ERIC*s  Research* in  Progress), 

For  instance,  see:    G&ae  V, .Glass  -(ed,)  Evaluation  Studies: 
Review  Annuals  Volume  1  (Beverly  Hills:    Sage  Publications,  1976); 
Marcia  Guttentag  (ed-).  Evaluation  Studies;    Review  Annual/ 
Vol  time  2  (Beyerly  Hills:    Sage  Publications,  1977);  Thomas  D, 
Cook  (ed)  Evaluation  Studies:    Review  Annual,  Volume  3  (Beverly 


HiWs:    Sage  Publications,  1978  forthcoming). 


20,  Caroline  H.  Persell,    The  Quality  of  Research  on  Education:  An 
Empirical  Study  of  Researchers  and  Their  Work,    Uew  York,  Bureau 
of  Applied  Social  Research,  ^Columbia  University  1971, 

21,  For  instance,  se^i    Lee  J,  Cronback  and  Patrick  Suppes  (eds,) 
Research  for  Tomorrow's  Schools;    Disciplined  Inquiry  For 
Education  (New  York:    Macmillan,  1969),  pp,  158-159,  232,269; 
Michael  Seriven,    "The  Philosophy  of  Science  in  Educational 
Research,"  Review  of  Educational  Research,  Vol,  30,  1960; 

A.  TSTtu"!    A  Arvey  of  Educational  Research  and  an  Appraisal 
by  Scientists  from  Other  Fields  (Bloomington,  Indiana:    School  of 
Education,  Indiana  University,  1967);    Ronald  G,  Corwin  and 
Maynard' Seider.    "Patterns  of  Educational  Research:  Reflections 
'        on  Some  General  Issues,"  '  In  Richard  Dershiimer  (ed-)  The  Educa- 
tional Research  Community:    Its  Communication  and  Social  Structure 
(Washington;    AERA,  1970),  ED  057  275;  National  Academy  of 
Sciences,  Fundamental  Research  and  the  Process  of  Education* 
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21.      Final  Report  of  the  Committee  on  Fundamental  Research  Relevaat 
(cont'd)      to  Education,  Sara  B-  Kiesler  and  Charles  F.  Turner  (eds.) 

(Washington:    Ijational  Academy  of  Sciences,  1977).    Also  se,e  1 

the  Phi  Delta  Kappa  symposia  on  educational  research:    F-  W.,                  *  ! 

BangharG  (ed.)  First  Annual  Phi  Delta  Kappa  Symposium -on  j 

Educational  Research  (Bloomin^ton,  Indiaaa:    Phi  Delta  Kappa,  j 

1960)  ;  R.  C^  Collier,  Jr.  and  S-  M,  Elam  (eds.)  Second  Annual  "  1 
Phi  Delta  Kappa  Symposium  on  Educational  Research;  Research 

Design  and  Analysts  (Bloomington,  Indiana;    Phi  Delta  Kappa,  J 

1961)  ;  E.  Cuba  and  S-  Elam  (eds.)  Sixth  Annual  Phi  Delta  Kappa  | 
Symposium  on  Educational  Research:  The  Training  and  Nurture  \ 
of  Educatiortal  Researchers  (BloomLngton^  Indiana:  Phi  Delta  ! 
Kappa,. 1965).                                                           .    x             '                      ■  ! 


22,  T^enjansin  S*  Bloom.    Twenty-Five  Ye;^r5;  of  EducatlJtial  Research." 
'  American  Educational  Research  Journal,  Vol*  3,  No.  1,  Hay  1966- 

23,  Edvln  Wandt,  Georgia  S,  Adams,  Dorothy  M-  Collet t,  William  B- 
Michael,  David       Ryans,  and  Carleton  B,  Shay,    ''An  Evaluation 

*     of  Educational  Research  Published  in  Journ3l5***    Report 'of  the 
CoEimittee  ,on  Evaluation  of  Research  (Washington;  American 
Educational  Research  Association,  1967);  Edwin  Uandt*    A  Cross-^ 
'  Sectioit  o£  Educational  Research  (New  York;    David  McKay  Co,, 
1965);  Annie  W-  Ward,  Bruce  W-  Hall  and  Charles  F,  Schramm. 
"Evaluation  of  Published  Educational  Research;    A  ^^atiorial 
Survey."    American  Educational 'Research  Journal,  Vol.  12,  No*  2, 
,  Spring,  1975,  pp.  109-128;  Persell,  op.  cit. 

^    -  -  A 

24,  EdVard  L.  Vockell  and  William  Asher.    **Percept iofts  of  Document 
Quality  and  Use  hy  Educational  Decision  Makers  and  Researchers/' 
American  Educational  Research  Journal,    vhl.  II,  No,  3,  Summer 
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procedures  in  the  RSD  tradition  is  found  in  both  the^^^  OE  Status 
Report  (Educational  Research  and  Development  inj^jf^f^nited  States).  ^ 
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OEj  Educational  Research  and  Development  in  *the  Unite^^t^^tesT^op. 
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Kratochvil  et  al-.  Product  Development  Reports,  op.  cifl^;  and 
Tiirnbull,  et  ai-.  Promoting  Change  .in  Schools,  op .  .cit/t .    Also  see 
J,  J.  Crawford,  D,  W.  KratochviJ^  an^  C.'E.  Wright ,-^^aluaVion  of 
th^  InpacX  of  Educational  R^D  Products,/ Final  Repor1r/(Palo  Al^o: 
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UXE\^  1976  Databook,  op.  cit, /pp.  52-55.       "        "  ^  . 

For  instance^  M^cAdain  and  Fuljler,  Kaleidoscope  2 ,  op .  cit . 

"OS  Memorandutn  tp  Superintendents\Fbbruar'y  IX^  1^74,  as  quoted  in 
Einr^ck  et  al.,  Evalyation  of  the  ti^Vional  Diffusion  Netivork,  op.  cit« 
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J- 

81. 
82, 


Ibid,    Also  see  the  September  197-5  National  Diffusion  Network* 
Program  catalog  entitled  Educational  PrQ^rams  That  Work. 

^6  Daoabook,  op.  cit;,      ^  ^ 

Nelson  and^Sieb^rJ  Innovations  in  Urban  Secondary  Schools^  op,  cit. 


Ibid .    The  quality^  ratings  of  only  3  of  the  17  innovations  included 
in  the  study  had  a  standard  deviation  of  1*0  or  ra6)^e  on  a  scale  of 
1  to  5. 


83, 


Ibid. 


Ne^^H^^and  Sieber  report  the  Spearman  rank  order  correlation 


two  variables  as  »34. 


84, 
85. 


86. 
37, 
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For  irfstancej  see  Rogers,  Diffusion  of  Innovations,  op.  cit.;  John 
^ incysT'^^I^centives  for  Innovation  in  the  Public  Schools,**  Reviei^ 
of  E^duciti^al  Research,  Vol,         No,  1,  Winter  1974;    Henry  M.. 
BriCkeH,  Orkanizing  Nev  York  State  for  Educational  Change  -(Albany; 
New  Yor^  State  Department  of  Education,  1961);    Willard  Jones, 
"Tne\  Nature  and  Process  of  Educational  Development  J'  in  The  Qreg;on 
Studies^  -Vol,  II,  op.  cit.    Also  see  Gerald  Zaltman  and  Nan  -liin, 
"On  tfhe  Nature  of  Innovations,"    American  Behavioral  Scientist^ 
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Rogers\  Diffusion  of  Innovations,  op, cit . 

See  our  chapter  on  the  acquisition  function  in  educational  R/D61,  , 
and  also' National  Institute  of  Educatitpn,  A  Concept  Paper  for  the 
School  Practice  and  .Service  Division  (Washington:    NIE»  1975). 

Pincus,  "Incentives  for  Innovation  in  the  Public  Sqhools>"  op,  cit.. 
For  a  contrary  perspective  on  the  effect  of  costs , 'see_  fielson  and     .  J 
Sieber,  Innovations  in  Urban  Secondary  SchdolSj  op,  cit< 
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Subsumed  under  rr&fed  identification  are  all  processes  of  perception, 
conceptualization,  art iciilation,  screening,  and  decisionmaking  that 
lead  to  the  determination  of  what  needs  the  r/D^I  system  (and^or 
particular  R^d^eX  Institution^)  will  attempt  to  meet  —  what  research 
questions  will'b^  stiidietli  what  products  will  be  developed^  what 
organizational  strategies  or  change  processes  will  be  designed^  what 
e:cistiT>^  R^D6cI  products  will  be  adopted  or  .adapted  by  a  user  system^ 
etc.     Included  is  need    identification  as  it  occurs  in  sponsor 
organizations  (e.g.,  NXE,  OE,  or  Eound^ions)  or  in  perEormsr  or;;ani- 
za^ions  (e  ,g".  ,  uni^rers  ities  ^  regional  laboratories ,  or  non-profit 
R/DSsI  firms)  j  .  institutions  at  the  knowledge-producing  or  the  knowledge- 
utilizing  end  of  ths  KPU  spectrum.    The  need  identification  process  my 
ba  the  stimulus  for  R^D  activities  oriented  to  deve-loping  new  products 
(or  processes  or  s  trategie-s) ,  or  for  the  search-atquisition-adaptation- 
impiemsntation  cycle  that  brings  existing  products  into  use  in  new^  , 
settings,  or  for  various  kinds  of  problem^solving  or  practice-based 
development  activities  within  schools  or  other,  parts  of  the  operating 

systetn  (e.g.,   district  offices,  SEAS,  lEAs,  etc . )  * 

r 

Of  all  the  dimensions  on  which  R^D£tl  systems  could  be  compared  fron 
sector  to  sector,  need  identification  processes  suggest,  perhaps 
more  than  any  other  feature,  the  degree  of  integration  that  exists 
between  KP  and  KU  functions.    Inhere  ne^d  identification  processes  are 
operating  well:     (1)    K6d>  products  are  geared  to  needs  of  the  user 
system^that  are  real  end  are  perceived  as  such  by  user  system  per- 
spnneii-    (2)  RiiD  outputs  are  designed  initialiy,  or  adapted  later,  in 
a  manner  that  takes  :':^ro  account  the  attributes,  and  especially  the 
constraints,  of  user  systenas,  and  the  workiog    types,  preference^, 
and  sensitivities  of  user  system  personnel;     (3)  responsiveness  to  .v 
user  syscen  attributes  ivC  the  need  icfejitif ication  function  spills 
oVer  into  the  manr\ei:_-irn  which  other  r/d&I  functions  are  carried  out 
how  knowledge  is  generated,  ho^  products  are  developed,  how  they  arc 
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evaluated^  d isse:ninaced ,  or  marketed,  how  they  are  ifnatalled,  and 
especially  what  implementation  supports  are  provided.  Consequently, 
the  probLeras  of  user  system  adopcion/adaption,  implementation,  and 
utilisation  of  development  products  *are  minimized. 


there  has  been  much  criticis?i  of  need  identification  processes  in 
educational  R/D6cl,  and  some'^^^i^this  has  appeared  in  the  literature. 
Much  of  the  discussion  in  the  literature  is  phras^ed  in  the  most 
.general  terms bemoaning  the  "research  to  practice  gap"  and  the 
irrelevance  of  r.ost  educational  research  to  eJucacioual  practice, 
or  Che  difficulties  of  getting  school  systems  to  adopt  R6[D  outputs 
presumably  designed  to  meet  their  needs,  or  the  "faddishness"  of 
ntuch  educational  innovation*    Some  of  the  literature  more  specifically 
pinpoints  characteristics  of  need  identification  processes  in  edu  a- 
tion  as  a  major  cause  of  these  gaps,  and  therefore  of  the  limited' 
impact  of  RfitD  Outputs  on  educational  practice,! 

* 

Our  analysis  suggests  thSt  need  identification  processes  in  educatioq^^^^ 
show  few  of  the  attributes  of  need  identification  in  mature  R/DitI  sys- 
tems*     xf  we  are  to  develop  feasible  policy  options  and  management" 
strategies  to  remedy  this  situation,  we  must  develop  an  understanding 
of  several  things:     first-,  how  needs  are  identified  in  educationf^ 
second,  how  this  compares  to  need  identification  as  this  takes  place 
more  effectively  in  other  sectors;  third,  what  issues  this  sug^sts 
in  developing  policy  options  and  management  strategies  for  restructuring 
and  changing  tlie  manner  in  whi^ph  need  identification  occurfe  ;  fourth, 
how  the  educational  context  ^^ffects  the  desirability  and  feasibility 
of  certain  options  and  strategies;  and  finally,  what  more  we  need  "to 
know  before  we  ^^lewi^jifisign  workable  policies  and  management  strategies 
f QT  Iheed  identification  in  education.       The  analysis  that  follows 
considers  each  of  the^e  points* 
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I,       HOW  NEEDS  ARE  IDf-NTIFTEO  IN  EDUCATION 

 : 

Several  patterns-oE  need  id^rvtification  in  education  can  be  distin- 
guLshedj  varying  along  four  dimensions:    who  identifies  the  needj 
the  basis  for  the  perception  of  needj  the  extent  to  which  needs  are  ■ 
translated  into  innovation  requirements;  and  the  nature  of  the 
decisionmaking  niechanisnis  used  to  screen  alternatives  and  make  need 
identification  decisions  for  a  system, 

I,      'Jbo  Identifies  tb^  ^eed       ^::ternal  or  Internal  i^eed  Identifiers? 

A.      Exte]?nal  Need  Identifiers 

—  —  ^ —  t  * 

Given  the  strong  influence  of  Environmental  forces  on  educational 
institutions  (both  operating  systems  and  R/D6cl  Institutions),  it 
should  not  be  suii>rising  that  a  significant  number  of  the  most 
pressing  needs  to  which  these  institutions  respond  are  identified 
by  organizations^-  institationSj  and  individuals  in  that  environ*- 
metit.     Examples  of  external  need  identifiers  abound^    The  courts, 
for  instance ,  have  mandated  school  desegregation  and  the  develop- 
ment  of  programs  to  ease  the  effects  of  that  desegregation*  The 
courts  have  also  mandated  the  provision  of  bilingual  education 
in  districts  where  large  numbers  of  students  are  unable  to  com- 
prehend the  English  language  at  a  level  adequate  to  derive 
benefit  from  their  schooling.    The  effect  has  been  the  need  to 

~         ---  £q^  stuSe 


develop  instructional  programs  for  student^  whose  primary 
nguage  is  Spanish>«^tallan>  Gre^k,  French,  or  Chinese.  To 
e  another  example,  Congress  has  identified  compensatory 
education  for  disadvantaged  students  as  a  high  priority  need, 
and  the  provision  of  large  sums  o£  Title  I  funds  for'sucT 
programs  has  had  ^  major  impact  on  the  activities  of  both 
educational  R^iJ£<I  and  gperating  systems^ 
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Nongo7erntnental  examples  of  need  identification  in  the  broader 
environment  could       cited  as  well       the  cl^ll  rights  move- 
ment's concern  with  black  pride  and  black  students*  self-'  ^ 
images,  leading  Jto  the  identification  of  needs  to  revise  text- 
books and  course  content  and  even  provide  speciaflzed  new 
courses  and  totally  new  kinds  of  materials;  similar  patterns  of  " 
n«ed  identification  Influencing  textbook  and  materials  develop- 
ment ,  for  programs  targetted  at  Hispanlc^Americans ,  Nativ^  * 
Americans,  au^  other  ethnic  groups;  and  the  most  recent  ripple  ^ 
"In  ttis  pattern^  the  identification  of  sexism  in  textbooks  and 
educaCional  materials  as  a  problem  requiring  responses  from  the 
"R^Di^X  4na^  operating  systems,  j 

]  '  *  ■ 

In  all. these  examples,  the  locus  of  the  need  Identification  <» 
process  is  In  the  broader  envlrpnment  of  the  educational  R/Oid 
and  operating  systems, **^TTi?*^eeds  so  identified  are  communicated 
frons  the  en^vironment  through  court  mandates  and  the  power  to 
force  compliance,  through  legislation  making  available  large 
sums  of  money  to  entice  responsive  program  development,  or  through 
pressure  group  tactics  or  efforts  at  moral  suasioTi  that  a^e 
difficult  for  school  systems^  to  res.ist, 

B.  JTnternal  Need  Identifiers 


Several  other  patttrns  ^f^  need  identification  can'be  traced  to 
origins  within  the  R/D&I  or  operating  systems.    The  loci  of  need 
identification  in  the^e  instances  are:     researchers,  developers, 
R^^-D  entrepreneurs,  R/D^I^  spon'sors ,  and  R/D£cl  institutions, 
policymakers  and  administrator^  at  the  federal,  ^tfete,  'and  local 
levels  of^the  operating  system;  teachers  and  other  operating 
system  personnel  who  interact  directly  with  students;  and 
school  hO£*rds  and  their  parent  and  community  constituer\cles^  We 
consider  example^  of  the  functioning  of  these  need  identifiers 
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2.      ^^at  Are  the  Bases  of  Need  Perception  --  Data^  Intuition;  or 
Opfiortunlstn^ 

*  A.      Data-based  Need  Identification 

'     We  use  the  terri  data-based  to  describe  the  p^rqcesses  that  lead 
to  the  identification  of  a  need  foHoving,  and  as  a  consequence 
of  ^  analysis  of  a  body  of  enpirical  ^ata.    Specifically  excluded 
from  this  category  are  needs  identif f^^WrT^arious  intuitive  ^ 
poTltlcalj  and  other  ireans,  and  then/'justlSied  by  reference  to 
Sata  assetnbled  after  the  fact,    Two  kinds  of  data-based  need 

I 

identification  can  be  distinguished:  ^(1)  systeinatic,  ongoing 
analysis  of  routinely  collected  data,  cyclically  relieved  as 
part  of  an  institutionalized  need  identi£icat}f«nL  ruri<jLi'A'ir;  and; 
(2)  one-^ime  analyses  of  particular  pieces/6r  bodies  of  dat^ 
collected  primarily  for  some  other  purpose^  but  ^sed  on  an 
ad  hoc  basis  to  identify  a  particular  aead  or  set  of  needs. 

a.      Systematic^  Ongoing  Analysis  of  Routinely  Collected 
Data  Bases 

With    increased  application    of  the 
technology  of  management  information  systems *to  the 
ed\Jcation  sector,  we  are  beginning  to  see  the  emergence 
of  planning  toward  the  development  of  SEA  or  LEA  managa- 
ment  information  systems.     Such"  systems  are  expected  to 
be  geared  specifically  to  identifying  needs  and  tnanaging 
activities  related  to  the  development,  implementation, 
and  evaluation  of  programs  designed  to  meet  those  needs, 
^Suggestions  of  this  pattern  can  be  discerned  in  national* 
and  state  assessment  projects,  in  work  on  the  developmeaf 
of  social  indicators  ^pplicabl^  to  education,  and  in 
contract  wbrk  to  assist  L^As  la  designing^  iostalllng. 


I. 


#  ^ 
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— ^ -       ^nd  ^Utilizing  maaagerr^eat  inf ormatioa  systems  to  meet' 

, their  .nteds.^      '  ^^^^  -  ,  ' 

\     +  Where  this  pattera  of  data-based- meed  ideatif ic^tion  rs 

operative  (aad  itr  may  aot  yet  be  fully  oper^loaal  anywhere 
/  ^       at. this  tiiae)  ,  needs  are  i-dentTified  qa  a  perfbtlic,  cyclical 

^      '  basis  a$  palrt  of  th^  routini^ed  proce^es  of  system 


functioning.  Needs  ar6  identified  by  comp^ryig  certain 
prespacified  perforrnanae  goals  with  cuVrent  data  on  the 


^  ^'    degree  to  which  the  s)sd^em  is  achieveit^^  these  go^als.    The  ^ 


0  * 


loci  cvf  need  identification  of  this  Uinj^^nd  to  be  palic^ 
^    ,       y  r)akers  and  ^administrators*  at  the  federal,  state^  or  local  * 

levels  of 'operating  sy/tems  that  hage  such  Mta  i^ses  and 
systematise  need  identification  mec^^isSl^  avaJlable'^^  . 
them.     Only  occasionally  nvigVit  researchers  or  R/DStl  institutions 
ka  the  locus  of  this  kind  df  need  identification;  where  they 
Rave  been  giverf  access  to  these  data  basss  and  are.func- 
^  tioning  eithar  on  their  own  or  in  collaboratioa  with  operaj^^'4^||^ 
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^  ting  system  personnel* 

^ J      "  "   b/     Findings       Research  *  Single  Studies,  Research  / 
" *^  ^      .    ' .      *  Programs^  or  Reas^ssments  of  Bodies  of  Re^BTchx         ,       ***  ^ 
4f        *^  ^  ^      *     lieatj'in^  ^o  New  Theoretical  Piaradigtns'^ 

*  .  '  '   Raeeatch  studies  generally  conclude  by  pointing  to  further 

^^P^        %  *  research  that.Tieeds  fo  be  done  to  pursue  lead^s  Uncovered  in 

.  a  particular  investigation^  or  to  untangle  r  quest  ions  left-^ 

^    yf  uransw^red,  or  to  •daal  with  contingencies  ouPside  the  scope 

-  of  a  particular  dAigp.-/  Or,  research  JEindirigss  may  pinpoint, 
elaborate  on;  dr  uncojrer  hitherto  'unno^t^ced  problems,  in 


4k 


need  of  solution  through  R/D&I  processes..  On  ocg^^s^on^    ^  4 
Idrge  research  programs  may  be  designed  'and  cai^jrieJr  out 
in  a  mann&i?'^5^,t  identifies  the,,  pa'^ameters-  of  the  nfeedecl 
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solution  to  a  problemj  perhaps %*7eii  specifications  for  a 
product  pr  an  otganizatdonal  strategy  or^  an  instructional. 

*       -  u 

systein  to  be  de.veloped.  >         ^  ^  ^ 


,  And  rarest  of  all,  reassessments  and  syntheses  of  Jbodies  .  , 
of  research  may  lead  to  wholly  new  theoretical  paradigms 
apd  uholfv  new  definitions  of  deeds  to  be  met  or  programs 
to  be  developed.    Certainly  much  of  the  educational  R/Di<I  , 
activity  of  the  last  decacle  that  was  focused  on  cornpen-  ^  ^ 
:>atory  and  preschool  education  is  traceable  t^g^^|^s'j^e7elop- 
nent  and  popuIa::^;iing  of  new  paradigms.    OAe  kind  "of 
compensatory  education  program  development  followed  froi?- 
the  delineation  of  a  paradigm  of  disadvantage,  deprivation, 

*'or  deficit.     A  some^nat  different  Jcind  of  co[npeiasa.tory 
education^  iprograrming  evolved  from^a  revisionist  paradigm 
emphasizing^  cultural  difference  rather  thag  3efi<5it.  One 
tJieoretit;al  paradigm  stimulated  identification  of  the 
preschool  age  period  of  3      5  as  a  key  target  of  R/D^l 
activities.    A  n*er  paradigmMs  suggesting  that  the  target 
age  should  be  lowered  to  perhaps*  the  period  from  birth  ta. 
age  2.      ^'  '         ^  , 

noted  earlier  that  ongoing,  systematic  analysis  of.  ■ 
routinely  collected  data  as  part  pf  an  institutionalig^dt 
need  identification  function,  if  it  exists  'at  all,  pri- 
marily a^|Gct>s  need^  identification  as  t^is,  is  carried  out 
*by  polic>Tnaker3,  jand  administrA'^rs"'in' SsAb  and  ^LEAs  .who 
have  developed  and  are  utilizing  such  iftanagement  informat^j^on 
systems,  iln  sha'rp  contrast,  the  research  findings  and 
'pheorecical  paradigms  we  ha-^e  considered  in  trhis  section 
are  a  major,  and  perhaps  the  major,  basCs  of  need  identiflca 
tion  'as  this  takes  pLace  among  researchers  and  in  some 
R/D&I  institutions*  .to  some  extent,  too,  these  research 
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* ^    '  findiTigs*  and  , paradigms  affect  need  identification  as  it 

^  takes',  place  among  policymakers  at  the  federal  level  (or 

irf  foundations)  as  they  formulate  funding  programs  for 
R/D£(I  activities  they  will  sup^rt*    This  is  especially 
'  feo  in  c/a^ses  where  research  findi^s  or  paradig;ms  get' 

popularized  arid  affect  the  byroad ^cy^rrents  of  social 
thought,  or  reinforce  a  significant  social  and/or 
^  ^        political  Hidvenjenj:  in  thi  broader  environment  of  the 

R/D^l  aTid^perattng  sysjtems*  (This  is,  well  illustrated, 
by  thV  compensatory  education  exanple,)  \     ^   ^  . 


Intuitive  Need  Identification 


We  have  no  way  of  knowingV^r  even  estimating  dhe  proportion  ' 
^      of  all  need  identification  in  education  that  is  data-based,  i 

However^  there  is  ample  testimony  in  the  literature '  to  the  ;^ 
preponderant    inrluence^  of  ^<^perietic^ ,  anal/sis  ,  e^cp^rt      1  ^ 
opinion,  and  various  forms  of  int;^iti%*n 'ia  deterisiining  edun       ^  '  ,^ 
'cat^pnal.  needs  in  the  dperatirfg  system,    and  som4  reason- to 
suppact  that  mucb  the  same  is  true'^of  need 'identification  vrv>/- 
R/Dcil  organizations  as  ^i^l.    Three' pat:ter.ns  of  intuitive 
need  identification  can  be  distinguished:     (1)  -  need  identi- 
ficatian  by  spontan^us  insight;  (2)  need*  identification  by 
polling;  and  (3)  need  identification  by  comp^cj^on*     ^  *  \ 

*  * 

a,*     Spontaneous  Insight  ^  ^ 

\t>    ^  >  We  i^nclude  in  this  category  all  tieed^identification  that 

c^^bg  traced  fto  an  a-hal  phenomenon  at  its  true  inception*.  ♦* 
The  creative  'teacher  or  administrator  senses  a  problem,      *  , 
thinks  vabout  how  to*  remedy  it*  and  decides  that  she  needs 
to  'J^vplop  a. certain  kind  of  instrucj:i*nal  srtrategy,  or 

-'A 


^  # 

V 


*5 


771  * 


certain  set  of  tc^terials,  or  a  particular  kind  oi  progcati' 
or  policy,  or  that  she  ne^s  to^flnd  answer^  to  certain 
sset  of  questions  bofocA^he  can  proceed  further.    A  cre- 
ative researcher  ponder^  over  a  cjertain^  ^it-uation  that  he 
finds  pri)bjj^matiCj  and  generates  a  series  of  research 
questi^ons  that  he  feels  must  be  answered  before  a  feasible 
solution  to  the  problem  ^an  bj^^und.    A  r^eearch  or 
"R^D^I  entrepreneur  or  sponsor  needs  a  project  or  An 
(approach  to  which  he  feels  h^  can  commit  himsjelfj  his 
cri^anUatioa,  ani  his  r^^sources.    He  uiuseSj  and  he  is 
scruck  hy  an  idea  th^t  satisfies*  aiKi  perhaps-^^n  excites 
bin.  ^  ^ 


ERJC 
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Polling 


"A  'funding  source  has  money  no  spend  and  asks  experts  an**  ^ 
^the  "field  to'suggest  what  neeli^  to  be  done  and  what  R'D&I 
activities  shoul^  be  supported*    An  R/D^I  organization  is 
api^roaching  the  beginning  of  a  new  funding  cycle  and  needs 
ideas  for  a  progr^tq^that  can  attract  funds*    The  ^t35|tf  of 
the 'organizatipn  ar^  asked  to  generate  ideas  .  ^  Or,  experts- 
and  varix>us  consul^tants  are  brou^fc  in  for  a  brain-storrning 


session*,  or  ars  cotnmissioned  to  write^apers  identif yirsg* 
needs"  to  be' met  atid  suggesting  R/D6tl  programs  to  meet 
those  needs*    Or  a'^ormaX  need^  aisessmetit  is  carried  out. 
consisting  of  polling  user-s^st?^  personnel  about  their 
needs  and  how  t;hey  j^ght^^^be  met^  by  R/D&I  activities.  All 
th^ee  examples  r^prese^t  what  we  are  refei-ring  to  as  need 
identification  by  polling,  ^  , 


i/ere  is  clearly 'Iperite  97erlap  between  titese  examples  and 
need* Ide^ti f  icatfon' s^pontane^us  insigl^l;^^  individuals 
included  in  the  pblHng  may  ponder  the  questions  posed 


to  fchein  and  then  generate  the  kind  of  a-hal  solution  we  , 
have  included 'lu  the  soonfaneous;  insight  categjbry.  The 
distinction  Jjetween  the  two  lies  in  the  source  o£  the 
stimulus  and  the  <Jegree  to  which  organizational  arrange- 
ment^,frare  needed  to  initiate  and  manage  the  process.  Need 
identification  by  spontaneous  insight  begins  witK  a  self- 
starter,  ran  individual  yho  starts  identifying  needs  without 
being  specifically  asked  by  anjron^  else  to  do'^so*  And 
equally  significant,  the  entire  inception  piltee  of  r>eed 
idehtif  ic^^3r55f  irrvolve^  only  that  one  ind^aual.  Need 
id(intif icatlon  by  polling,  in  contrast, _  requires  an 
organisational- stimulus  (the  request  or  polling)  to  set  the 
ococess  in  Tnotion.    And  since  the  process  may  invcvlve  large 
nuinbers  bf  indi-yiduals  who  are  so  polled ,  management  of  the 
'process ^tends  to  require  the  development  of  organizational 

■  &rrang"ei:!ents  that  may  in  some  cases  become  exta^nsive  and 
complex.  * 

c,      Conpsrlson  * 

Pat'ents  or  members  of  a  school  board  hear  about  a^  exciting 
new  program  in  a  neigh'boring  school  ^igtrict .     Or- perhaps 

■  they  read  aboiit  some  new  approach-   such  as  open  education, 

whigk^appeers  to  be  sweeping  .the  .country,  and  is  the  latest 

"in"  iij^ovation  for  presumably  increasing  the  qu4lity  or 

the  enjoyinent  of  education.    Th^jLr  district  has  no  -such     .  ^ 

progran.    The- need  is  defined  by  "cpnparing  what^e:cists  in 

the  dl3;trict  C'/lth^ras  ^,ists^^so^e-^feere  else,  or  is  being, 

talked  ^bout  or  written'.^baut  e-lsewh^et  , 
f      .        -        ■  '  * 

R^p6T  drganisfetion  has  defined  its  o rganizatio^l 
mission  In  ji  manner  that  places  *lT>44i__a  cotng^itive  ^ 
position  '^ith;  l^t  us  five  or  sipc  other  R'D^T  ; 


^     organisat io,;^f7    M 1  ^ ar?*^t^T?Tp«i4jj;g^_fg^  the^4?nie  funds  in  the 
^s^^se^of^'grants  or  contracts^  or  the^^e'  crf^Sitfi  in  the; 
c^^'of  gt'oviding  services  or  devel^^ng  and  niarketing 
products.     Comparison  with  £ifr^  scope  of  activities  pursued 
by  one*s  coTr.petitors%  or  the  types  "of  R/ Did  outputs  they  ^ 
^roducGj  suggests  a  €et  of  needs, 

Both^  thl^^^ases  illustrate  the  process  of  peed  identification 
by  cinparisoT^.    The  basis  for  the  perception  of  need  is  only 
i7.'Hrectly  a  rt;iil -;/orld  problem  ^f  tlie  R/D^T  or  o9>eratiTt^ 
3yste:n.    The  ii:irr.ediate  source  of  ths-'perception  is'a  com- 
parison bstveen  what  exists  at  a  particular  pplnc  time 
In  the  prcr^ranniing  of  a  particular  R/D6cl  or  operating 
systen  institutioifi  and  what  exists  somewhere  else*    All  ^ 
aspects  of  the  comparison  make  intuiti,ve  sense  to  the  need 
identifier the  coi^iparative  process  as  a  means  of  identi- 
fyi/ig  needs  J  thie  validity  of  the  particular  comparison  made  ^ 
and  the  T^eed  idei^tified  as  a  result  of  making  the  comp^arison. 

Al^ough  we  have  no  wa}^  of  estimating  how  nuctf  of  all  need  , 

^4ntificatioa  in  education  falls  Into  this  pattern^  the 
:requeTit  crttici/m  of  education^^ijinnovation  as  faddish 
suggests  that  tVyare  is  a  sijiilficant^anioujig  of  need  Idertti*- 
fic^.tion  "by  co"bpari^^nj  especially  In  operating  systems 


Opportui%^5t^  ^:efe  Identification 


Ue  use  the  tern  opportunistic  to  r^fer  to  those  pa^tern^of  need 

tc!enci£ic3tton  in  which  the  impetus  comes  primarily  from  the 

exist^nfie        a  resoi3|r^ej  and  only  secondarily^  from  the  existence 

of  a  problem*    The' aJtrai lability  of  a  resource,  and  its  potential 

for  use  in  a  beneftclat  manner^  is  whaf  In  fact  suggests  the 

■  *  # 

n^t^'l.    We  distinguish  two  kinds  of  opportunistic  need  identifica* 


J- 


tioHj  dlff^Prin^  in  the  nature  of  the  resource  to  be  e>iploited; 
(1)  funding;  or  {2\  a  resource  thsft  could  .form  the  substantive 
basis  of  a  produc^t  or.  program. 


a.^    Availability  of  Funds 

This  pattern  of  need*  identification  is  particularly  wel^ 
illustrated  by  tHe  inpact"  of  Title  I  funding,  on  need 

'  identification  in  school  districts,  especially  in  large 
ijrb^r^areas  with  si^lficant:  numbers  c£  lovJ-ir.cc^e 
students.  -This  "popi/lat ion  and  itfc  problefos  -are  not  new 
to  school  systems,     However,  the  apprt>priatioji  ,of  rela- 

.  tively  large^  sunis  of  federal  money  for  educatsionalr^rograu^^ 

targetted  at  this  popul'^tion  a  decade  ago  stimulated  an 

un{>recedented  level  or  attention:- to  their  ne'eds.  The 

educational  needs  af  low-Income  students  suddenly  emerged 

as^  a  high  priority*  pjrograiming  concern  of  schoql  districts 

* 

and  R/Di-t  organizations. 

This  basis /of  need*  oercegt;ion  is  also  becoming  increasingly 
prdminerit  ^niong  r^sea yc^ier^j  especially  those  who  have 
be^n  characterized  as  *r^search  ^entrepraneurs  .    As  the 
federal  goyernnienb  and  ather^esearch  sponsors  channel 
funds -to.  Bpeoixic  rfi^earch  are^s^  large  nutnijers  of 
resaarcj^exs  are  ^attract'ed  to^  these  areas  end  pursue 
investigations  that'  these^spj?nso.rs  are  willing  to  support. 
'The  prinaflTV'inip^i^ti^  ■  rorrti{;ie '^hif t  in  research  areas  in 
such  ca3"ais.  i s-* th4' avit'ilabi  li^^^of 'fuods ,     Inhereigt ,  interes 
in\tHe  s^b'jecit: "area  i^y^Vss  o^^^dtri^dnipbrta^^s  buc  is 
s'^^c*^^daf^"^a^*l -a;.  ca^Uff^i- facdp  tbe' shift  in  the 

need  idi?rtt:i fi^^tion  focu^  th^se 
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lal  Pro^raiE  or  VxAc 


bl      Availabliltiy  oi  Potential  Pro^rars  or  pT&4duct  Resources 

A  new  technology  is  developed  for  one  purposes  but  appears 
to  be  adaptable  to  Instructional  settings  as  well  ^-g-* 

^  cor^puter  technolog^  or  tha  availability  oS  low-cost       "  ^ 
^lec^^troiVie  calculators.    The  adaptation  process  seems 

..relatively  simple  and  inexpensive*;  the  potential  benefits 
seem  great.  Adapting  the  neft  technology  is  identified  as 
a  need,,-^   TH^  true  ittpetu^J;©^  this  kin^l  of  need 'Identif  ica- 

-  IS  the  ^iicis::snce  of  the  ndv  t-::chnology  as  e  potep.iial 

progran  resource,  *The  need  identifier  in  this  instance 
is  likely  to  be  an  R/d6cI  organisation  able  t6  make  the 
^adaptation,  and  perhaps  also  an  imaginative  teacher, 
administrator,  or  R-'D^I  sponso^  who  perceives  the 
potential  benefit  of  the  new  product, 

A  talerJted  sculptor  aiS^  perhaps  a  poet -and  a  daVicer  reside 
in  a  given  community  offer  their  services  to' the  local 
school  district  as  the  basis  for  a  high  level  progran 

*^  focused  on  the  arts,.  The  need  for  such  a  program  is  then 
enthusiastically  identified^ by  the  district  staff,  the 

^*  school  board,  parents  and  the  community  as  a  whole.  But 
clearly,  i^f  ti^e  resource 'did  not  exist  and  beconre  available 
to^the  district,   it       unlikely  tha^thls  particular  need 
'would  have  been  identified,  ^ 

'  Pv^-gardless  of  the  source  or  basit  of  a  perception  of  need, 
f  .needs  so  identified  have  to  be  articuleted  into  innovation 
requirements,  and  then  filtered  through  sone  decisionmaking 
apparatus  before  R5cD  resources  will  be  coimnitted.    We  'turn  f 
now  to  these  subsequeni?^ steps  In  the  need  identification 
proce^  *  '  *  " 
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3.      To  \^at  ExtePt  ace  ^eed  Perceptions  Translated  into  Innovation 
Regulren^.gnts? 


r 


The  process  of  translating  perceived  needs  int©'  innovation  require- 
ments  in  the  field  of  education  is  influenced  by  three  factors: 
(A)  <he  nature  of  the  knowledge  base  of  the  field;  (B)  the  patterns 
of  thinking  that  characterize  need  articulation  in  th^  field;  and 
(C)  th«  extent  to  which  specialized  organizational  arrangen^nts 
€xist  to"  carry  out  the ''translation  process. 

A.      Nature  of  the  Rnowladge  Base 


The  field  of  education  has  a  social  science  knowledge  base, 
id  consequently  sonewhat*  limited  intellectual  consensus  and 
good  d^al  o?  value-laden  disagreement  over  goals  and  there- 
to^^ueeds.    This  puts  a  premixim  on  vagueness  in  stating 

^eds,  2nd  th2r«£ore  <^o^lplicate3  the  problem  of  articulating 
needs  in  a  manner  that  translates  easily  into  innovation 
requlrotnents.    The  vaguer  the  statement  of  a  need,  the  easier 
it  is  to  ^chieve  agreement.    The  greater  the  specificity  about 
the  chsr.ges  implied  by  a  need  statement  (e.g.,  change. pro- 
x;edure  £  to  procedure  b)  ^  the  less  agreei^nt  is  likely.  The 
^riuclpal  who  agrees  that,  therj?  is  a  need  for  "incr^eased 
conwinication  between  school  and  comrBunityj"  for  i^stanc^j 
may  change  his  hizii  when  the  need  is  defined  in  terms  or  a 
specific  set  of  behaviors  that  he  must  change. 


in  its  impact  on  articulation  of'needs,  the 
field  of  oducatjjn  has  an  inade<5\iate  and  uncertain  knowledge 
bas^and  an  anbiguous  technology.     It  is  difficult  to  de£ine 

ns  or  to  kiow  what  is  needed  to  ^olve^them.  'Consequently, 
U-  h.v/c  a  difficult  time  identifying  and  articulating  needs. 
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'and  for  this  .reason  also,  Cend  to  generate  statements  that  a^e 
too  vague  to  be~  genuinely  u^ful.    More  often  than  not^  foriual 
needs  assessnent  in  education  has  been  a  dismal  failure."^ 
Typi'cal  of  need  statements  in^education  are  phrases  that  call 
for  programs  "t'o  improve  students*  self-concepts/'  or  "co 
develop  creativity,"  or  "to  raise  reading  achievement  levels/' 

i,These  stateaents;jSuggest  no  particular  program,  o?  even  type 
of  program  or  prOgramning  parameters,  to  focus  on  in  planning 
R6D  activities*     By  way  of  contrast,  ve  would  assume  that  when 

^IV^'s  Tte^^i  identifiers  det^r^ined  that  a  self-cjarrecting-  feature 
was  n^ieded  on  cheir  next'- generation  of  typewriters,  this  jieed 
vas  translated  easily  into  a  ,set  of  engineering  requirements  ta* 
guide  subseqv^nr  research  and  development, 

patterns  of  Thinking  That:  Characterize  Need  Articulation 
»  .       in  *the  gield^  '    ■       '  ^ 

'  We  think  of  n^ed  articulation  as  basically  a  two-step  process, 
beginning  with  definit^^n  or  a  problem  and  then "Continuing  vith 
conceptualization  of  the  kind  of^, product  or  prog^ram^  that  might 
remedy  the  problem.    Several  patterns  of  need  articulation  can  * 
&e  distinguished,  depending  on  the  degree  to  which  the  attributes 
of  the  problem  and  potential  product/program  are  analyzed  and 
elaborated.    The  patterns  can  be^  depicted  by  means  of  a  ^.  2 
table^  with  high  vs ,  Icrf  (or  absent)    problem  definition  as  one 
di-nensioa,  and  high  vs,  low  (or  absent)  program  definition  as 
the  other.'       ^    ,  -  "  ♦ 


PROGRAM 
DEFINITION 


probl^:m  definition 


778 


Cell  t  represents  fche  host  elaboraCe  pattern  of  .need  arti culationj 
the  least  co[nmon  type  in  education.    A  problem  is  analyzed  in 
sufficient  detail  to  pinpoint  specific  elements  in  the  problematic 
situation  or  condition  in  oeed  of  change>  and  perhaps  even  the 
atRouat_Q.f  change  in  a  given  direction.    The  kind  of  program  or 


product  necessary  to  brinr  ibmTl'  yf\n^\   i  limigig  ti  '"^1^^  ^pecified^  

This  fnromation  Is  readily  translated  into  innovation  require-  ^ 

esearch,  development,  and  evaluation  (in  the  case  of 
the  RitD  svstem)  or  for  product  acquisition  (in  the  case  of  the 
usir  syi^ce::^^  . 

We  ffiight  find  this  pattern  of  need  articulation>  for  instance", 
in  an  R^D6<I  organization  with  an  extensive  evaluation  and  research 
program  tied  to  its  development  wor^k*     In  «uch  organizat  ions  > 
developzient  is  viewed  as  "successive  approxihations"  to  a  final 


1 

ideal  product,    Therefore>  successive'  "generations"  of  an 
innovative  prograo  or  product  are  developed,    Evaljjators .  cont inu-  ^ 
ally  analyse  data  on  progran  performance  under  different  tnple-  * 
mentation  conditions/   As  problem  are  uncovered  (e.g*,  gaps 
between  e>:pected  and  obseryed  achievement  levels)  ,  data  analysis 
pinpoilfits  specific  elements  in  the  problematic  condition  that' 
appear  to  be  pivotal  in  causing  the  problem,  and  suggests  research 
ar.d/or  development  activities  to  be  carried  out  to  remedy  the 
probl,em  in  the  ne;^t  generation  version  of  the  product  or  program* 

Cell      represents  an  all- too- typical  pattern  of  need  identified-  ' 
tiop  in  education.'  'Cieeds  afs  defined  almost  entirely  in  tefrns 
of  sn^  tw)  o£  *the  articulation  process>  program  definition 
"we  r^'sd  a 'progr^arft  that  looks  like  this:    .   -   .   ."    Step  one, 
problo:::^  definition,  is  bypassed,  or  given  minimal  attention.  Or 
■fperh^^ps  pr^lem  ciefiniti^  is  given  considerable^attention  but 
is,  £oc9l*?d  on  orj^anirational  rather  than  educational  problems. 
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^X:?,erous  or^anlzationaVp^ij^^s  nay  suggest  needed  program 
or  products:     a  textbook  publish"e¥^^^ftfft4^^fi  exciting  new  product 


to  recapture  his  declining  share  of  the  highTek^il  social 
stLidies  textbook  market;  an  audiovisual  equipment  manura^*4iter 
Tieeds  an  overhead  projector  with    features  that  will  permit  a  wide! 
range  of  applications  la  instructional  settings;  a  school  board 


needs  to  find  an  exciting  new  prograin  to  restore  the  district's 
in-^ovati^e  inage  and  the  board^s  own  popularity  in.  an  election 
ys-ar.    Thovgh  a  financial^  marketing^  or  political  probletn  may 
'"Jc  ^Ive:^  co7.5id^ra>le  act'^nCiorL^  little  chought  is  given  to. 
ed>.:canlonaX  probXens  a^  the  basis  of  product/program  need  defi- 
■  nitioii  in  these  instances^  ^  * 

What  distinguishes  this  pattern  is  that  the  focus  of  thinking  in 
need  arcic^jlation  is  on  inputs  to  the  educations^  process  (what 
resources  will  be  allocated  or  what  progranis  or  products  will- 
io^k  like^  etc.),  rather  than  educational  outputs  (what  Inpact 
resources  or  programs*  will  have  on  students)  ►    Output  orientation 
in  need  articulation  requires  extensive  elaboration  of  the 
problematic  educational  situation  or  condition  to  be  c^nged^  and 
how  the*  proposed  re:?.edy  might  bring  atout  the  needed  change. 
Wiihin  the  past  decade^  there  has  been  a  noticeable  shift  in  ■ 
emphasis  in  education  from  inputs  to  outputs*    The  transilion 
15  far  from  complete^  and  school  systems  are  still  defining  mny  4 
types  of  needs  in  input  terms  ("we  need  team  teaching/'  or  " 
ungraded  classrooins      or     .   .   .  open*  education")  ,  with  little  raor^ 
than  the  most  superficial  elaboration  of  how  these  innovations 
»rtight  Improve  the  quality  of  educa'tion  provided.     But  more  and  * 
more  ^  nudged  along  by  federal  and  state  require »jfents  for  funding* 
prograTTj  needs  are  being  articulated  in  terms  of  output  criteria. 

Cf^il  3  represents  anocher  common  pattern  of  thinking  in  need 
artlcul^ition*  in  education.     A  considerable  amount  of  attention 
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is  recused  on  defining  needs  iri  t^err^s  of  educa'tio^nalv  problems 
and  needed  changes  in  problenfatfic  situations^    But  need  articu- 
,  lation  essentially  ends  at  that  pointV    This  pattern  is  illustrated 
by  need  statements  calling  for  programs  to  "raise  reading  achieve-- 
Taent  Revels"  or  to  ''increase  conmujjication  between  school  admini- 
strators and  cortmunity  residents/'  supported  by  extensive  data-  . 
based  elaboration^^of  the  problem^    But  little  or  no  attention  is 
dev^oted  to  the  kln^  ^of  program  perceived  as  needed  to  reiredy  the 
problem,  '  Tnerefore^  the  brunt  of  the  need  articulation  task  is 
">hl"ced  to^esearch^jrs  and  developers  (or  acquisition  personnel), 
rather  than  the  decisionmalcers  responsible  for  det.ermining  tlie 
needs  to  be  met,    Then,  after  considerate  expenditure  of 
resources  to  design  of  (or  search  for)  a  program  to  "r^ise  reading 
achievement  levels"  or  to  ''increase  communication  between  school 
administrators  and  community  residents,"  there  is  a  good  possi-' 
bility  that  the  sace  decisionmakers  may  reject^  the  program,  won- 
dering who  could  have  e^er  dreamed  that  this  kind  of  program  vas 
needed .  /  - 

When  rrinimal  attention  is  devoted  to  definition  of  e^en  the  problera. 
we  find  the  situation  represented  by  cell  A        Limited  'or  no 
thinking  focused  on  problem'or  needed  product/program.    We  find 
this  pattern  in  educationalVsettings  where  the  most  elaborate  ^ 
staternent  of  need  is  repr96ente<^  by  the  phrase  '*a  program  to  ra-lse 
.readin:^  achievement  levels",    .The  cell  h  pattern  is  also  character- 
istic of  the  vast  number  'of  school  districts  where  needs  are 
rarr^tv  identified  (except  in  response  to  crisis  situations)  -  and 
innovations  are  rarely  introduced,  / 

C,  i^p^cialiged  Organizational  Arran<>enients  for  the  Translation 

■■■  » 

In  thos^  atypical  settings  where  an  ^extonsive  amount  of  ijeed 
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a  c:  LciilaC  loa  occurs  (as  in  cell  I),  there, appear  to  i)e  specialized 
or;;anlzaCional  atrangenients.  to  translate  vague  perceptions  of 
r-eed  into  innovation  requirements-    For  inst^^^e.!  certain  staff 
n^tnb^ars  are  ai^signed  responsibility  for  engaging  in  dialogues^ 
with  sources  of  need  perceptions  Co  help  them  articulate  what 
Ch'i*y  have  in  nind,     ("By  cotrjTiunicaCion,  do  you  nsSn  x  or  y?" 
">rnaC  would  an  ideal  comiriunication  pattfern^  look  like?"    '^Is  this 
what  you  nean?    Or  do*you  have  something  note  like  that  in  mind?") 
Or,  need  identification  and  R/DSd  planning  is  a  specialiiied/  insxi 

L'e  confiiderad  one  example  of  this  i/istitiX ionali^ation  earlier  — 
R'DojI  orgpinisations  that  use  evaluation  data  on  existing  products 
a3  the  basis  of  defining  needs  and  planning  Research  and  develop- 
tnent  for  future  products.    Other  examples  exist  as  well  for 
instance,  SEAs  and  LEAs  th^t  are  developing  and  using  management 
infornation  syste;:is,  or  R^'D&I  Uponsors  such  as  NIE  that  usa  the 
R^P^tnechanism  to  translate  identified  needs  into  innovation 
.requirements  to  be  met  by  prospective  contractors,    \n  botH  these 
instances,  a  substajptial  amount  or  specialized  and  even  expert 
talent  is  asBembled  to  c*ry  aut  vthe  translation  and  articulation 
processA   In  the  case  of  the  management  inf^^Jnation  systems  used 
StAs'  or^As  (In  the  relatively  rare  cases  where  such  systems 
art*  to  be  found),  statisticians  might  conduc^?tem  analyses -pf 

data  to  detenj^ne  wharr  kinds  of  questions  are  giving  students] 
fficulty,  perHhps  even  what  kinds  of  errors  they  are  itiaking, 
his  information  night  be  related  to  process  data  (if  it  were 
available-)  about  classroom  implementation  conditions-     And  all 
this 'Hnformation  might  then  be  turned  over  to  other  specialists 
abl^  to  Suggest  what  kinds  of  programs  or  progran  changes^ould 
S(?^>T)  to  bft  n(>eded  to  r^^medy^  the  problems,    i'Jhere  an  R/P6(I  sponsor 
u^s  the  RFP  mechanlsn^  its  staff  is  likely  to  work  closely  with 
expi^rts  in  a  field  to  tfetail  so  precisely  the  research  ^quf^stions  , 
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to  be  answered,  or  the  kind  of  pijograni  to  be  daveloped,  that  a 


^  ^     major  complaint  ir.ade  against  the  use  of  RFPs  is  that  they_turn 

f  '        '  '  w 

researchers  and  developers  into'^Hierc  technicians  carrying  out  ^ 
specific  tasks  predefined  by  the  sponsor. 

However>  these  examples  of  instifcutionalizatioa  of  ^ed  ident.i- 
fication  and  articulation  of  need  perrceptions  into  ^innovation 
requirements  represent  the  exception  rather  than  the  rule.  More 
typically,  needs  are  articulated  poorly,  and  vague  neefi  state- 
ments '^re  not  tr^^nslntecJ  into  innovation  requirc-nents  in  tine  to 
affect  the  decisioninaking  apparatus  that  coniniits  R'DgaI  resources 
to  Tne^ting^  particular  needs.    We  turn  now  to  thi's  final  phase  of 
the  n^ied  identification  process. 

How  are  Need  Identification  Decisions  Hade? 

IJhatever  the  process  by  which  a  need  comes  to  be  perceived  and  articu- 
lated,  soma  kind  of  decisionmaking  apparatus  must  be_aCtivated  before 
R/D6tl  resourced  will  be  committed  to  meeting  the  need.    The  complexity 
Qf  the  apparatus  ^±11  depend  on  how  many  interests  and/or  levels  in  an 
organizational'  hierarchy  are  represented  in  the  decisionmaking  process, 
J19W  much  considerajiioh  is  given  to  aTternatives,  and  how  sophisticated 
are  the  decisionmaking  tools  (and  perhaps  too  how  extensive  is  the 
empirical  data  baseV^Jsed  in  the  course  of  determining  a  course  of 
action.  « 

'The  simplest  case' would-be  represented  by^a  single  university  researcher 
(or  teacher  or  principal)  who  is  the  source  of  a  need  perception,  who 
needs  no  funding  or  resourc'eq  from  others,  dnd  who  would  himself  carry 
out  the  R/D£tl  activities  recfuired  to  meet  the  identified  need.  The 
idea  is  Intuitively  satisfying.    Perhaps  ^too„  he  tries  to  confirm  the 
need  by  gathering  impressionistic  data  or  eyen  analyzing  some  empirical 
data,'    Feasibility  considerations  might  be  g^ven  some  minimal  thought.^ 


But  less  likely  would  be  extensive  analysts  of  ^tlternativer  conceptions 
of  needs  to  be  met.     If  ^o-ma^or  problems  are  uncovered  by  him  in  th6 
course  oE  this- minimal  screening  process,  the  decisioR  is  ^made  to 
coinmit  a"  portion  of  his  time  to  the  project,  . 

I 

A  somewhat  greater  degree  of  pomprlexity  is  involved  when  the  researcher 
is  pa^t  of  an  R/D&I  organisation,  that  pays  for  his  time>  especially  if 
organizational  resources  (funding,^  staff  itig*  etc)  are  n^eded  to  car;i^y 
out  the  project.    Organizational  decisionmaking  generally  requires 
successive  screening  of  decisions  3^  each  point- in  the  organizational 
hierarchy       the  researcher's  own  work  team,  then  hxs  unit^ir  division, 
then  the  top  echelons  of  the^  organization's  mar^ag^ment  structure,  their 
expert  advisers,  and  the  organization's  board  of  directors.    The  amount 
of  screening  a  proposal  receives  is  likely  to  reflect  the  laws  of 
supply  and  deina-nd.    Where  demand  for  new  ideas  outweighs  supply  in  a 
stable  or  expanding  funding  context,  screening  will  be  minimal.  Where 
tbe  supply  of  identified  needs  is  greater*  than  the  demand  op  the 
existing  resources,  screening^  is  far  more  elaborate,  the  originator 
of  a  new  idea  must  do.  far  ^o re  preparation  and  persuasion^  and  more 
idea^  are  rejected.     In  the  early  hisjrory  o^^the  regional  laboratories,, 
a  stable  source  of  institutional  support:  for  each  laboratory  seemed 
assured,,  and  the  problem. for  each  laboratibry  seemed  to  be  tOygenerate 
ideas  about  needs  to  be  met  and  programs  to  meet  those  need^.  Icieas 
that"  seemed  attractive  wete  adopted  easily,  with  a  minimum  of  screening 
or  choosing  among  alternatives  or  structuring  or  focusing  need  state-^ 
ments,    Th^  literature  attests  to  the  unhappy  consequences  of  this 
situation.  ^  ' 

Declsionm^ikxns  mechanisms  do  not  appeal^  to  t^ve  changed  substantially^ 
They  remain  r^ilatively  encapsulated  -3-  within  the  ^confines  of  single 
organizations,  and  shoving  relatively  little  collaboration  between 
KP  and  KU  institiitions'  or  systejns.    Screening  and  decisionmaking  in 
some  sponspr  organizations  such  as  NIJ^  may  take  an  integrated  view 
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of  KPU,  but  this  is  still  atypical  of  most  KP  and  KU  institutions 
irf  t\fe  field.    There  ^re  exceptions ,  ^  but  it  i's  still  rare  to  find. 
R$cD*and  user  organizations  collaborating  on  the  definitibn  of  needs 
and  priorities  to  be  titet  by  R^D^ficI  activities.    Most  decisions  made 
*y  RitD  organizations  about  the- needs  of  user  'systens  are  luade" 
without  any  involvement  of  user  system  personnel.    And  as  a  rule 
there , appears  to  be  relatively  little  interaction  between  KP  and 
ICl'  personnel  at-any  point  in  the  need  identification  process.    KP  ^ 
personnel  generally  identify  useif  system  needs  on  the  basis  of 

.  int^iition  or  resr>arch  (gerierally  not  observational  data  of  classroon 
or  school  operations),  but  rarely  as  a  result  of  talking  with  school 
personnel  about  their  problems  or  spending  ^ime  inside  school  buildings. 

,JCU  personnel  rarely  devote  their  energies  to  educating  R&f)  organizations 
about  their  needs ,  or  requesting  that  a  particular  kind  of  prograni  or 
product  be  developed  by  the^^^e  external  KP  organizations  to  Ttieet  those 

,  needs .  ^ 

Unlike  sectors* where  market  and  technological  forces  are  the  most 

critical  deteinninants  of  needs  identified  for  R/D&I  .activities,  need 

*  * 

identification  in  educational  R5(D  tends  mor^  often  than  not  to  ignore 

either  user  system  demand  or  the  tec^inological  readiness  of  the  R/d&I  ^ 
^  '  .     y   ■  ,9 

system  to»adequatelyi  meet  identified  needs.    Unlike  more  mature  R/D&I 

"systems  where  need  i<^^if ication  tends  to  follow  orderly,  systematic,^ 

step-by-stcp  procedures       e*g*    needs  ^^assment,  market  research, 

capabilities  assessments  and  long-range  planning       need  identif icatii^pn 

in  education  rarely  shows  evidence  of  disciplined  analysis , .rarely 

sfiOv7s  consideration  of  marketability  (e*g*,  existing  user  demand 

patterns  or  preferences,  or^  likely  prospects  for  promotiional^campaigns 

to  sfttnulate  appropriate  user  demand  *  or  preferences)  -or  feasibility  ** 

(e,g.,  what  is  the  state  of  the  existing  knowledge  and  technology  base 

for^  meeti'ijig  a  specific  need?    what  is  the  sequence  of  research  and 

R^D  activity  needed  to  develop  the.  program  or  product  expected  to  best 

meet  the  identified  neecH^  ^  what*  are  the  existir^  capabilities  of  the  / 
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"organization  for  carrying  out  these  research  and  Rfij)  activities? 
what  activities  will  be  required  to  produce  the  needed  capabilities 
on  an  adequate  level  to  insure  program  success?    what  resources  wil-^. 
be  neede^jjjli^  carry  out  these  activities?    how  much  will  they  cost? 
how  lorfg  will  they  take?)    Educational  R/D6cI  proposals,  budget 
justifications  and  documents  of  tbis  kind  often  present  a  weak  facade 
of  considering  these  issues.    But  it  afppears  to  be  relatively  rare  to 
find  projects "where  these  issues,  are  taken  seriously  and  are  analyzed 
on  the  basis  of  extensive  data-gathering  and  long-range  planning 
technlq-jes  . 

Part  of  -the  problem  in  education,  is  traceable  to  the  fact  that  the 
personnel  uho  carry  out  need  identification  do  not  think  in  these  terms 
Keed  identification  is'  a  casual  activity  for  thim  that  intrudes 
occasionally  on  the  work  they  do.    They  have  vtiot  been  trained  to 
analyze  problems  in  this  way,  or  to  use  the  sophisticated  topis 
that  exist  in  other  sectors  to  carry  out  need  identification.  And 
they  do  not^ave  the^  tlme^  to  approach  what  is  to  them  a  r^athe^  lainor 
concern  in  so  time-consuming  a  manner.     In  short,  P^^t  of  the  problem 
is  the  lack  of .  institutionalization  of  tjje  need  identification 
function. 

AnothSr  aspect  of  the  problem  is  .the  l^ck'of  adequate  data  bases 
agaiijst  vhl^h  to  judge  the  marketability  and  feasibility  of  various- 
alternatives.    There  are  demographic  data  bases  that  provide  sonie 
useful  clues  about  the  size  and  distribution  of  potential  markets  , 
for  certain  kinis  of  targetted  materials        e*^g.,  materials  targette 
at  black  students,  Hispanic-Americans /.Native  Americans,  etc;  bi- 
lingual materials  (English-Spanish^  English-French,  English-Italian, 
English-Chinese,  etc.);  materials  targetted  at  economically  dis^dvan 
taged  urban  students;  materials  targetted  at  rural  communities ^  etc . 
*Ther^  are  data  bases  that  indicate  where  the  most  depressed  achieve- 
ment  levels"  are  to  be  found  and  therefore  wh^e  the  need  Is  great,est 

r 
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support  personnel  its  use-.  The  weaknesses*  of  the  need  identi  f  ica- " 
tion  function  in  education,  thenj  are  felt  throughout  the  KP-KU  cycle* 

There*have  been  some  recent  initiatives  to  remedy  this  situation*  We 
noted  earlier  in  this  chapter  the  appearance  of  increasing  numbers  of 
projects  in  S&As  and  LEAs  to  *de^ign  and  iniplement  m^agement  informa-. 
tion  systems  and  public  accountability  systems.    We  also  noted  , 
suggestions  of  this  approach  in  nati^onal  and  state  assessritent  projects 
and  in'Work  on  the  development  of  social  indicators  applicable  to 
education-    In  all  these  Instances,  it  is  exoected  that  needs  will  be 
identified  by  comparirig  prespecified  performance  goals  with  current 
data  on  the  degree  to  which  a  system  is  achieving  these  goals,  I^IE's 
KPU  monitoring  project  Is  intended  to  provide  a  systematic  data  base 
about  educational  KPU  institutions  and  activities.    The  assumption  is 
that  this  data  base  vill  be  used  routinely  to  identify  imbalances  In 
KPU  functioning  and  therefore  needed  new  policies  and  programs  -  ^ 


Other  recent  NIE  initiatives  have  been  designed  to  ovenxome  tho^  general 
lacl^  of  KP-KU  integration  in  the  need  .identification  process  and  the 
fragmented,  Institution-by-institution  character  of  the  process  in 
this, sector.    fflE's  State  Disseninatlon  Capacity- Building  Program  and 
the  'Local  Problem-Solving  Prografei*  for  instance.,  are  intended  to 
strengthen  state  and  local  capabilities  for  need'identification  and  link 
user  system  personnel  to  KP  resources  that  can^be  used  to  solve  locally 
defined  problems.^     The  Institute's  R&D  Utilization  program  is  designed 
to  provideTassist^nce  to  school  dlst;r{cts  in  locating  atid  using  exter- 
naJLly  developed  R6d>  outputs  ^o  ireejt:  jtheir  locally  defined  needs- 
Sirnilsrly,  T.IE' s  use  of  Invitational  conferences  to  define  research 
agendas  an-^  needed  R/D&I  activities  was  intende'd-   to  bring  the  research 
coiranimi^ties  from  education  and  6he  disciplines  iftto  the  need  identifica- 
tion process  with  maximal  efficiency       getting  simultaneous  input' 
and  feedback  f^g^  ^he  leaders  of  a  given  research  area  (and  at  th^ 
same  time  developing  so:n6  consensus  on  priorities  and  disseminating 
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1  ^ 
these  to  the  f  leld)  .       And ,  of  all  the  neV  Federal  ialtiatives  in 

tflis  area,  the  one  that  is  probably  most"  directly  targetted  at 

strengthening       and^  KU  integration  in  need  ident if  icat  Ion.  procos-a 

is  the  *¥eed forward"  segfttent  of  NIE's         Exchange  Prosrah- 

It  wifl  be  some  time 'before  the  effects  of  the,  various  NXE  arid  other 

federal  initiatives  can  be  a^essed  adequately.    However>  at  the 

present  time  it' appears  th^^^eed  identification  in  education  remains 

for  the  most  part  fragmented  and  severely  limited  in  KP-KU  tntegrar 
tlon. 


Summary; 


"We  have  considered 'tn  some  detail  a  number  of^^spect^*  o:f  need  identi- 
fication in  education  —  who  generally  identifies  needs  ^  what  the 
soured^  of  need  perception  are^  how  (if  at  all)  need  perceptions  get  . 
translated  into  innovation  requijements  during\the  need  identification 
procesSj.and  how' decisions  are  made  to  coTttmit  r/D&X  resources  to 
meeting  specif ic needs .    Although  there  is  clearly  some  variability 
in  need  identification  patterns,  some  general  comments  would  seem  to  , 

^be  ^in  order  about  the  typical  or  modal  process  and  especially  its 
inadequacies.  \ 

^^irst  and  foremost^  the  process  ten'ds^  to  be  episodic^  sporadic^  some- 
what  random  and  Unplanned.  Whatever  periodicity  and  order  does  exist 
in  the  process  seems  to  have  been  imposed  by  the  annual  funding  cycle 
of  federal,  and  to  a  lesSer  degree^  Staca  agjencies.  xt  is  relatively 
unusual  to  find  the  need  Identification  function  institutionalized,  , 
carried  but  by  specialized  personnel  on  an  ongoing  routinized  basls^ 
as  part  of  a  comprehenai^  long-ran^e^  planning  and  monitoring  opera- ^ 
tion  that  significantly  influences  top  management,  decisionmaking. 
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Secondj  need  idencif ic^tron  in- education  is  generally  intuitive  and 
opportunistic.    Data-based  need  identification^is  prpbably  the  least 
common  form.    This  is  not  necessarily  a  weakness,    G^jLven  the  quality 
of^TT.osC  educational,  data,  intuition  ntay  ^e  a  far'inore  reliable  basis 
for  need  identification,  especially  when  the  source  of  the  int^tion 
is  am  individual  or  group  possessed  of  ^reat  knowledge  and  keen  ^n* 
sight.    But  what  uxist  be  underscored  are  the  lim^^ted  possibilities  in 
education  for  checking  intiiittva  or  opportunistic  need  perceptions 
against  empirical  data  that  shed  some  light  on  the  marketability  or 
r^^a.srbility  of  alternative  proposals  for  needs  to  be  met. 

Thirdj  there  is  little  collaboration  between  KP  and  KU  systems  in  the 
definition  or  articulation  of  needs,  or  in  the  making  of  critical 
decision^  about  committing  R/D<£tl  resources  to  specific  projects -to 
meet  specific  needs.     Consequently,  there,  is  minimal  KP-KU  integra- 
tion, and  we  witness  the  unfortunate  spectacle  of  educational  R/D<£tl 
.organizations  generating  products  for  which  there  is  a  limited  (if 
any)' Tijarket  while  user  system  personnel  find  it  necessary  to  divert 
considerable  resources  of  their  own  to/developing  materials  to  meet 
needs  they  perceive  being  met  inadequately  (or  ignored  altogether)  by 
r/d^iI  organizations,  '  '    *  ^ 

Comparison"  with  what  we  might  propose  'as  a  more  effective  model  of  ' 

* 

need  identification  should  underscore  the  key  weaknesses  in  need 
identification  in  education  and  su|gest  possible  points  of  leverage 
for  policy  tnterventiont 

11*      ViODZL  OF  EFFCCTIVE  NEED  IDENTIi- ICATTON 

Based  on  our  observation^  .of  need  identification  in  more  mature  R/D&I 
systems  where  there  is  effective  Kp^-KU.  integration,  we  conceive  of  at 
least  six  requireiTients  for  ^  maxiniilly  effective  R/p<£tI  need  identi- 
fication function,  '  , 
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^'irst,  nsed  id(inti£ication  would  have-to  be  institutionalized  --  ' 
carried  out  in^an  ongoing  roi/tinized  manne^  by  specialized  personnel, 
in  specialized  organizational  i^nits,  using  resources  specifically 
allocated  for  such  activities  as  needs  assessment,  roarket  research  ■ 
(or  in  the  case  o£*a  KU  organization^  availability  of  products  or 
programs  to  meet  given  needs),  capabilities  assessment,  and  long- 
range  planning.  '  ^  ,  '      y      ,  ' 


Second,  what^y^r  need  identification  mechanisms  were  created  would 

+ 

hav^/to  brin^  together  systeruatically  and  i'nt'egrato  effectively  th^ 
different  sources  and  bases  of  need  identification  that  are  opera-  * 
tive  in  a  given  sector       e*g.*,  sources  of  need  Identification 
located  in  the  R&D  and  operating  systems  and  in  the  external  en- 
vironment; intu^ive,  opportunistic,  and  d^ta^^b^sed  sources  of  need 

percepti-on.  *  ' 

t  -  r 

Third,  personnel  responsible  for  the  conduct  of  the  need  identification 
function -wouid  have  t6  be  .linked  to  carefully  constructed  and  well 
developed  data  bases.    And  they  would,  have  to  bie  trained  in  the  use  of 
analytical  procedures  designed  to:     (1)  pinpoint  problems  in  system 
functioning  and  innovation  requirements  to  overcome  these  .problems ; 
.and  (2)  assess  alternative  options  for  meeting  each  of  the  identified 
needs.    For  need  identification  at  the  level  of  tnacrostructure  manage-" 
ment,  \t  would  "seem  especially  impor'tant  for  ttje  data  bases  and'  ana- 
lytical procedures  to  be  targetted  at  detecting  imbalandes  In  'systera 
functioning.^^    Fo"r  need"  identification  in  all  parts  of  the  system 
(macrostructure  management  and  management  of  individual  R6dD  and  opera- 
ti.n^  system?,  institutions  .ot:  networks  of  institutions),  it  would  seem 
essential  for  the^system  to  be  geared  toward  identifying  shortfalls 
between  perfotrjjnance  goals  and  current  levels  of  achievement      It  would  ' 
be  g^rticularj^  helpful  if  the  system  could  also  provide  inf< 


-ormation 

that  related  these  problem  areas  to  proces's  d^ta  that  might  help*  to 
explain  why  th^  system  is  performing  at^ less  than  the  expected  levels 


of  achievement  and  what  specific;  innovation  *requir£Tne^ts;are  called 
for  to  overcome  fhes^  difficulties.  "     ^  , 

If  need  identtric^tion  pers'onnel  are  to- provide  the  kind  of  infor- 
•  xnation  needed  to  contribute  to"  the  need.  ldent,ificatio|j  process  -in 
TCP  institutions,  their  data  bases' and  anaT.yti(:al  procedures  would 
have  to  be  able  to  pro\ride  estimate?  of  the  marketability  and  feasi- 
bility of  alternative  proposals  for  inno\rations  to  meet  identified 
needs        e.g-.  ^  information  about  existing  user  demand,  levels  (or 
estimates  of-^hb'-j  ftiuch  potential  .user* demand  could*  be  stimulat'ed)  ^  - 
for  alternative  products  or  programs  that  might  be  developed,  infor- 
mation about ,  existing-  capabilities  (knowledge  and  technology  bases, 
skilled  personnel,  organizational  readiness)  for  producing  these 
alternative '  outputs  and  eiitimates  6f  whafwould  be,  reqifired  to 
produce  the  needed  capabilities*     Similarly>  if  need  identification 
personnel  are  to  provide  .comparalJle  support  for  the  decision  process' 
in  RU  fnsfitutions^  their  data  bases  and  analytical  procedures  woi^ld 
have  to.be*able  to  provide' information  about  the  rajfige  of  existing 
'products  and  program^  that^ould  be  adopted  or  adapted  to  meet  an 
^identified  need^  the\  relativfe  advantages  and  costs,  of  each,  the  ■ 
existing  capabilities  xn-'^e  user  system  fot  effective  implementation 
of  these  various  innovations  ^  a"nd  estimates  of  what  would  be  required 
■to  produce  the  capabilities  needed  for  effective  implementatil^n,  how 
long  it  would  takrf^  and  how  much  it  would  cost.*  % 

Fourth,  effective  conduct  of  the  need  identification  function  would 
seem  tg  require  specialised  attention  to  articulation  of  perceived 
needs  itt^o  specific  innovation  requirements       ideally, 'requirements 
for  alternative  conceptions  of  the  LnnffvationCsy  to  *be  developed, 
adopted^  or  adapted  to  meet  a  given  tieed.  '  Theje  alternative  proposal 
would  then  be  turned  over  to  experts  ftom  the  functional  areas  to  use 
their  .expertise  and  the  system's  d^ta  base  ta  draw'up  long  range  " 
pj^ns  detailing  the  R'Did  sequepco  (or  in  a.  user  institution  the 
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■     •      '-^  . 

adaptation^ Inpleoentation-revision  sequence)  required,  existying  and 

■needed  capabilities,  time 'frames,  and  costs. 

■  '  '  ■    *  " 

FiStb,  the  decision  apparatus  used  to  make  nee(f  identification  decisions 
in  an  effective  system  would  have  to  integrate  "effectivel^t  KP  and  K\5 

perspectives  (i.e.,  both  technological  capabilities  and  existing  or  ^ 

■* 

potential  uset  demand),  draw  on  all' available  data  bases'and  sources  " 
of  insights  and  systernatically  %^ly  rigorous  decision  criteria,  for 
screening  and  selecting  alternative  propo^alst  for  outputs  to 
bs  developed  through  KP  activities  or  ad^ted/adapted    tfy  user 
■organisations . 

Finally,  in  an  effective  systenv  we  would  expect  need  identification  to 
be  carried  out  as  part  of  a  broader  long-range  planning  and  monitoring 
function.    The  integration  of  need  identification  with  long-range^  planning 
and  tnoaitoring  is  fundamental  to  our  conception  6f  maximally  effective 
need  identification  activities*  * 


Ill .    issi-F.s  V 

Comparison  o£  existing  p'satt^^rnf  of  need  identification  in  education  ■ 
with  this  pGrhAps  idealised  model  suggests  a  number  of  issues  that 
need  to  be  considered  in  developing  strategies  f or  iTni>j^oving  the  nee*d 
identification  fanctioj|^  in  education.  ,      ^  g 

1.     Institutionalization  of  a  ne<^d  identlf icatiog/long-^ranse  planning 
f  unc_tion:  "  ^  "  ; 

What  kinds  of  policy  interventions  are  needed  to  instit-utionalize  ^hd 
need  identification/ long-range  planning  function  on  th^level  of 
macrostructure  management  and  on  the  microstructu^e  le\rel  of  IndJ^vidual 
sponsor,  perf<^rfnerj  and-  user  organizations  or  networks  of  organizations? 

What  kinds  of  resources  areTieeded?  ^         -  , 

/_ 

m  * 

Cctn  specialized  personnel  with  the  requisite  skills  be  attracted  from 
other  sectors?    What  incentives  are  needed  to  attract  them?    ^ow  laijge 
Is  the  persbnhel  pbol  that  might  be"'attracted?   -How  large  a  personnel 
pool  would  be  needed,  for  wjiat  kinds  of  staged  instlttitionalisationj 
progressing  at  what  rate?  ^ 

How  can  we  bfe^t^rain  new  personnel  for  roles  in  the  need  i'dont'^lfi- 
cationAong-range  planning  f  unction  in  different  organizational  ^et- , 
ting5i  (e.g.:    supero rdinate  system  gfgencies  vs.  performers  vs.*users 
vs.  various  kinds  of  nepworks  of  organization?:)?  "^t^^ 


How  rt^adily  can  r^ec^^d  ij^ontificacion  technology  (e.g,  :  needs  assess- 
mtnt  >  cfemnnd  ^nalysis^  product  availability  analysis^*-  capahilitites 
ass.e.ssment  >^  long-range  planning)  be  transferred  from  other  sectors? 
What  kinds  of  adaptations  are  needed?  * 

.      .  ■       '  ^  t 

2.    Coordination  and  integration 'of  exi^tln^  sources  and  base?^ 
ne^d  perception : ^ 
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How  can  ve  Ivest  c5esi;n  a  ^ystem  that  brlnga  together  t-Efectiv^Ly  all 
■available  sources  ^nc!  bases  o/  need  percfi^ft^on  in  a  set^or^    l^at^  * 
ptrocedutres  can  be  desinged  to  routinely  gather  data  and  judgements 
from  koy  sources  inside  the  R/D  fi^.  I  syste/n  and  in  its  ek-tetrnal  en- 
vii::pnment  ^for  Systematic,  periodic  aml/sis  of  emerging  needs  and 

opportunities  for  R/D  &  I- activity?  '         '    ^     '  ^ 

-  * 

3.    r)eoi^n  and  use  of "  inform^^tion  systems: 

~  ^   ^  , 

Uliat.  att^  the  essential  design  jrequirements  for  information  systems 
thatt  can  Ijjp  used  rouciii^l^on  a  periodic  basis  to 'pif^P^^^^^ ♦     (s)  short 
Ealls^  iDetween  gAals  and  ^erformance>  and  (b)  imbalances  in'' system 
functipning? "  ^  ■  ^ 

* 

Vfliat  kinl^  of  data  and  analytical  procedures  ar&  needed  ^to  relate  ^  . 
impatt  shortfalls  to  Innovation  requirementa? 


What  kindi>  of  data  and  analytical  procedures  are  needed  to  assess 
achieveiaent  of  different  kinds  of,  impact  goats  in  the  seotor? 


liThat.  kinds  of  input,  icontect,  and  process  data  an^  analytical 
procedures  are  neede<l-  to  relate  impact-^horfalls.  to  innovation 
requirements? 


What  kinds  of  data/  an^ilytical  procedures,  'and  decision  criteria  ^re 
needed  to  identify  imbalan^es^  in  KPU  .system  ^functioning  and  reqi^jt^-  . 
m^nts  for  necde^Kfto-Xic/ -initiatives?     *  ' 

-      .  -   ^  '  ■  "        /  \ 

What  are  th^  essential  design  requlrementfs  for  an  infor-nation^system 
<to  asi^li^t.KT', organizations  and'R/D  St^I  sponsors  in;     (a)  identifying 
^the'^l^ds  of  t>ew  KP  actiA^ities  needed  most>  and  (by  assessing  tbe  * 
^oten:i£^  marketaJjility  of  a  specific  proposal  for  a  ne^  KP  activity? 
What  4^inds  of  data  anil  analytical  procedures  can  provide  the  most 
yst^ful  estimates  of  market^ibility  for  giWn  innovation  types  or 
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'  ■  ■  /- 

specific  innovation  types  or  specific  innovation  proposes;  avail- 
ability of  existing  produces  to  meed  those  demantls;  likei\prospects 
for  inp,lehien.tation/ut ilization  sftccess  and  long-teVm  prospectK  for 
maintnnynance  in  user  systems  with  varying^  levels^  of  roquirtjd  cap- 
abilitiss;  etc  - ) ' 

V/hat  are  the  essential  design  requirements  for  an  information'  system 

'      '      '        *  ■ 
to  assist  KU  organizations'  fand  organizations  that  provide  funding  and 

technical  assfstance  fot  KU  organizations)  in;     (a)  ^^^ntifying  the 
kinds  of  KP:cmtputs  recjuired  to  meed  their  needs,  and  (b)  determin- 
ing, uhot^ftr  nccui;  1 1  io^  pf^rsonnel  will  be  able  to  locate  satis- 
factory existing  R?D  &  I  outputs  that  will  me^  those  needs,  or  ^ 
whether  instead  thrfy  will  ^>ave  to  either  negotiate  with  external 
R&D  orgaaizat ioT^or  draw  on  internalnKP  resources  to^produce  the 
needed  outputs?    VJhat  {cinds  of  data  and  analytical  'procedures  can 
provide  the  most  useful  information  on  these  questions? 

r  i  1  ^  ■    -  H 

V  ^      ,  r'        1  ^        -  . 

What  are  the  essential  design  requirements  for  information  systems' 
to  assiist"  macrostructure  rranagement>  KP  organizaCionSj  KU  organiza- 
tjlons,  and  KPU  sponsors  in  determining  the  feasibility  of  alter- 
native proposials  far  needed  innovations'  to  be  developed  or  adopte*d/ 
adapted?    %^at'  kinds  of  data  and  analytical  prpcedures'will  provide 
tile  most  useful  estimates  of;    existing  KP-  and/or  KU  orgaijizational 
capabilities?  ^Available  personnel  pools  and  subcontractors ' in 
other  sectors  who  can  be  dra^jn 'on  for  different  kinds  of  efforts'and 
Support  activities?    Sequences  :<?f  activities  needed  to  build  required 
ca^^ahilittes?    Sequences  ^  research  and  R/D  &  I  activities  needed 
to  develop*  disseminate >  a^nd/pr  adcq^jately  implement  and  utilize  a 
i'jil  \Q  ^R/D  £f  I  Output^  given  existing  KP  and/or  KU -capabilities? 
Costs?    Time  -frame's?  ^ 

^^at*  kinds  af  dat^i>  formatting  aggregation>  retrieval  procedures> 
information  hetworkin/j  arrangements  and  coordination  polities  would 
encotirage  maximal  use  of  macriy-level  dat£«ases  t>y  micro  levels 


th^  macro  acid  micro  ^levels?,  "  ^       .  "     .  ' 

I7hat?>^actdr3  must  be  present  in  the  relationship  between  a  need  Iden- 
tification  unit  and  top  management  to  insure  ^integration  of  need' 
ljlenti*£cation' with  long-range  pla^cining,  system  nonitbring,  and  de- 
veloptnent  of  policies  and  strategies*:  \  • 


/ 


^That  are  the  e^secicial' design  Tequriements  for^an  in£orniation  system 
that  integrates  need  identif ic<» tiort  data  bases  with  data  bases  on 
syWtem  operations,  outputs,  and  impact  so  that  a  comprehensive  man- 
a,:^ejT:c?rr:  inf oruvatscon  syste:n.  is  available  to  inform  top  rrianagcment 
decisian-makinj;?  '      *  ^  ^ 


l^hat  factors  must  be  present  atT^ the  relaCio^iships  between  a.  need  ideci- 
tification  unit  and  other  unics  that  carry  ^3t  r/d  &  I  activities 
to  provide  smooth  integration  of  need  identiSicatioTi  with  all  other 


R/D  &  I  functions  and  ef ficlenc/effective  flow  of  information? 


ESTUAL  FACTORS 


In  developing  policy  options  and  management  strategies* for  improving 

*need  identification  processes-  ill  education,  cpnslderation;must  be 

given  not  only  to  these  genertic  types  of  issues*  but  al$o  to  dis-* 

■  ■       '  .  ^ 

tiactive^  contextual  factors  in  the  education  sector  that  affect 
*^      .  '  " 

the  desfrability  and  feasibility  ojf  certain  approaches.    Five  - 

,  .  s 
sets  of  contextual  factors  se'eni  espiecially  important:     (1)  ch^  l^ge 

backlig  of  already  identified  needs  tdat  are  not  being  adequately 

met;  (2)  the  Inadequate  state  of '  develtft>TQenCj  of  the  system's  R/D  &  I 

capabilities;  (3)  tiie  political  context       need  ident  if  icat ion  ' in 

educatioii  (both  internal"  and  external  to  the  R7d  &  I  system)*;  (A)  the 

vagueness  and  diffuseness  of  goals  in  the  edMcation  sector;  and  (5) 

the  wet3knesses  of  the  "fieXdls  knowledge  and  technology  base* 


Probi^s  Po.qed  Bv  Surplus  of  Need  and  Immaturity  of  System  'Culpabilities- 
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,     Two  of  these  contextu;^!  factors'are  closely  xntGrrelatcd. 
^(1)  There  is  ^  large  backlog  of  alre^^^-ldentif iecJ  need  that  are 
not '  tyeing  ade'^JVlately  met  by  the  eduf^ational  R/D  h  T  system  because 
(in  part)   (2)  the^  capa{)ili  ties  .of  that  system  are  i'na'dequate  to 
meeting  thfsoe  needs.'  In  mature  R/D  h  I' systems,  need  identification 
is  followed  by  a  sequence  pf  R/D  &  I  activities  that  lead  to  pro; 
ductiori  and/or  utilization  of  outputs  that  effectively  meet  the 
ic^entytfied  neecls.    An^p-robably  more  often  than  not  >  need  identi--  ^ 
fication  activities/ are  carried  out  in  these  mature  syslrems  -pri- 
marily to  identity^  hitherto  unthough-of,  needs  ' —  e-g,,  InnwAtions 
t\\ziZ  vill'^lve/h  KP  ro        ar^anizition    a  compiJtitive'  edge. 

^     /  '  •  ^  '       ^  - 

In  educatiOFi  however,  the  desire  ^for  a  competitive  edge  is  less 
prevaler>t,  and  identification  of  new,  hitherto  unthobght-of  needs 
^e^y^ss  salient  concern  ^because  there  is  a  la^^ge  backlog  of  i 
alr^dy-identif ied  ^needes  that  have  not  been  adequately/'met.    With-  * 
ou^t  specialization  or  institutionalization  of  *the  need  identification 
^processes,  naed  identifiers  are  already  generating  more  needs  than 
the  system  is  ^apalVie  of  meeting*    Therefore,,  diverting  scarce 
resources'  to  need  identification' as  a  new  area  of  specialization 
makes  sense  only'if  it  functions  as  paift  of  a  larger' planning  and 
decisionmaking  system  for  which' there  is  acritical  need-     The  logical 
interrelationship  between  heed  identification  and  long-range  planning 
becomse  clear  once  attention  is  focused  on  the  kind  of  information 
required  'to  mak^^eed  decisions  in  a  sector  with  immature  capabilities. 

The  key*' need  identif  i^^cation  ^p'tobleirlf  in  education  is  to  develop  ap- 
proaches ,  that  permit  Identified  oeeds  to  be  a^se&sed'*against  criteria 
of  marketability  and  especially  feasibility.-  It  seems  reasonable 
to  argue  that  ^significan  amounts  ^f  available  R/D     I  ^sources  are 
being  wasted  because  they  are  invested  in  projects  that  had  limited 
chances. of  success  from  the  very  outset  —  e.g.^  f^roj^cts  that  ignored 
large  gaps  in  the  knowledge  and  technology  base  ne<Jded  to  produce  the 
output,  prpjects  that  IsS/erlooked  the  inadequate  state  of  development 
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of  R/D  f.  t  resonrcos  and  capabilities  required  by  the  project,  etc*. 
Before  resources  are  committed  to  identified  needs,  it  woyld  seem 
advisable  to^est  alternative/ proposals  against  feasibility  criteria* 
But  before  this  .can  be  done  adequately,  the  field  needs  a  data 
sys.£e:n  and  analytical  procedure's  that  can  provide  e  reasonable  basis 
for  reasibility  estimates.  •  ■  "  * 

Given  the  iramaturity  of  system  capabilities,  any  effort  to-develop 
this  kind  of 'feasibility-orietited  data. system  (and  the  requisiste  ana- 
lytical procedures')  r^u^t  take  a  long-range  capacity-building  view. 
Ir  fTiusc  build  in  consideration  oAbutJi  existing  capabilities  and 
needed  future*  capabilities*  as  well'  as,  how  these  future  capabilities 
are  to  be  de^velop^d .    Once  the  needed  capabilities  information 
has  been  assembled,  the  logic  of  the  information  systenr  suggests 
using  the  informations  not  only  to  estimate  the  relsicive  feasibility 
of  alternative  proposals  but  also,  to  plan  for  sta^d^evelopment 
of  neede'd  future  capabilities-,  to  insure  the  -success  jj^f  whatever 
project  is  selected.    An<f  once  "the  use  of  the  information  s/st/sm  has 
been  carried  this  far,  the  logic  of  the  system  suggests  carrying  it 
one  step  further,  to  monitoring  the  development  of  these  capabil- 
ities andy  system  functioning  to  sucessfully  produce  the  planned-for 
output*    Clearly*  then,  in  a  'sector  such  as  education,  characterized 
by  a  surplus  of  identified "needs,  and  inadequately  developed  capabild- 
ties  to  meet  those  needs,  allocation  of  specialized  resources  to  the  *h 
need  identi f ipation  fucncion  seems  reasonable  only  when  need  Identi- 
*fication  is  viewed  ^s  part  ^of  a  more  comprehensive  long-range  planning 
and  monitoring  ^ncti'on*  s  "  ^ 

-2.    Problems  Posed  by  th^  Political  Context  of  Need  IdentiRAcation  in 

 '  \  ' —  — :  \  ^  '  

Educa tjgn  .        *  * 

■t  .  *  ■ 

This  point  is  reinforced  by  consideratiOn'of  the  political  context  of 
ne^thudentifiration  in  educ^ition7=^"  both  the  external  and  the  internal 
poetical  context-     The  aptiroach-^o ^he  need  idontif tcatlon  function 
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that  pervades  our  analysis  suggests  an  effort  to  "rationalize"'' 
^  decisionmaking,  in  a  sphere  that  ve  have  emphasized  repeatedly 

is  highly  vulnerable  to  political  fonsiderations*    Ue  have  noted 
how  many  af  the  needs  that  the  educational  system  responds  to  are 
defined  by  organizations  and  people  in  the^ system's  external  en- 
■  vironmentj  and  hov  many  of  the  demands  made  ocr  the  schools  are 

derived  primar;Jiy  from  social  and  political  movements  in  that 

/12 
env'ironment  * 

We  also  note  in  other  chapters  how  little  demand  there  is  within 
^  the  education. sector  for  information  about  needed  innovations,  and 
how  much  information  about  needs  and  about  gaps  between  objec- 
tives and  performance  is  either  ignored  or  used  only  to  justify 

13 

decisions  made  on  other    grounds.       Schools  have  what  has  been 
described  as  a  "domesticated  environment .'^^^    Scho61  personnel 
have  not  had  to  concern  themselves  yith  competion  or  market  forces: 
,  their  funds  and  their  "clients^'^  (i*e* ,  students)  have  been  assured* 
There  have  been  few  incentives  to  develop  a  "competitive  edge'  — 
i*e*,"  to  put  ^  particular  school  out  front  with  the  newest  .and 
best  innovation,  as  ai  leader  in  its  field-  -Consequently,  there 
has  been  relatively  limited  interest  .in  information  that  coald  be 
used  to  develop  innovations  that  might  improve  system  performance* 
Lacking  has  been  the  spirit  of  e^ntrepreneurship  that  we  emphasized 

so  strongly  "in  our  analysis  of  historical  development  as  a  com-i 

"  '  15  /  ' 

^  parative  feature  of  R/D.  A  I  systems.  '* 

Given  th>6  situation,  what  is  needed  in  the  education  secdor  is 

+ 

not  a  system  that. simply  Identifies  needs  so  much  as  a  system  that 
provides  decisionmakers  with  information  about-^the  likely  conse- 
qpeqcces  of  different  need  identification  decisions.    An  informa- 
tion  systjem  designed  to  "make  decisions"  — l,e.,  to  tell  decision- 
makers what  decisions  co  make  —  is  i^ely  to  be  ignored  unless 

<    '  .  f      .  ■ 

■k  ■ 

ER?C  7i0,. 
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its  "advice''  is  congruent  with  what  the  decisionmakers'  had  in  mind 
anyway.    However,  an  information  syistera  that- can  provide  reasonably 
reliable  estimates  of  likely  consequences  of  particular  decisions 
is 'likely  to  be  used  to  shape  policies  and  programs       a  way  that 
maximizes  probable  benefits  and  minim^.zes  probable  difficulties*^^ 
Develop.7ient  of  this  latter  kind  of  information  system  would  seem 
to  require  integration  of  need  identification  <ffec isionmaking  with 
data  bases  <^n  marketability>  feasibility^  long-tern  capability 
planning,  and  system  monitoring. 

.  Problems  Posed  by  the  Diffuseness  of  Educational  Goals  ^ 
*  * 

The  surplus  of  identified  needs  in  the  education  sector>  the  iin- 
mature  state  of  the  system's  R/D  L  I  capabilities^  arid  the  €xtern- 
al  and  internal  political  context  of  the  system  all  suggest  the 
desirability  of  integrating  need  identification  processes  in  edu" 
cation  with  a  comprehensive  long  range  planning  and  system  inonitor- 
ing  function.    However^  the  feasibility  of  creating  the  kind  of 
, system  w^  have  described  seems  severely  limited  by  the  vagueness 
and  diffuseness  of  goals  in  the  education  sector.    We  noted  earlier 
in  otar,  .analysis  of  ^oal^setting  in  the  education  sector  haw  rarely  i 
goals  have  been  defined  with  sufficient  specificity  to  permit 

operationalization  into  performance  expectations  and  achievement 

17  ' 
■benchrnarks ,        In  the  absence  of  clear  goals  aijd  performance  Speci- 

ficationsj  it  i?  difficult  to  identify  ne^d«  ia  terms  of  shortfalls 

between  csystem  goals  and  system^  functioning;  it  is  difficulty  too, 

to  kn^v  orecisoly  what' kinds  c>f  data  to  col^ec^  and  vhat  kinJ^  of 

questions  to  ask  in  analyzing  the  data.    And  in  the  absence  of 

precise^  stable  goal^^  long-range  planning  and  system  monitoring 

seem  pointless.     Clearly^  then^  no  jcietaAed  dtisign  work  can  be 

done  on  developing  an  integrated  need  identification/long-range 

planning  and  monitoring  system  until  a  framework  of  system  goal^ 

and  performance  specifications  has  been  elaborated. 
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4.  Proble~s  Posed  bv  the  Weakness  .of  Che  Field's  Knowledge  and 
TechnoloP.v  Base^^  "        .  ' 

In  most  fields,  we  te^d  to  think  of  need  identification  as  occurring 
prior  to,  or  at  the  beginning  of  the  development  process,  e,g*  when 
the  user  and  developer  work  together  to  define  what  sort  of  product 
or  program  is^needed*    Typically,,  need  identlEication  i$  tlien  assumed 
to  have  been  completed.  ,  ^  J 

/  ■ 

This,  ho^jjever,  is  a  very  limited  ctincept  qE  n^ed  IdentlEication,- 
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throughout  the  various  stages  of  developiifent  to  seek  and  receive 
additional  infonriation  and  clarification  fron  the  user;  and  (b)  not 
only  involves  successive  stages  of -  the  development  process,  but  is 


continuous  through  disseminatj^ort,  ffepSB^itientation '$nd  utilisation,  ^  r 
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We  have  been  suggesting  throughout  this  chapter  th^  requirement  for 
a  need  identification  specialization  within  the  planning/management 
function^    What  we  are  pointing,  to  briefly  here  is  ati  additional  ,  * 
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ment  outputs  can  be  readily  absorbed  and  used  ±<i  opera(;ing  systems. 


<c)  Lacking  too  are  the  kinds  of  data  and  Information  systems 
*      we  have  .described  here  as  essential  to  effective  functioning 
of  need  identification  in  «jducation,      -     *    * "    '  * 


(d)  Operating  systen^s  are  ge'nerally  functioning  under  such 

severe  financial  constraints  that  there  seems  to  be  little 

likelihood  that  school  systems  v"{lJ.  (at>^e^st,  in,  the  riear'  / 

future)-, consider  vallocating  ^i^eable  budget  lines  to  nted  - 

identification  personnel  or  siipports  f or  ^the  need  ide^tifica- 

■  * 
tion  func^tion.  *  /  *  \ 

J 


(e).  Systematic  need  identification  is  not  generally  a  high 
^  *         'priority  concern  of  operating  systems ,  "just  a$  }.ong  range 
planning  o-f  curriculum  and  instructional  p-rograms  tends  to 
'be  lacking.    School  system  administratar^  generally  devote 
all  or  virtually  all  of  their  attention  to  mote  pressing  "  , 
immediate  problems,  vhic|j_seems  to  bring  to  the  forefront  more  ' 
needs  thap  the  system  carr  meet  vithout  their  institutionalizing 
a  nev  speciality  to  identify  more  such  needs.    Lacking  is  an 
orientation  Vouard  lon^^^'an^  "planning  or  thinking  of  syst;pmatic 
■  need  identification  as  an  essential  component  of ' system  manage- 
ment and  policymaking,  - 

2.  Keeded  Research 

What  this  -suggests  is  that  *ve  need  to  learn  more  about  what  is  feasible 
within  tK^  current  realities  of  the'operating  system  "^vhat  is  ther<i 
nov  that  can  be  built  on/  what  perceptions  and  "attitudes  are  likely  to 
facilit^iru  or  hinder  t,he  in£>titutionalizatioa  of  a  need  identification 
function,  what  kinds  of  existing  pjersonnel  or  organizational  units  might 
be  called  on  to  assume  these  responsibilities  as  part  of  the  jobs  they 
are  alreacjy  fioing,  etc. 
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arrangerncncs  or  information  bases  if  they  were  made  available  to  »,  . 
theifi,  ^v'hat  would  make  specific  possibilities  for  need,  identification 
arrangement  or  supports  more  attractive  to  them,  etc-    A  "quick  and 
dirty"  analysis  of  this  kind  migh^be^made  even  more  useful  if  those 
who  provided  information  could  be  given  the  time  to  study  and  react 
to  the  draff  report  and  then  attend-^  conference  of  particijiants.  At 
such  a  conference,  they  might  be  asked  to  share  their  redactions  and 
then  collaborate  on  outlining  the  design  requirements  for  need  identifi^ 
cation  mechanisms  and  arrangements  they  ta^^ght  be^   willing  to  install  »■ 
and  try  in  their  school  system,  ^  ^  >  ' 

w  / 

f  '  '  , 

The  above  approaches  might  produce  a  somewhat  representative  picture  ; 
of  the  existing  base  for  a  need  identification  function  in  school 
systems  across  the  country.-  In  addition,    A  second  line  of  inquiry 
that  might, be  highly  useful  would  involve  identifying  ^fid  doscrlbing 
exemplary  need  identif icartion/lbng-range  planning  mechanisms  in  education. 
This  might  be  undertaken  after  completion  of  the  (systematic  or  quick 
and  dirty)  survey  phase,  jor^^fter  a  sufficient  amount  of  survey  dai^a 
had  been  gathered  to  identify  a  range  of  exemplary  arrangements »  Or, 
it  might  be  conducted  simultaneously  with  the  survey  phase,  using 
knowledgeable  informants  and  snowballing  approaches  to  identify  exemplary 
cases.    Such  research  could  provisle'(a)  in-depth  documentation  of  ^ 
individual  exemplary  cases;  and  (h)  gross-case  analyses  of  pattarns, 
data  bases ,  information  systems,  resources,  Capabilities,  organizational ' 
arrangements  and  factors  that,  facilitate^gathering  and  gse  of  the 
requisite  infdrmation  as  the  basis  pf  deed  identif idadjl^  and  long-range 
planning  and  decisionmaking!  " 

/^'\        ...     ,  . 

3>  Pol  icy  Choices  .        .  "  *  . 

Once  this  kind  of  empirical  research  had  begun  to-accumulatc,  a  ba^is 
might  exist  for  further  decisionmaking  on -whether  or  not  to  proceed,  and  if 
so,  what  the  proper'' federal  role  tnight  be  in  the  institutionalization  of 
a  need  identification  function  /or  operating  system  decisionmaking! 
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perforn  other  important  roles.-    F-or  instance*  ne?a;identi^£ipation> 
monitoring  and  long-range  planning  (of  one  or  an^tlijfr"*<fegr^g  of  rigor) 
might'be  a  function  o£  district  administrators  w^^.  prima^jJ^  responsi- 
bilities are  ih  the  area^-Di^^structional  .plannii^^^t  ^r¥^^ 
development*    0?  it  might  be  carried  out  by  district  ^mijof^rators  ^ 
who  spend  most  of  their  time  placing  information  into'  and  analyzing 
Che  irvEormatlon  that  somes  out  of  the  district*s  management  informa- 
tion system^    Or>  It  insight       assigned'to  a  district's  (or  a  &tate 
region's)  curriculum  spepi"alis,ts  who  tend  to  work  more  directly  with  ' 
teachers>^l|uppoFting  implemeBtation  and  utilization,  processes*  *  Or  the 
function  might  be  carried  out  on  a  contractual  basis  with  specialist 
'agencies  who  have  an  ongoing  relation^ip  with  specific  districts  in 
a  manner  resembling  contracts  between  school  districts  and  technical 
assistance  organizations^    Or>  somewhat  elaborate  networks  migh t  4>e 
es tablished 'involving  any  one  or  more  of  the  above  options  linked  to 
a  specific  , person  or  staff  committee  in  each  school*    This  combining 
of  the  need  identification  function  with  others  (especially  those  ^ 
linked  intimately  to  district  decisionm^ing  or  schools-level  implement 
.ta>Eion)  might  even  have  the  added  advantage  of  increasing  the 
likelihood  that  the  needs  so  identified  will  in  fact  have  some  lmt>act 
on  district  decisionmaking  and  planning  and  classroom  practices* 

^he  possibilities  arc  endless*    The  point  ls>  the  nature  of  what  is  to 
be  oesjgned'and  the  n^chanisras  established  to,tnake  what  is  designed 
available  to  local  districts  and  schools  is  likely  to^be  significantly 
affected  by  prior  decisions  made  about' which' of  the§e  vario'us^options  , 
are  most  llkel^  to' be  accepted  and  used/by  the  districtss  ^^Jl^otheti- 
cally-j  ue^can  envision  design  work,  producing  outputs  thatr  could  ,be 
plugsed  into  any  of  tJiese  options.    However>  once  we  mave  from  thinking 
in  terTTiS  of  only  materials  and  training  programs  t^o  also "  thinking  in  ^  terms 
of  information  flo^s  and  delitreryflSystems,^  iikprobably  Ibecomes  more 
important  to  have*  more  pV<^cise  information  abWTt ,  the  form  the  function 

.is  Hkely  to  tak^e  in  .the  school  and  school  ^district . 
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that  whatever  centriilized  resources  ver^\develop§^,  t^ey  would  KaVe 
to  be  readily  available  and  easily  accessible  to  local  units,  px  little 
,  or  no  cost,  and  would  *i^^e^B|"  be  designed  so  that  they  could  6e  used 
easily  ifith  little  or  nS^Outside  assistance  oncB  the  c^abilAties  had 
been  devslo^ied  at  the  local  level'- 

f*resumably,  the^  design,  work  would  be  carried  outX£>  ^  level  of 
"specificity  sufficient  to  permit  school  systemsj to  select  and  experiment 
v/iJth  the,  implementation  of  any  or£e  of  the  models-    It  would  seem  ^ 
essential  to  include  SEA  and  LEA  personnel  thrt^ugh  such  a  design  effort, 
whttthef  ii^^  a.  staff  or  an  advifi.ory  capacity  (or  both). 

5*  Trial  ^iTnplementation  and  Implementation  Research 

Clearly,  given  our  United  knowledge  aft:  this  time  about  need  identifica- 
■  tion  in  education  and  about  impIet*ientation  requirements  for  the 
Institutionalization  of  need  iderttiflcation,  a  cpnsiderable  amount  of  ^ 
trial  and  adaptation  is  likely  to  be  required,  accompanied  by  extensive 
documentation    and  analysis  of  the ^process.    Sugh  research  can  reason- 
ably be  expected  to  provide  information  not  only  about  the  relative 
merits  of  different  models  for  implementation  In  different  types  of 
'  organization  settings  but  also  about  adaptations'  Or  modifications 
needed  in  'the  models,  about  required  implementation  conditions  and    ,    *  ^ 
implementation  supports  to  miike  implementation  of  the  models  effective, 
and,  more  generally,  about  the  practice  setting  as  an  innovation  system. 

6. ^Development  of  Implementation  Supports 

Fintilly,  it  would  seem  essential  to  develop  impletrttentation  supports  to 

assist  school  districts  who  choose  to  use  any  of  these  need  identification 

models »    We  would  include  liiere  the  developmelit  of  both  packaged  naterials 

and  interpersonal  'technical  assistance  services  to  support  the  implemen- 
♦ 

tation  of  th^se  models,  in  different  kinds  of  organizaticunal  settings, 
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starting  from  different  points  of  organlrzation  readiness-  Packjiged 
materials*  for  instance>  might  include  elaborately  docLmented  descrip- 
tions of  the  alternative  models  with  detailed  how-to-dor-it  guides; 
checklists  for  assessing  existing  patterns>  data  bases>  resources> 
capabilltles>  information^  needSj  etc*;  analyses  of  needed  skills  and 
capabilities^per  task>  with 'resource  guides  providing  alternative 
sources  or  approaches  for  developing  each;_ self-evaluation  instruments 
for  assessing  progress  made  toward  n^ore  effective  levels  of  functioning^ 
etc:> 

Presurrablvj-  this  work  uould  reflect'  the  findings  of  the-"  inpleirentation 
research  mentioned  earlier-    Also>  ue^would  assume  such  a  development 
effort  would  benefit  substantially  from  the  involvement  of  personnel 
from  SZAs  and/or  LEAs  which^articipated  in  the  trial  implementation 
and  ot'her  SEAs  and/or  LEAs  considering  future  Implementation. 

We  recognize  that  institutionalization  of  an  optimal  need  identification/ 
long-ran^e  plaiining  fufiction  on  the  micro-level  is  generally  unlikely 
for  *r:^e  time  ^o  come,    However>  it  does  appear  that  macro  leVel 
'resources  to  facilit;ate  the  institutionalization  of  a  need  identification 
function  on  the  tnicro  level  could  he  developed  at  this  time*    For  in- 
stances >  work  might  be  ^egun  on  the  development  of  the  needed  data 
bases>  information  systems>  analytical  capabilities >  etc,  in 
centralized  settings>  designed  in  such  a  way  that  micro  level  insti- 
tutions could  draw  on  these  resources  without  developing  highly 
specialized  need  identification/long-range  planning  mechanism  of  their 
own.    Required  implementation  supports  for  the^e  models  might  focus  on 
how  individual  LEAs>  SEAs.  or  R/D&I  institutions  might  link  up  to  the- 
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through  the  use  of  the  centralized  system^ snd  especially  how  technical 
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VI «  CONCUUSIOMS 

'   '  .  * 

Need  identification  in  educat;iorf  is  currently  a  random  and  chaotic.^ 
activity,  carried  out  haphazardly  if'at'all.    The  bases  of  this  activity 
tend  to  be  intuitive  or  op^ortunj.stic ;  data  based  need  Identlf icaXion  * 
i3  not  the  norm.    The  stimulus  for  need  id^entif ication  tends  generally 
to  be  external  pressures  —  e,gr>  court  decisions  or  demands  of  * 
special  interest  groups,    The, pattern  of  identifying  needs  through 
systcnatic>  ongoing  analysis  of  routinely  collected^ data  bases  seems 
to  be  relatively  rare..  Even  more  rare>  it  seems >  ?r,e  mechanisms  that 
link  need .identification  to  system  monitoring*  and  long-range  planning' 
activities^  or  chat  relate  identified  needs  to  data  bases  that  could 
^p^r^^it  development  o£^  realistic  estimates  of  marketability  and  feasi- 
bility. '  .  >  ' 


As  long  as  thi^pattern  holds>  educational  R/D&I  is  likely  to  remain 
an  inefficient  (and  probably^  too>  ai\  ineffective)  enterprise.  Hovjever> 
until  educational  R/D&I  priorities  are  conceived  in  long-range  terius^ 
and  until  system  decisionmaking  reflects  an  understanding^  of  educational 
R/D&I  in  terms  of  the  system's  requirements  ($*g->  for  capability 
building  aKcI  for  ongoing  monitoring  and  long  range  planning)  >  this 
pattern  is  likely  to  continue^  retarding  further  system  maturation . 
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FOOTl^OTES 


1.      For  a  good  i^tatetnent  critiEing  the  failure  to  include  6racti^ 

tioners  in  need  identification  for  ecfucational  R&D,  see  ^ 
Herbert  J-  Brovnell's  article  in  the  Journal  of  Research  and 
Development  in  Education^  Vol.  1,  No.  ^,  Summer  1968, 
USQE-Funded  Research  and  Development  Centers;  An  Assessment, 
For  good  summaries  of  the'^argument  for  institutionalising 
,  a  practitioner  role  in  need  Identif  icfrton,  for  the  R/DGI 
System^  sec;    Jiational^  Institute  of  Education,  Request  for 
Proposals 'to  Establish  an'^R&p  DisseTninaton  and  Feedforward 
System"  (Washington:  HIE,  1976);  also.  Information  Dissemina- 
tion and  Exchange  for  Educatioixal  Innovatous:    Conceptual  and 
Impleaientation  Issues  of  a  Reaionally-Based  N'atonvide  Systenu 
Michael  Radhor,  Durward  Hofler,  and  Robert  Rich,  ed^.- 
(Evanston:    Center  for    the  Interdisciplinary  Study  of  Science 
and  Technology, ■ Northwestern  University  1977),  ^especially 
the  following  two  chapters:    Su^an  Kl^in,  Richard  McCann, 
and  Mary  Saily,  ''The  R&D  Exchange;    An  Emerging  Ejf fortj'^ahd 
Michael  Radnor,  Robert  Rich,  and  Durward  Hofler,  "The  RDx 
System:    Concepts,  Strategies,  Practices  —  An  OverviewV 

'2,      For  instance  on  state  assessment  projects',  sec:  Educational 

Testing  Service,  in  collaboration  with  the  Education  Commission 
of  the  States,  State  Educational  Assessment  Programs  (Princeton; 
ETS,  1973;  Educational  Testing  Service,  in  collaboraton  with 
Conference  of  Directors  of  State  Testing  Programs,  State' 
Testing  Programs  (Princeton:    ETS,  1973);  Martin  HershkowitE, 
Ed . ,  Statewide  Educational  Needs  Assessment:    Results  *from 
Selected  Model  Stfijies    (Silverspring,  Mdl;      Consortium  of 
State*Eiiucation  Agencies,  1974);,  and  -    Also  on  State  assessment 
P  projects,vsee  the  following  papers  presenting  at  the*  Annual 
SMeetings  o£t  the  American  Educational  Research  Association.  At 
the  February'  1973  meeting  in  Hew  Orleans:    John  Pyecha, 
The  Approach  to  the  Desifih  of  the  North  Carolina  Statewide 
Assessment  of  Educational  Progre^^;  William  J.  Brown,  Jr., 

^The  Promotion,  Pisseinination,  and  UtiliEaton  Plan  for  the 
North  Carolina  Statewide  Assessment  of  Educational  Progress; 
Donald  Woodingtori,  The  Challenge  of  Accountability  for 
Etffcctive  SEA  Administration;  Arthur,  R,  Olson^  Cooperative 
Accountability  Project;  Archie  A*  Buchmiller,  The  Legislative 
Mandates  Contained  in  Various  State  Educational  Accountability 
Statutes:    and  Michael  J*  Grady,  Jr.,  An  Evaluation  of  Account- 

y^bility  Programs  in  Colorado >    At  tHe  April  1974  meeting  in 
'    Chicago,  Sec;    Alexander  I-  Law,  Major  Changes  in  the  Cali- 
fornia Assessment  Program;  Albert  J-  Magoon,  Victor  R.  Martuza, 
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Alberto  P.S*  Montare  and  Bruce  W-  Tuckman,  Phi  Delta  Kapoa 

Nejajs  Assessment::    Educational  goal  Attainiuent  Tests;  and 

^ruce      'Tuckman  and  Alberto  P^S,  Mdntare,  Phi  Delta  Kappa 

Needs  Assessment:    The  Application  of  Educational  Goal 

Attainnient  Tests ♦  On  the  Natonal  Assessment,  see  for  instance> 

the  following  papersr  presented^at  the  February  1973  meeting 

in/New  Orleans;    iarry  E+  Conaway>  Soine  Implications  of  the 

Katonal  Assessment  Model  and  Data  for  Local  Education;  and 

Lewis  .A-  Bonney,  Application  of  the  National  Assessment,  of 

Educational  Progress  Philosophy  in  San  Barnardino  City  Schools^ 

Sec>  too>  the  following  papers  presented  at  the  Annual  Meeting 

of  the  American  Educational  Resefyf^h  Association  in  ,ChicagOj 

April  1974:    w*T*  Rogers .and  DaviJ'J.  Wright>  The  In-Schcol  , 

Sample  Design  for  the  Natonal  Assessment  of  Educational  Progress 

and  Bdb  L*  i:^lor>  Potential  Uses  of  National  Assessment  Model 

at  the  State  and  Local  Levels, 

 ^— ^—   t 

On  school  or  school  district  management  informaton  systems 
see,  for  instance:    Carmelo  V»  Sapone>  CURMIS^  Curr^iculum 
Management  Information  System  (and)  Prospectus  of  a  Design 
to  Assist  a.  High  School  Staff  in  the  Evaluation  of  ±ts 
Proarain;  Paper  presented  at  the  Annual  Meeting  of  the  National- 
Council  for  the  Social  Studies>  November  1972,  ERIC  ED  075  281; 
Council'of  the  Great  Cities  School,  PHIS:    System  Descrij>tion 
PMIS  Project,    Planning  and  Management  Ipfonfetion  System^ 
A  Pro.fccdTto  Develop  a  Data  Processing  System  for  Support  of 
the  Plagfiina  and  Majaagement  Needs  of  Local  School  Districts  > 
April  1?72>  tKlC  ED  063  647;  and  for  the  June  1973  PMIS  Final  ^ 
Report  with  the  same  title  as  the  April  1972  report,  sec 
ERIC  079  864,    Also  sec:    K,M,  •  Hussain>  Development  of  Informa- 
tion Systems  for  Education    (Englewood  Cliffs;    Prentice-Hall > 
1973)*    A  substantial  number  of  papers  on  management  informa- 
tion systems  in  education  have  been  presented  at  the  annual 
meetings  of  the  .American  Educational  Research  Association>  in- 
cluding the  following:    At  the  February  1973  meeting  in  New 
Orleans,    Juris  C,  Lasmanis >  Design  and  Use  of  An  Information 
System  to  Support  School  Planning-Evaluation.    At  the  April  19/4 
meeting  in  Chicago:    Bernard  M*  Barbadora.  A  Description  of  the 
Cincinnati-Public  Schools'  School  Information  System;  and 
Stanley  A+  Rumbaugh  and  Dorothy  R*  VanLooy>  A  Procedure  for 
A  Management  Information  System,    At  the  April  1975  meeting 
in  Ua*?hington>  D,C-:    Barry  A*  Cle^nson,  The  MlS^Problen 
Reconceptualized;  and  John       Hyma^  and    J,  Jackson  Barnette> 
The  Design  of  a  Future  Oriented  Sensing  System  for  the  Identi;- 
ficat.on>  Production^  and  Dissemitiaton  of  Natonal  Education  ' 
Information  Needs,    A^t  the  April  1976  meeting  in  San  Francisco, 
Ying  C-  Chuang,  Management  Information  Systfem  Development  for  * 
a  State  Department  of  Education^ 

I 
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In  additionj\  management;  information  syscems  in  use  in  various     .  . 
school  discricts  have  been  discassed  in  various  AE^A  s^niposia. 
For  instance,  at  the  April  19^4  meeting  in  Chicago^  staff 
members  of  t'he  Philadelphia  Public  Schools  participated  in  a 
syiaposiutn  entitled,    "The  Past*  Present  and  (Hopefully)  Future' 
of  a  Multi-Level  Xnfomratioh  Feedback  System  for  a  Large  ^ 
City's  Schools."    At  the  April  1975  meeting,  in  Washington, 
nodels  for  systems  and  systems  in  use  Ui  school  systems  were 
discussed  by  academics  and' practitioners  in  a  Discijj^sion 
Session  entitled,  "Management  Information  Systems  in  Education; ^ 
also  at  this  meeting  personnel  from  state  departments  of 
education  in  Alabama,  Florida;  North  Carolina^  and  South|  ^ 
Carolina  discussed  the  design  a^  use  .of  state  education  manage- 
ment information  systems  in  a  symposium  entitled  '*Data  Berived 
Through  Automated  Management  Information  Systems  a§  a^ Basis 
for  Decisionmaking/* 

On  Social  indicators ,  sec;    Raymond'A*  Bauer,  ed..  Social ' 
Indicators    (Cambridgei    The  M.I.'K.  Press>  1966);  Eleanor  B, 
Sheldon  and  Wilbert       ¥loore,  eds .  ^  Indicators  of  Social  Change: 
Concepts  and  Measurement    (New  Yorkt    Russell  Sage- Foumdation, 
1968);  Otis  Dudley  Duncan;  Toward  Social  Reporting:  Kext  Steps  . 
(New  York:    Russell  SSge  Foundation,  1969);  Daniel  Bell,  *'The 
Idea  of  a  Social  Report,:    The  Public  Interest,  No,  15,  Spring 
1969;  Mancur  Olson,  Jr.,  "The  Plan  and  Purpose  of  Social 
Report,'^'  The  Public  Interest,  No.  15,"  Spring  1^69;  Peter  J, 
Henriot,  Palitical  iKiplicatiohs  of  Social  Indicators^  paper 
presented  'at  the  Annual  Meeting  of  the  American  Political  Science 
Association,  Chicago  > 'Sept*  1971;  and  Leslie  D.  Wllco^t,  Ralph 
M,  Brooks,  George  M.  Beal-,  and  Gerald  E.  Klonglan,  Social  Indi- 
cators and  Societal  Monlt6ringT    An  International  Annotated 
Bibliography  "  (San  Francisco;    Jossey-Bass/Elsener,  1972) * 

This  chapter  was  drafted  before  we  saw  the  Rand  Corporation's 
reports  of  its  Change  Agent  Study,    However,  when  w,e  did  get 
to  review  this  study,  we  were  delighted  to  note  their  finding, 
that  oppor'tunism  was  a  frequent  basis  project  initiation* 
See:    Peter       -Greenwood,  Dale  Mann>  and  Milbrey  tfallin 
Mclaughlin,  Federal  Programs  Supporting  Educational  Change, 
Volt  III:    The  Process  of  Chanj^e  (Santa  Monica:  -  Rand  Corporation, 
1975);  and  Paul  Berman  and  Milbrey  Wallin  McLaughlin,  Federal 
ProsirSr^s- Sup^orti^.;^  EducatioLial  Change)  Vol.  IV:    The  Findings 
in  Review    (Santa  Monica:    Rand  Corporation^  1975). 

On  the  fail^ure  of  formal  ne^ds  assessments  conducted  in  the 
planning  phase  of  various  regional  laboratories,  see  Kjell 
"Program  Planning  in  the  Regional  Educational  Laboratories," 
included  in  appendix  to  Fi^ncis  S-  Chase,  The  National  Program 
of  E<juCcitlonal  Laboratories    (Washinj^ton :     Office  of  Education, 
1 968). 


Ibid. 
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6,  Tne  Northwest  Regioi^al  -Laboratory  appears  to  be  one  clea^r 

'  exception,  at  least  as  its  program  and  modes  of  functioning 
have  been  described  in  the  literature.    For  instatice>  set: 
Larry  McClure>  Grasnroot^  R&D:    Meshing  Regional  and  NatlQnal  - 
Resources  to  Solve  Educational  Problems.  A  Case  S tudy  and 
Comparative  Analysis  of  Regional  Educational  Laboratory  '      -  ^ 
Approaches-  to  Research  and  Development  (Portland;  Northwest 
Regional  Educational*^boratory ,  1977) .    Also  ssc:  N'orthwest 
Laboratory's  Institutional'  Capability  Statement  attached  to 
-    RFP  responses  such  as  their  response  to  ^NIE  RFP  to  Establish 
an  "R6iD  Dissemination    an^Teedf oryard  System*"  Regional 
Exchange  Component  ^ 

7,  On  the  proposed  ICPU  Monitoring  System*  seci     Natonai  Institute 
of  Education;  Dissemination    and  Resource^  Gro\ip>  RSD  System 
"Support  Dlvison,  Program  for  Monitoring  the  Education  KPU 
S^-stL:n:     Current  and  Planned  Activities,   (l-Jashington:  ^:I£, 
October  1,  1976);  also  see  earlier  program' stat^r^ent,  R&D 
System  Support  Program    (Washington:    N'1E>  April  12,  1974). 

8,  See,  for  instance;    National  Institute  of  EducatiPn>  Request 
for  Proposals  for  Evaluation  of  the  State  Capacity  Building 
Pro^ran  in  Dissemination    (Washington:    NIE,  1976);  ^^ationai 
Institute  of  Education,  Dissemination    and  Resources  Gr«ip, 

,  Dissemination  and  Resources  Group  Program  Plan,  FY  1978  \ 
(Washington:    NIE,  August^ 1976) ;    Katonal  Institute  of 
Ed^:cation,  Fiscal  Year  1^77:    Program  Plans.  Executive 
Summary    (Washington:    NIE,  January  1976);  National  Institute 
of  EducatioTitPreliminary  Program  Plans:    FY  78.  Executive 

■  Summary    (Washington;    HIE,  July  1976);  and  National  Institute 
of  Education,    The  Status  of  Education  Research  and  Development 
in  the  United  States:     1976  Databook    (Washington;    NIE,  1976). 

9,  See,  for  instance:    National  Institute  of  Education*  Building  , 
Capacity  for  Renewal  and  Reform  (Washington:    Is'IE.,^  1973) ; 
Katoinal  Institute  of  Education,  A  Concept  Paper  for  the 
School  Prag.tice  and  Service  Division    (Washington:    NIE,  ^ 
April  1975);    National  Institute  of  Education*  Request  for 

*  Proposals  for  Studies  in  Utilization  of  R&D  in  Education 
(Washington:    NIE,  1975);    National  Institute  of  Education, 
Preli-mlnary  Program  Plans  for  FY '78.     Executive  SunHlary 
(Washington:    NIE*  July  1976)    National  Institute  of  Education* 
Dis^^^Tination  Pind  Resources  Group,  Dissemination  and  Resources 
Group  Program  Plan,  FY  1978    (Washington;'    NIE*  August  1?76)"^- 

10,    For  instance*  see;    Patricia  E,  stivers*  "Researchers  at. HIE: 
.prom  Planning  into  Action,"    Educational  Researcher    Vol.  3> 
No.  5,  May*197A.  ■ 

11*    Thi3  is  the  ]anguas;e  used  in  the  ^^lE  R&D  System  Support  Divi- 
sion's description  of  it^-^^ucation  KPU  Monitoring  Program* 
April  12,  197A.  }       "  ^        ..  ^ 
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Carl  It* .  Rittfitihouse,  InTvovation  Problems  and  Information  Needs  . 
of  EducatiQptal  PractitiQners    (Menlo  Park:    Stanford  Research 
Inst^tucc,  1*70);    Colin  Mick,- Richard  Farr,  Ketii}^*^^  Bowman, 
Suzanne  P<  Hawkins,  ^Robert  Wade,  Douglas  Hall, -Matilda  B* 
Paisley,  William  Paisley,  Developing  a  Sensing  Network  for  * 
Infomiatfion  Needs  in  Education    (Stanford:-.  Institute  for 
Coi?:!iutiicat;ion  Research,  Stanfpxd  University,  1972)",  ERIC  ED  066 
622r  ^         ^  '  '  '  ^  ■  _ 

^.     -         ,  *  •  ■  .  + 

For  instance,  see:    National  .Institute  Qi  Etfucatiion,  Dissemina- 
tion and  ResourcJes  Group,  .Dissemination  and  Resources  GJ'oup 
Pro^ram'P^lan,  FY  1978,    op;,  cit^      ^  . 

SuOh  in-depth  documentation  with  cross-case  arfalysas  might  follow 
the  pattern  used  by  The  OrejKorr  Studies  in  Research  Devfeloptaent, 
Diffusion,  and  Evaluation    (Monmonth,:  Oregon:   .Teaching  Re- 
search Division,  Oregon  State, System  of  Higher  Education,  1972J , 
H.  Del  Schalqck,  Director;  see  especially,  Vol,  A,  Part  1-3,  * 
Case  Profiles,  Har;(y       Ammerman,  Darrell  Clukey,  ^nd  Gregory  P* 
Thomas,  ■ed/f  vbl-  5,  Methodoloflv,,  Loring  M.  .Carl^  Gregory  P* 
Xho^ias,  Clark  A.  Smith,  Kevin  R*  Horse,  and'Darrell  Clukey,  eds, , 
and  Vol*  1,  Summary  Report,  by  H.  Del  Schalock,  Gregory  P.  '■ 
Thomas,  Kevin  R.  Morse,  Clark  A,  Smith, .and  Harry  L-  Ammerman* 
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I.    DEFTXtTIOM  OF  TK£  RESEARCH  FUN'CTtOK.  IN  EDUCATIONAi:.  r/D&I 

 7  ' 

y      ■■  ■  .       '  ' 

The  term  "re&earch"^^as  been  used  rather  broadly  in  the  fields  of. 
education>  to  include^a  wider  range  of  activities  than  what  is 
generally  understoo^d  as  the  res^rcfi  function  in  R/DSl^ystems* 
Thus>  OH  "research*'  funding  in  the  1960s  covered  a  number  of 

different  "research  functions/'  including  what  x^e  generally 

i  .      '  *    '  1 

differentiate  now  into  "deveiopment.>"  '^dissemination,"  etc* 

.  School  system  ."research"  offices  gather  demographic  and  testing 

data  on  tPteir  student  p'opulat ions ,  publish  summary  statistics,  and 

describe  what  they  do  as  "research/'/ Given  this  usage  tradition,  it  , 

becomes  important  for  u^  to  be  clear  at  the  "outset '  as  to  what  we  do  / 

and  do'not  include  in  , our  definition  and  analysis  of  the  resear<;h  * 

function  in  educational  R/d&I*  ■  ' 

1*    Resea^^ch  as  Disciplinedt  Systematic  Inquiry^ 

We  will  be  concerned  in  this  analysis  only  with  research  that  meets 
the  criteria  of  "disciplined  inquiry"  —  the  conduct  of  systematic 
empirical  investigations  or  the  application  of ^disciplined  qualita- 
tive inquiry  approaches  (e*g*j  historical/  p}iilosophical anthropo^ 
logical  ^iid  political  science  modes  of  investigation)  to  education-  ' 
^related  quj^stions.    Tne  Research  may^be  quantitative  or  qualitative. 
It  piay  be  conducted  by  researctiers"  who  identify  themselves 'as 
"educational  researchers^  or.  as  researchers  working  within  a  particu- 
lar  discipline  (sociologi&tSj  .psychologists,  etc).*    As  long  as  the 
research  is  of  a  dis^^plined^  systematic  natureyand  is  Socused  on 
questions  relevant  .to  education^  we  inclu(Ie  it  within  the  research 
function  in  educatiofial  R/DJ&I. 


h 


*This  chapter  presents  in  summary  form"  material  that  is  expanded 
extensively  in  a  subseqyant  draft  of  this*volume,  already  in  prepaTc/a-tion^ 
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however,  we  must  restrict  our  attention  to  the  more  disciplined 
modes  bf  inquiry  about  which  a  sizeable  body  of  knowledge  h£is  ^ 
already  accumulated. 

4*    Types '^of  Disciplii^ed  Intiuiry 

The  literature  iT>eitrd«  several  attempts  to  distinguish  among 
types  of  *  inquiry  modes  )tbat  fall  within  the  research  function,  - 
The  most  v/ldely  used  distinction  is  the- qne  made"^et'^een  **basic'* 
(or  "fundamental''  or  rpure^')  vs.  "appTied"  research.  Dissatisfaction 
with  this  usage  has  prompted,  some  analysts  to  replace  the  basic  vs. 
applied  teminolog^ywith  such  other  distinctions  as:  **conclusion- 

oriented"  vs.  "decision-orierfjred"  rese^arch    or  fundamental  vs* 

*  5  *  ^ 

"probl en-focused"    vs,  "product-focused"  research.    However,  though 

we  recognize  the  limitations  of  the  basic  Vs*.  applied  usage,  for 

simplicity  we  will  use  that  terminology  here* 

We  will  be  concerned  in  this  chapter  with  basic  and  applied  research- 
We  will, be  considering  other  kinds  of  systematic  inq^uiry  in  two  other 
ctiapters  in  this  analysis!  product-oriented  research  ^nd  formative 
evaluation,  discussed  in  our  cjjapter.on  the  ^development  function;  and 
decision-oriented/research  modfes       evaluation  research  (both  form- 
atiue  ;^nd  summatijVe) ,  i^nstitutional  resarach,  and  policy  research  . — 
in  our  chapter  on*  the  evaluation  ftinctlon*    Although  all  of  these 
inquiry  modes  phare  certain  features  in  common,  the^  differ  substan- 
tially In  purposes^  In  personnel  and  institutional  bases,  in  the 
effects  of  various  political  ^nd/or  .organizational  constraints,  and, 
to  a  yignificant  though  lesser  extent,'  in  relevant  knowl^d^e  and 
technology  bases ^    These  distinctions  will  become  clear  w^en  we  con- 
sider these  othet  inquiry  mo^des  in  subsequent  chapters*    tor  the 
remainder  of  this  chapter,  we  will  focus  on  basic  and  applied  research 
only. 


829" 


however,  we  must  restrict  our  attention  to  the  more  disciplined 
modes  bf  inquiry  about  which  a  sizeable  body  of  knowledge  h£is  ^ 
already  accumulated. 

4*    Types '^of  Disciplii^ed  Intiuiry 

The  literature  iT>eitrd«  several  attempts  to  distinguish  among 
types  of  *  inquiry  modes  )tbat  fall  within  the  research  function,  - 
The  most  v/ldely  used  distinction  is  the- qne  made"^et'^een  **basic'* 
(or  "fundamental''  or  rpure^')  vs.  "appTied"  research.  Dissatisfaction 
with  this  usage  has  prompted,  some  analysts  to  replace  the  basic  vs. 
applied  teminolog^ywith  such  other  distinctions  as:  **conclusion- 

oriented"  vs.  "decision-orierfjred"  rese^arch    or  fundamental  vs* 

*  5  *  ^ 

"probl en-focused"    vs,  "product-focused"  research.    However,  though 

we  recognize  the  limitations  of  the  basic  Vs*.  applied  usage,  for 

simplicity  we  will  use  that  terminology  here* 

We  will  be  concerned  in  this  chapter  with  basic  and  applied  research- 
We  will, be  considering  other  kinds  of  systematic  inq^uiry  in  two  other 
ctiapters  in  this  analysis!  product-oriented  research  ^nd  formative 
evaluation,  discussed  in  our  cjjapter.on  the  ^development  function;  and 
decision-oriented/research  modfes       evaluation  research  (both  form- 
atiue  ;^nd  summatijVe) ,  i^nstitutional  resarach,  and  policy  research  . — 
in  our  chapter  on*  the  evaluation  ftinctlon*    Although  all  of  these 
inquiry  modes  phare  certain  features  in  common,  the^  differ  substan- 
tially In  purposes^  In  personnel  and  institutional  bases,  in  the 
effects  of  various  political  ^nd/or  .organizational  constraints,  and, 
to  a  yignificant  though  lesser  extent,'  in  relevant  knowl^d^e  and 
technology  bases ^    These  distinctions  will  become  clear  w^en  we  con- 
sider these  othet  inquiry  mo^des  in  subsequent  chapters*    tor  the 
remainder  of  this  chapter,  we  will  focus  on  basic  and  applied  research 
only. 


^30  I  831 


30  I 


-k  - 

11.    J:SSUE$  A::D  PROBLDIS  in  basic         applied  RBSEAlVpit  IK  EDUCATION 

z  \  

The  educational  reseatch  enterprise"  faces  many  of  the  same"  dilemi?ias 
as  research  in  other  fields >  especially  other  applied  social  scienc^ 
fields.    There  is>  fqr  lnstance>  the  universal  issue  of  quality  control^ 
which  takes  on  particular  importance  in  education>  where  evaluations 
consistently  show  poor  definition^  educational  research  questions;^ 
inadequate  nte^thodological  rigor;  inadequate  grounding  in  theory;  and 
low  ratings  of  the  quality  of  most  educational  research  outputs*  ^ 
There  is  also  the  omntprssent  issue  of  appropriate  methodology  — 
"debated  in  education  in  tenns  of  the  strengths  and  weaknesses  of 
experimental  (or  qua^i^-experimental)  vs.  the  less  controlled  designs 
in  the  field  Tfittings  in  which  most  education^al  research  is  conducted,. 
A  related  issue  concetns  the  inappropriate  application  of  various 
statist  Leal  techniques  in  data  analysis. 

Several*of  these  generic  research  issues  that  .cut  across  all  social 
science  fields  (and  perhaps  other  sectors  as  well)  are  particularly 
pronounced  in  education  because  of  the  nature  of  the  field's  know- 
ledge base>  the  nature  of  the  demands  made  on  the  educational  research 
Poininunity  by  external  environmental  forces,  and  the  deep  strains  in 
relationships  between  researchers  and  practitioners.    Instances  of 
these  generic  issues  that  take  on  particular  salletjce  in  education* 
are*  how  to  produce  interdiscip^linary  cooperation;  how  to  determine 
priorities  between  basic  artd  applied  research;  and  how  to  protect 

subjects  and  operational  settings  from  unwarranted  interference  by 

C 

researchers . 

1 .    Ho:j  to  produce  InterdiscipVihary  Cooperation 

Education  is  a  conjunctive  domain  of  knowledge  —  i.e.,  a  field 
th;it  focuses  the  perspectives  of  several  disciplines  on 
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understanding  and  solving  certain  social  problems.      Since  as  many 

-9 

tweLve  (or  aore)  disciplines  converge\on  inquiry  in  education,  ^ 


interdisciplinary  cooperation  and  cooperation  between  educational 
researchers  and  res'earchers  in  the  other  disciplines  become  all  the '  i 
iTiore.  important  —  but  no  less  easy  to  attain. 

'  1,  ' 

2rf    rfow  to  Determine  Priorities  Between^ Basic  and  Applied  Research 

TJjB  debate  between  ^i^sic  and  applied  researchers  in  education  is 
phrased  in  terms  of  the  weaknesses  of  the  field's  knowledge  base 
(how  Littler  or  hoy  ^uch  we  know  at  tnis  ti^e  to  guide  program  or 
product  development)  vs.  the  ir^nadiacy  of  the  problems  i.n  need  of 
solution,    Tkus  arguments  can  be  made  in  support  of  basic  research 
at  the^expense  of  applied  research  —  for  example;  the  contention 
that  Ri(D  programs  at  this  time  are  premature  and  ill-co^eived 
because  the.oasic  knowledge  base  is  inadequate;  the  argument  that 
applied  work  is  ineffective  in  solving  problems  because  it  framed 
in  teras  of  existing  conceptions  that-are  inade<}vate  and  will  remain 
so  until  basic  research  produces'  fundamental  t^^w  insights,  th^t  affect 
the  tfay  we  think  about  problems  as  well  as  the  knowledge  and  technol*- 
ogy  we  apply  to  theni.    Howeve^*',  other  persuasive  arguments  can  also 
be  made  for  applied  research  at  the  expervse  of  basic  research  —  for 
example:  the  argument  that  we  Already  know  a  great  deal  that  is'use- 
ful  for  sol^^ting  pressing  probleir^s  that  cannot  a^^ait  maturation  of^  the  ^ 
field's  basic  knowledge  base;  or  that  effective  solutions  can  be  ^ 
developed  if  the  available  knowledge  base  is  effectively  transformed 
^nd  structured  in  a  manner  that  facilita-t^  application. 

If  high  levels  of  funding  were  available  for  educatiot^al  research, 
the  issue  of  determining  priorities  between  basic  and  applied-  re- 
search would  be  of  less  consequence.    However,  federal* funding  of 
educational  research  (both  basic  and  applied)  has  generally  amounted 
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to 


to  little  more  than  10"  of  federal  funding  of  all  educational  R/D&I 

activity-';  The  federally  funded  research  total  for  FY  1975,  for' 

^  11 
instance,  was  only  548-5  million,      a  rather  modest  sum  for  all  areas^ 

of  fundasi^ntal  research  relevant  to  education  and  all  forms  oi  applied 

research. 

Strong  criticisms  have  been  made  of  basic  ^research  funding  in 
particular  —  that  it  has  been  relatively  small  in  sc^le  (and  able 
provide  support  for  an  Inadequately  srcall  p'^rcentage  of  the  pro- 
posals submitted);  has  not  been  designed  in  accord  with  any  overall 
basic  Vesearch  strategy;  and  has  lacked  either  continuity  or  high  , 
visibiHty.  ^ 

The  ^ata  gathered  by  the  National  Academy  of  Sciences  Coicmittee  on 

Fundamental  Research  Relevant  to  Educationa  is  useful  to  illustrate 

the  concerns  of  the  basic  research  cotnmutiity.    According  to  their 
12 

report:  _  , 

a)    Research  Support  as  a  Percentage  of  Total  R&D  Budget : 
Federal  agencies  that  sponsor  R&D  r^evant  to  education 
differ  in  the  percentage  of  their^  R&D  budgets  they  allo- 
cate to  research.    In  some,  such  as  the  Department  of 
Defense  or  the  Department  of  Commerce,  as  much  as  one- 
third  of  their  R&D  budgets  go  to  research.    Their  esti- 
mates for  OE  and  KIE>  however,  arc  that  less  than  10%  of 
the'  funds  go       research  while  tnorc  than  50%  goes  to 
demonstrations  and  around'25X  to  dissemination.  ^ 


b)    Basic  Research  Support  as  -a  Percentage  of  Total  Research 
Support :    When  the  dat^i  arc  con^^ide^d  for  all  federal 
,  agencies  that  sponsor  R&D  relevant  to  education^  approxi- 
mato-ly  one-thii?d  of  total  research  support  goes  to  basic 
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research.    The  percentage  is  even  smaller  (22-297.)  when 
attention  Is  restricted  to"  the  agencies  directly  concerned 
with  research  in  education,  and  smallest  sitH  (15-20%) 
when  one  exaz^ines  the  data  for  0£  and  ^HIEh.- alone  *     ,  / 


1 


Basic  Research  Support  as  a  Percentage  oB  T»tal  Education 
^R&D  Budget :    The  data  for  all  federal  agencies  engaged  in 
social  research  show, that  11-12%    of  total  R&D  funding  is 
allocated  to  basic  research.   , However,  when  the  data  are 
examined  for  onlythOse  ^tg^ncies  conc^rnerd  with  education> 
only  3-^%  of  ^R<ti)  funding  is  aliocactsd  to  basic  research. 
Vben  attention  is  restricted  to  OE  and  KIE  alone,-  that 
figure  is  further  reduced  to  2%. 


Fandarnental  Research  Support  Under  KIE  Compared  to 
Fundamental  Research  Support  Prior  to  1972:  Worst  of  all, 
froin  the  perspective  of  the  research  community,  research 
was  receiving  less  support  from  KIE,  both  in  absolute  and  ' 
relative  terms,  than  It  was  receiving  prior  to  the  estab-- 
ll«hment  of  JJlE  which  was*  explicitly  mandated  to  strengthen 
thei  scientific  and  technological  foundacions  of  education. 
In  1968,  research  was  receiving  approximately  bne-third  of 
total  federal  R&D  funding,  basic  research  represented 
approximately.  13%  of  the  research  budget  across  federal 
agencies,  and  OE  allocated  approximately  7%  of  Its  R^D 
budget  tt>.  basic  research.    In  1975,  research  was  still 
receiving  more  than  one-third  of^-^^^D^  funding  across  federal 
agencies*  but  in  OE  and  KIE  together,  re«iearch  was  receiving 
around  10%  ' ot  R^D  funds  and.  ba^ic  research  was  receiving  2% 
or  less^    Kot  only  the  percentages  but  even  the  dollar 
amounts  available  for  basic  research  in  education  declined 
between  1968  and  1975.  ■ 
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In  short,  the  argument  cade  "by  the  KAS  coniraittee  was  chat  federal 
support  for  educational  RciD  activities  hos^  increased  in  recent  years 
but  fundamental  "research  has  not  only  not  shared  in  this  growth  but 
has  even  suffered  a  decline  in  available  dbllars. 


dollars 


There  were  many  high  hopes  for  KIE  in  connection  *with  basic 
research  in  the  months  prior  to  its  creation  —  but  NIE  has  not 
become  the  think  tanjc  of  e^iinent  scholars  that  NIE  proponents  en- 
visioned and  argued  for.    Instead/  funding  problems  forced  cutbacks 
in  the  snail  basic  studies  unit  within  NIE;  allocations  for  basic 

research  grants  r^^cained  small  (and  were  eliminated  altogether  for 
13 

a  while);      and  earlier  initiatives  to  strengthen  basic  research 

* 

(e.g.f  the  four-year  funding  of  COBRE,  the  Coituiittee  on  Basic  Research 
in  Educan:icm)  have  not  been  continued.  * 


The  COBRE  project  was  of  particular  Importance*    It  had  an  eminent 
organizatonal  setting  (the  >lational  Academy  of  Education  and  the 
National  Acadeiny  of  Sciences  -  National  Research  Council)*  Eminent 
scholars  served  on  the  Coitimittee.     Its  task  was  '*co  ideatify  problems 
to  be  attached  by  basic  research  in  education  and  to  develop  and  try 
out  plans  and  proce^iures  for  stimulating  ^nd  supporting  such  research. 
It  had  noderate  success  in  stttt;acting  both  established  and  younger 
scholars  from  the  social  sciences  to  basic  research  in  education. 
Stillj  it  was  discontinued.^^ 

Clearly,  basic  research  in  education  ijeeds  to  be  strengthened.  But, 
as  we  shall  see  shortly^  applied  research  may  require  even  more 
stren'^.th^nin^  and  ca^acitv  b-illrfing.    Until  we  learn  considerably 
more  than  we  knov  now  abou^  the  requirements  for  a  health  basic 
research  capacity  and  a  healthy  applied  research  capacity  in  education 
we  will  lack  a  sound  ration^ile  for  detettnining  the  appropriate  balance 
between  ^asic  and  applied  research  funding  in  educational  R/D&I. 


836  .t  .    '  ^ 

\  ••       •  ..  .         '  '  •.      ■     ■  , 

Ethical  issues  surrounding  relationships  between  researcher^  and  human 
subjects  take  on  added  meaning  in  education  where  the  human  subjects 
are  often  children  and  where  i^lationships  between  resea^hers  and 
practitioners  are'often  strained.    In  educational  research  settings^ 
the  need  to  protect  subjects  from  harmful  effects  o£  experimental 
treatments  or  from  invasion  of  their  privacy  is  a  very  important  issue> 
and  a  considtirable  amount  of  concern  and  policy  thinking  has  already 
been  directed  at  this  issue. These  direct  ethical  Issues  raise 
farther  issues  about  the  amount  of  control  a  researcher  can  have 
over  the  conduct  of  his  own  inqui-ry       e.g.,  the  role  of  the  practi- 
tioner in  defining  the  problem  to  be  investigated;  the  amount  of 
manipulation  of  "treatments'*  ' to  be  permitted'in  an  operational  ^eld 
setting;  the  needs  of  re^earchers4ro  a  stable, program  stimulus  vs. 
the  needs  of  program -personnel  to  keep  changing  their  pr.ogran  iij  terms 
of  changing  rfeeds  and  understandings  of  what  they  are  doing. 


SI 
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III,   'THE  CHANGING  CHAfL\CTER*6F  THE  EDUCATIONAL  RESEARCH  COMMUNITY 

In  *addit ioti^  to  these  various  generic  research  issues>  there  are  a 
host  of  new  is'sueB  that  hav6  emerged  over 'the  last  decade  and  a  half 
"in  the  education  Sector  as  the  character  of  the*^* educational  researctr 
enterprise  has  been  transformed  by  research  funding  policies  of 
federal. agencies. 

1 .    The  "Small-Scale  Research  Mode  in  Academic  Settings 


Until  the  mid-'60s  educational  research  was  an  acti\^ity  carried  out 
by  a  relatively  small  number  of  individual  researchers  who  were  based 
in  the  universities;  operated  with  a  great  deal  or  autonomy  in 
defining  problems  and  conducting  investigations;  devoted  a  small 
proportion  of  their  tim&  to  research;  were  oriented  primarily  to 
publishing  research  findings  that  might  add  to  our  understanding  and 
knowledge  about  educational  phenomena;  and  were  regulated  primarily 
by  a  peer  group  review  system  that  allocated  rexi;ards  primarily  iri  the 
form  of  prestige  and  recognition  within  the  scientific  community,''"^ 

2  -    Hew  Institutional  Arrangements 

Developments  of  the  past  decade  and  a  half  have  transformed  educa- 
tional research.    The  educational  research  community  has  grown 

17 

rapidly  in  numbers  and  in  diversified  institutional  bases.  Although 

almost  all  basic  research  is  still  carried  out  in  the  universities 

and  sor:ie  applied  work  is  done  there  as  well,  non-profit  and  for-profit 

rese^ircli  corporations  have  emerged'  as  a  strong  competitive  force"  in 

18 

securing  applied  research  contracts  from -governmental  agencies/ 
Consequentl/j  more  and.nor^  of  this  research  is  being  done  outside 
-the  univers ities J  with  serious  consequences  for  research  training; 
for  information  flow  and  the  cumulative  developm^ertt  of  the  field's 
knowledge  and  tcclinoj^gy  base;  and  for  the  manner  in  which  (and  the 
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extent  t;o  which)  research  findings  get  to  be  disseminated  and  util- 
ized.   I'he  new  institutional  arrangements  for  the  conduct  o£  raseatch 
have  turned  research  into  a  £all-tlne  pursuit  £or  a  Idrge  portion  of 
the  research  community.    Of  even  greater ^consequence ,  these  new 
arrangements  have  had  a  significant  impact'  on  the  nature  of  educa- 
tional research  and  the  educational  research  community.    These  new 
arrangements  have  produced  new  patterns  of  research  functioning  (e.g., 
research  teams  rather  than  individual  researchers).    There  are  new 
modes  of  research  management  and  new  constraints  on  researchers  — 
i     .  J  b^jroauc ratic,  mls?;lon"Or ientf>d  research  [nanagement  that  limits 

the  'individual  researcher's  autonomy  in  both  defining  research 

'19 

problems  and  conducting  inquiries.^      There  are  new  research  sub- 

cultures  with  wholly  new  systems  of  rewards  and  controls  that  weaken 

the  impact  of  the  disciplines  on  the  ronduct  of  inquiry  —  e-g'> 

political  and  bureaucratic  norms  are  competing  with  an  (for  many) 

replacing  professional  norms;  political  influence  and  economic  incen-" 

tives  are  replacing  scientific  recognition  as  rewards;  and  agency 

acceptance  and  utilization  of  research  findings  are  replacing  peer 

20 

review  of  scientific  quality  as  -the  dominant  controls, 
3.    New  Kinds  of  Accountability  Issues 

The  new  prominence  of  educational  research,  and  the  amount  of  public 

funds  flowing  to  it^  have  posed  new  kinds  of  accountability  issues 

that  may  be  harder  for  research<;rs  in  the  education  sector  to  resolve 

than  researchers  in  other  sectors  which  have  stronger  knowledge  and 
*  21 

technology  bases.       The  Congress  has  been  demanding  public  account- 
ability for  an  immediate  payoff  for  its  investment  in  <;ducatioaal 
research  —  without  any  re^ilistic^  appreciation  of  the  extended  time 

frame  needed  to' produce  results  in  research  in  general  and'  in  educa^ 

22  r  ^ 

tional  research  in  particular.        Thus,  we  find  a  '  Catch-22"  type  of 

i  i 

situation.  On  the  one  hand>  to  obtain  funding!  r<;searchers  must  pro- 
vide Some  promise  of  a  payoff  —  regardless  a£  the  fact  that  research 
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-by  definition  involves  3  not  in^igin^ircent— degii^^ 

On  the  other  hand,  to  nake  promises  vhich^  cannot  be  EulEllled  may 

result  in  tlie  researcher  being  funded  —  but  even  more  importantly, 

such  unfulfilled  promises  lead  inevitably  to  public  disillusionment 
*■ 

apd  a  worsening  of  the  political  environment  of  the^research  enter-^ 
23 

prise*       The  proper  stance  for  educational  researchers  to  take  in 
relation  to  government  agencies  and  the  kinds  of  research  outputs 
they  should  provide  (i,e,,  should  they  attempt  to  provide  solutions, 
approaches  to  defining -problems  and  thinking  about  solutions,  or 
information  about  the  likely  or  obtained  effects  of  alternative, 
Boh.iZi->n^  under  consideration  by  policymakers?    )  have  t*herofore 

become  matters  of  serious  debate  among  educational  researcher^  and 

^  25 
social  scientists  in  general. 


4, 


Despite  frequent'  calls  in  recent  years  for  a  strengthening  of  the 

educational  research  community  ana  more  f  ie'Id-based  initiatives  to 

.    ^  "26 
structure  the  n&tio^al  r^esearcK  agenda  for  education,      the  educa- 

tianSl  "research  contiunity  ren^ains  diffuse,  politically  weak\  and 

largel^^reactive  to  federal,  initiatives"  designed  by  governinent 

bureaucrats  #10  are  geneTrally  not.niembers  of  the  research  community, 

^  TKe  AERA  has  i:ecentl;^organ^ed  a  Governmental  'and  ,?rofessional 

^    Liaison  Croup  to  lobby  in  Congress  and  amo^i'g  federal  agencies-^  in  the 

"  -  *  ^  '  '  27 

^^te^ec,t^  oz  .th^  educational  cestarch  co^unity.    ^  However,  iz  is 

st^ill  too  early  to  assess  whether  or  not  trhese  effort^' have^signi'-s  ^ 

Jican't;ly  improved  the  political  position  of  the  r^esearch  comiriunity^ 

or  creat'cd  conditions  conducive  to  more  active  researt^h  community"  ^ 

leadership  on  research  ,i4lBijes ,  '>'^      ^  ." 


The  strengthening  of  the  educational  researc^community  in  the  future 
may  d^^j^nd  .on  •collaboration  among  the  leadefrsbip  of  the  , research 
."^community  and  the  key  federal  agencies  aad  other  major' sgorisors  of  _ 
educational  re^arch*  with  initiative  perhaps  remaining  sdll  ^th 
*    the  federal  agencies.     Our  analysis  of\frrht  is  needed*  iSi^ased  on 
consideration  of  the  '^omewhat  diatjinct/ive  requirement§j^£jbasic  and 
applied  research  and  the-current  stap4  of  ,developnifent  "ijr'^rtte  iristitu- 
tional  and  , personnel  bases  tQX  cotrauct  of  the  b^^ic' and  applied  re- 
search functions  in  education^^^ft^  ^     *  t 

1.     Basic  Research 
\  * 

.  A.    Ass-^ssmenf"  Eafeis 

- '  ' 

tn  ^^ssesslng  the  requireireais  for  .strengthening  b^jsic  research 
in  thc^  Education  sector,  it  is  importaijt  to  recall-  the  inter- 
,di?jn'pHnary  nnturc  of  educational 'research.    On  tfi^  one  hand, 


■         *  8^2 

mvsih  of  tltis  basic  research  i:s  being  performed  ultbin  thb  various 
disc'iplijnes  that  are  reAevSjjit  to  education.    Hox^t^ver>  education 
Is  a ' subssidiary  coac^srn  of  these  other  disciplines,    On^i.e  other 
handj  the'r^  is  basic  reseac^oh  that  is  done  within  th^  field  o£r-  ^" 
education^  by  researchers  who  h^^g^cpnimiijted  themselves  primarily 
to  the  derivative  disciplines  (educational  psychology >  educi- 
tional  sociologVj  etc.^)^  The^e  researchers  are  trained^  in  and' 
committed  primarily  to  education  as  a  field  of  study,  iN^ereas 
reseax'chers  who  identify  themselves  with  the  parent  di^sciplines 
nay  wt^li  move  in  f^nd  uut  ot  tlm  field  oi  education  —  st\idyiii;; 
educatioQ-relevaat  questions ^for^a  time>   then  moving  to  other 
questions  of  concern  to  their. work  that  do  not  impingt^  on  educa- 
tion,' then  moving  back  a  few  years  later  into  more  education- 
felt^vant  work>  etc.  ■ —  researchers  who  identify  themselves 
primarily  with  the  field  of  education  provide  the  field  of  ed'uca* 
tion  with  a  more  stable'  central,  core.     It,  is  this  latter  focus 
which  is  our  pjriniary  concern  here  because  of  the  importance  of    '  * 
having  a-basi^  research  function  whose  p.rimary  and  ongoing  focus 
'and  cotntnl tmenfr  is  on  the  field  of  education  per  se  —  while  at 
the  same  time  recognizing-,  and  ijgrilixing  important  and  relevant 
basic  research  in  o'ther  fia'^,ds. 

Basic  research  is  sm  \incertain>  unpredictable  and  highly  creative 
undertaking  that^is  very  sensitive  to- threats -to  its  climate  and 
to  the  quality*  and  stability  of  support  and  funding,  and  is 
highly  depende^it  on  its  roots  in  ^ti>e  ,f  undaiRental  disciplines.' 

It,s  output^  are  knowledge>  and  il^is  only  gener^jlly  in  the  long— 

'  '    '  ^  '  23 

term  ^tji^it  assess  Its  ^rac^iQal.  contribution .        And>  given 

'  i^s  inherent  uncertainties  it  l^ecomes  hazardous  to' attempt  to 

predict  the. areas  in  which  suoh  outcomes  will  occur.     BuL  without 

it  tlie  jwoH  of  new  thinking  .f requently  runs  dry.     I^t  is  there- 

V 

f-oro  vital  thtit  a  healthy  ^ind  m^jture  R/D&T  syston  ulil  have 

V  w 

dev€;lopPd  and  maintained  a  substantial>  hi*^h  guality  basic  research 
component*  *  .  ,  ^ 


Such  a  compooenc  cannot  be  builc  quickly,  'The^r^^  at 'which  ; 
quality  basic  rese^irch  can  be  expanded  is  limited  by  the,  sixe 
and  qtialicy  of  its  existing  centers  of  exct*llenc^/CwhicH  may 
range  from  a ^ingle^-outscanding  researcher  to  a  team  of  .siii^h- 
researchers).    To  pump  more  funding  into  this  endeavor  feKiin 
such  centers  can  usefully  absorb -pan  only  lead  to  wa^^^'^cin,^ 
disappointment,    future  growth  i^  (and  will  be)  limit£;^,,'by"^ast; 
irivestments  *?^i^creating  and  suppojrting  a  central  c;ore;Of  b^sic 
research  having  many,cent&rs  of  excellence,    The'major  problem  \ 
of  basic  research  within^ducacion  as  a  field  of  s.tudy '  per"se 
has  b'-'^:s       we  aoutjd  in  fh-^  v^r)^  we^ikfi^ks  o: .  thig  j^intV^l  cure , 

Assessment  of  the'basic  research  f unctiona^will  need  tlieri  to  be 
based  on:         ^  '  ^  '  .  ^  - 


a)    The  size,  and  quality  (based  on  th6  reputation  of 
institutions  and  personnel)  of  th^^Ajcentral  core  of 
tj^e  basic  research  function  —  mosfc  specif ically,"  on 

♦    the  size,  groWth  and  stability  patt^rj:!^  of  identified 
centers  of  excellence*    An  important  ii^*dicator  will  be 
the  ability  to  attract  and  hold  top  flight  researchers 

/-  b).    The  number  of'  new  centers  of  ^^cellence  seeded  and 

taking  root  over  successive  (rolling)  3-5  'yeo^r  periods, 

^  c)    A  measure  of  the  suppor tivenes$  <Ti  cne  climate  -  ip 

terms  of  funding;  growth  and  stability*  over  several 
r 

,  *     .   year  period?,  -  ^ 


Measures:  of  the  quality  of  the  linkage  to  arid  repu- 
tation of  basic  r^earch  in  .eduction  and  its  -more 
f.undamental  parent  disciplines. 


Over  .iij^ 
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R|sti>-*Tes»aj:ch  in*;j^4yca^ibR  iS'te;*lfe  found       tii/p  types  of 

/  .  ■       *    '         /         ■  <  ■       .  ^-^ ■ 

secting^s.    Gerie'rallV*  ti^e-'bai^lc  resB'arch  \a^t:rl;&d  "out  .ia  schbols 

■  '    ■  >     '   '  .  '  '    "     '  ,/  - '  "jf  '     '  * 

of  cducaciort  (in  derivatdve  cJispipJ4irtei^,,^ch  as  ^Acational 

psychology  and  so'ciology)  boast^,        Ctintcrs^  (if  excye-Henc.e  and 

much  modlocrityi  _^  A  dif"£ereat,j>ictiire  emerg^^a  when  biie  examines 

the  research 'carried  on  in  discipline-based  university  ^epart-  * 

mencs  such  as  psychology  and  sociolt>g.y-    Excellent^  and.jva^luaMe  _  , 

concribucions  to  {criowl€?<^e  are  to^.iie  /^bund,- but  what  has  been  ^ 

.  lai^king  here  has  been  a  primary  and  continuous  conmitment  to 

education,    Tlie  interdisciplinary.  c}i^racter  of,'  educational , 

researcK  has  added  cq  the  diffusenes**'of  the  research  enterprise 

by  lua^'ittg  communications' and  information  retrieval  (from  the" 

tLarg'e- variety  of  "publication  sources)  very  difficult,  Altogether, 

this  has,  added  up  t;o  a  basic  research  community  in  education  that 

has  feeeii  to  date  unstable  artd.  amorphous-    It  makes /s^ste^o  building  "  ) 

in  this '^tea  a  major  requirement  and  a  critical  consideration 

in  funding  programs.  '  ^  . 


At"  the  sa^ie  time>  the  genera-1  climate*  for  basic  research  in 
education  as  for  other  (especanlly  social)  areas  of  basic 
reseaji'cb  fias  been  far  from  supportive/    This  negative  climate 
has  btren' particularly  ^  iiicense  for  education  whi^h  has  been  iiard 
put  to  point,  to  mor&  than  a  relat*lvt*ly  5?malL;,fttifl{bet  of  signifi- 
cant developments  that  are  traceable  to  b^sic  research-^^    The  ■ 

low  pro^ti^^e  with  the  general  public  and  with  Congress  and  the 

♦ 

as^ocl/'vted  unreliable  fiinding  have, made  it  hard  to  attract 
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strong  t^lGfint  and  this  has  acted  as' a  major  constraint  on 
building  the  CGneral  core^ 


C/   Key  .Needs  '  ■        .  - 

"In  light'of  the  Aove*  summary  analysis  of  the  distinctive 
rcquireEnents  of  basic"  research  and  the  current  state  of 
development  of  this  function  in  education,  the  key  need  would 
see:n  to  be  for  a  consistent,  continuous,  st^ible  process  of 
svste^  building.    This  would  include: 

a)     id.entifying  e'^isting  centers  of  excellence;^ 
1^)    facilitating  the  establishment  of  additibnal  * 
centers  of  excellence; 

c)  facilitating  the  growth  of  these  cente'rs>  existing 
and  new; 

d)  facili-tatl^ig  improved  information  exchange  and 
retrieval  mechanisms; 

e)  providing  stable,  loftg  term  funding* 

Applied  Research 
A,    Assessment  ©asi's 


Applied  research  is  research  and  therefore  shares  with  basic 
research  a  high  level  of  uncertainty  and  unpredictability.  t 

H  4 

Thus >' researchers  in  particular  treat  applied  research  in  a 
basic  research  mode.     But  it  .is  also  ■targeted  research.  Thus> 
f-i-nHers  and  users  often  as^une  it  £o  have  th^  level  of  certainty 
and  shortness  of  time  line  more  appropriately  associated  with 
development."    This  deceptiveness  and  the  consequent  inherent 
tension  fliakes  applied  research  subject  to  considerable  instability 
:T:isdt rcc:  ion  and  mismanagfjm^^nt  >  and  cOnf;oquent  m^sdireqtod  assc^ssment. 
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Researchers  frequently  redjaifine  and  bend  applied  research  into 
basic  research  modes,    rnlparticular>  they  often  aitempt  to 
undertake  projecJJf.on  smatLlar  scales  than  are  required  by  the 
nature  »f  the  problems>  wiaich  often  require  ^the  efforts  of 
large-scale  interdisciplinary  and,  empirically  based  team  programs 
/xhis  syndrome  is  oft-en  combined  with  attempts  to  oversell  the 
timingj  probability  and^  impact  of  outcomes  in  order  to  obtain 
funding-    This  often  succeeds  with  funders  simply  because  applied 
research  prajecCs  d^  appear  to  have  practical,  attaiJC^able  out- 
con:es.    All  of^  this  creates  an  environment  that  tends  to  be 
una£tracciv.e  to  many  oi.  the  best  researchers. 


On  the  other  sid^j  users  and  lunders,  haveing  been  persuaded 
to^Tttrt^^^uch  programs  because  of  these  very  expectations  of 
■   near-ticie  benef i'ts^^ibecome  frustrated  by  not  only  the  lack  of 
delivery  but  ilso  by  the"  shifting  targets,  time  and 'cost  patterns 
which  are  inherant  in  tKfe  uncertain  research  process. 


I 

\ 

J 


Another  important  dimension  of  this  tension  lies  in  the  problem 
of  need  identification.    Ofi  the  one  hand,  the  objective  is  to 
work  on  important         tim&*ly  problems  that  require  solution,  and 
this  tends  to  be  the  prime  inducement  for  the  users  and  funders* 
On  the  other  hand>  a  researcher  is  require^  to  maintain  the 
criteria  of  researchability,  and  may  therefore  so  sign^lf icantly 
redefine  the  research  <TU^stion  to  make  it  'Vesearchable"  that  the 
eS'fect  is  to  signiTicarvtly  linit  the  utility  of  the  project's 
findings  f,ron  the  user^perspectivc . 

Tliese  sources  of  tension  becone  magnified  when  one  recognizes 
th/it  tbe  cost  an:!  scale  of  applied  research  tend  to  run  orders 
of  r?.agni.tude  higher  than  what  is  ^typical  of  basic  research. 
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AsG^ssnfenc  r.ust  ch^r&fore  be  b^sed  on  judgments  of;' 

a^)    The  quality  and  appropriateness  of  the  institu- 
tions performing  this  function:    Are  they  capalile 

/  i 

of  izcmnting  the  required  large' fecale  interdisci- 
plil^a^  efforts?    Are  they  attracting  and  keeping 
tOD  quality^  applied  res^earchers?    Are  their  pro- 
grams  and  projects  considered  to  be  of  hig[\  quality, 
important  to  practice  and  on  truly  res^jarchsble 
\  oroblerns? 

b)  IvTifeCher  appi^ied  research,  is 'emergirjg  as  a  definable', 
entity^  differentiated  from  basic  research  and 

'  development.  *  \ 

c)  After  a  time  lag  th^t  reflects  several  years  of  sus- 
tained system  building,  an  evaluation  of  the  rate 
and  impact  of  outputs. 

d)  The  climatG  for  applied  research  in^erms  of  both 
support  patterns  and  receptivity  to  its  outputs, 

r  h  L 

B,    Current  Status 

Most  of  the  research  that  is  carried  on  in  education  appears 
to^  be  what  might  loosely  be  defined  as  the  applied  type,  much 
of  it^  unfupded  and  small-scale.    The  volume  of  studies  produced  ' 
n;;i^^ndGed  be  large  —  but    heing^of  this  small-scale,  scatt'^gj^ 
and  fragmented  quality,     these  have  been    subject  to  many  ^ 
questions  of  quality.    It  is  evident  (as  mentioned  earlier) 
that  there  is  substantial  lack  of  differentiation  in  education 
b4tween  what  can  truly  bB  classified  as  research  and  various 
Other  activities  (e*g-»  demonstration  projticts,  social  book- 
keeping>  etc);  ^  great  weaknesses  in  defining  researchable 
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problems;    considerable  fuzziness  in  differentiating  applied- 
research  fron  basic  research  and  development;  ■  and  tne  pre-- 
viously  mentioned  tendency  to  oversell  such  projects* 

■Mnst  appli^;d  research  in  education  is  carried  out  in  either 
universitiessor  large-^scale  R^D  institutions  in  the  private  or 
quasi-pbulic  sectors. 

Inhere  this  work  has  gone  on  in  universities,  there  has  been  a 
tendency  to  perform  applied  research  in  a  basic  research  mode* 
This  is  not  surprising  given  the  socialization  and  prior  train- 
ing      ^university  researchers  and  the  social  and  publication 
pressures  under  which  they  operate.  ^enerally>  universities 
find  it  difficult  ta  assemble  the  minimum  critical  mass  of  effort 
needed  to  undertake  large-^scale  applied  research  projects.    As  a 
consequence,  they  have  'tended  to  sCale  such  projects  down  and/i^r 
to  assemble  ad  hoc  teams  that  lack  long-range  stability.  With 
this  has  come  fne- unfortunate  tendency  for  researchers  to  move 
in  and  out  of  this  part  of  the  field  which  has  mitigated  against 
cysien-building  requirements. 

\.^r^\^  sc^le  RiD  organizations  should  have  been,  and  to  some 
decree  have  b,een,  more  suitable  sites  for  such  programs,  Hov-- 
evjr,  two  Irportant  problems  have  limited  their  potential  success 
Firsctly,  most  of  these  R6D  organizations  have  not  been  able  to 
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promise'  a  stable  career  path  to  researchers,  thereby  greatly  ^ 
limiting  th^ir  ability  to  attract  and  hold  first-rate  research- 
ers* ^Seconcjly,  federal  funding  practices  in  the  late  '60's 
shifted  the  character  of  many  of  these  institutions  away  from 
applied  research  and  reshaped  the:D"  Into  development  organizajr 
tions  in  accord  with  S^deral  _priorlties  at  that  time  for 
product-centered,  quidk- Impact  strategies, 

a  consequence-  Si  the  above^  conditions,  education  has,  in 
fact,  s^en  very  little  large-scale  applied  research.  There- 
fore, ^this  has  to  be  seen       an  area  th<lt  needs  to^  be  put 
tosether  at  this  tiir.e  in  itr  own  terms  end  not  be  thought  of 
as  ,a  fom  af  advanced  development  or  downstream  basic  research. 

A  nuniber  of  other  p'robleins  in  educational  applied  research  were 
previously  Implied,  but  require  further  explication.  The 
climate  for  such  research  has  been,  perhaps^  even  more  negative 
than  that  described  above  for  basic  research.    This  has  been 
so  precisely  because  it  seemed  to  hold  out  more  promise  of  in-  > 
pact  and  riaised  expectations  than  could  have,  been  satisfied  — 
given  the  inherent  tine  frame  and,  the  weak  state  of  the  area. 
Relatedly,  need  ideritlf ication,  which  had  been  researcher-driven 
up  through  the  nild-'60s,  became  system-driven  by  users  and  t 
funders.in  an  overreaction  to  this  state  of  affairs.    As  with 
basic  research,  funding  has  been  relatively  limited. 

Key  \^eeds 

Applied  research^  in  education,  then,- must  be  seen  in  a 
'_sy5 ten-buil'Kni;  mode. 

•  §k    ■  ■ 

a.     It' wll»oe  essential  to  locate  those  centers  of 
exccilcnct*  capable  of  pcrforning  lar^e-scalo  applied 
research  ■ 

.  ■ 


b.  Such  inscitutiohs  will  need  to  be  provided  with  the 
kind  of  long-term'-stable  funding  that  will  permit  thera 
to  attract  and  retain  top-flight  staffs  of  researchers, 

c.  It  will  also  be  vital  for  the  lead  educational  fund- 
ing agencies  to  help  practitioners  and  the' Congress 
understand  the  nature  and  requirements ^of  applied 
res&jl^h  to:  understand  that  project  selection  requires 
the  determination  of  what  ^is  researchable  as  well  as 
what  is  inportancj  recognize  that  the  present  lack  of 
capacity  deniar.ds  a  period  of  institution-building  before 
the  promise  of  the  area  can  begin  to  be  fulfilled;  and 
understand  that  such  institution-building  will  require  ' 
an  ongoing  and  long-term  commitment.  ' 


V.    DEVEL0PN5NT  OF  RESEARCH  FUNDING  POLICIES 

Reseatch  funding  is  on  the  increase  in' the  educatipn  sector . ^ 
'Indicative  of  this  is  the  NCER  resolution  passed  in  1977,  mandating 
an  increase  in  SIIE  support  for  fundamental  research  such  that  at  least 
20%  of  NIE's  budget  would  be  ^set  aside  for  fundamental  research  by  FY 

1979,  rising  to  a  set-aside  of  at  least  30%  l>y  FY  1985.^^    We  have 

*- 

argued  elsewhere  against  this  approach  tb  detem^ining  funding  alloca-* 
31 

tions.        Instead,  we  have^called*  for  a  perspective  that  takes  into 

account  a  number  of  factors  such  "a  priori  set-asides  ignore  —  for 

instance,  the  capacity  of  the  existing  high  quality  research  base 

to  productively  use  different  levels  of  funding,  the  tate  at  which 

the  quality  research  base  can  be  expanded,  the  need  to  balance  funding 

allocations  across  all  functional  areas  that  make  up  the  educational 

R/D&I  entfer'^irise,  the  need  fon  a  .balanced  rate  atjd  level  of.  develop-  " 

>  ■ 

ment  across  each  o{  these  areas,  etc. 

Clearly,  th§  research  function  in  education  requires  substantial 
strengthening.    And  probably  an  increase  irf  research  funding  was  im 
order.    However^  we  would  hope  th&t  future  policy  decisions  of  this- 
kind  will  take  into  account  long-term^  systemic  questions;  that  t^he 
expansion  of  the  research  function  will  be  planned,  orderly,  and 
targtjted  at  centers  'of  excellBnce;  and  that  existing  capacity  will  be 
protected"  and  nurtured  in  a  nianner  that  would  leave  it  less  exposed 
to  the  vagaries  of  NIE's  budget  appropriation  from  Congress* 

What  has  been  lacking  is  clear  policy  thinking  directed  t9warji 
ectabllshnienD  of  an  overall  research  strategy  for  the  educational  * 
R/D£fl  system.     This  uould^seem  to  be  a  matter  that  warrants  priority 
attention.    The  NCER  Resolution  mandating  Increased  support  for 
fundamental  research  suggests  that  KIE^  policy  making  body  has  come 
to  acknowledge  the  importance  of  the  'research  function  for  the  overall 
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health  of  the  educational  R/Did  system'*   Xt  woald  now  seem 
essential  to  invest  some  resources  in  the  design  of  more  appro^ 
priate  research  funding  policies  for  insuring  the  healthy  deuelop- 
,inent  of  the  research  function,  *  "  V 
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iij  the  early  years  o*f  funding  for  education  R/D£il,  there  was  consider- 
ablfi^  enthjisiasin  for  che  notion  of  applying  R^D  models  (i.e*>  Research- 
linked  development)  to  phe  solutic^  of  ^uc'ational  problems ^^^^gain 
/and  again>  the  liCeraCdre  echoed  the  theme^  that  development  was  "the 
^critical  missing  link  needed  to  translate  findings  from  research  and 
in^/acive  ideas  from  practice  into  usable  forms  that  could  be  imple- 
mented widely  in  schools  across  the  country*'^    Research  was  having 
little  impact  on  practice,,  it  was  argued;  because  research  findings 
tend  to  be  too  general  to  apply  directly  to  the  solution,  of  practical 
problems :    research  generjally  does  not  make .  infotmation"  available  in 
a  form  thaf  is  readily  usable  or.  suggests  easily  implemented  solutions 
to_  perceived  problems.    And  innovations  s3evised  by  practitioners  rarely^ 
have  ^gnif  icant  impact  beyond  their  site  of  origin  betause  they  are 
rarely  developed  or  packaged  sufficiently  to  permit  adoption  or  adap- 
tation by  others*    Institutionalization  of  the  development  function 
was  expected  to  overcome  both  barriers  to  wide"  scale  educational  im^ 
provement  ►  /       *  '^^^^ 

As  envisioned  by  R&D  proponents,  developers  were  to,  become,  the  '^engineers 

for  the  field  of  education.    They  were  to  perform  tl^e  key  tlranslation, 

elaboration,  and  packaging  rples  carried  out Ni2__gjisii^®®i^s  in  industrial 

and  military  settings*    And  they  would  carry  out  these 'functions  in  ^ 

clalized  institutions  thougirt  of  by  some  early  proponents  as  anaj^ogous 

to  the  great  national  laboratories  in  the  /ields  of  health,  defense^ 

and  at(?nic  energy.    Educational  development  vfes  to  become  *'a  new  dis- 

2  ' 

cipline  for  self-rehe^^al,"    borrowing  engineering  procedures  from 

\  ' 

duitri^i  and  nilitary  seqtings  ari4  adapting  then  to  the  field  of  edi*- 

catiftn\    Once  education  hfd  received  this  infusion  of  systematic  pro- 

% cedures  from  technological  fields  that  were  achieving  such  goajs  ae 

putting  .T>en  on  the  moon,  suxejy  wide  scale  improvement  t^f  educational 

^      '      ■  ■  ^ 

practice  could  be  expected! 

v;  ■ 

When,  only  a  f£iw*brief  years  la  ter ,  s^these  lofty  expectations  werre  .still 
unfulfilled,  much' the  earlief-  interest  in  educational .  R&D  dissolved," 


1     '      862  ' 

The  fedi^rally' funded  labs  and  centers,  created  as  the  institutionalized 
settings  for  R&D,  had  to  fight  for  their  survival' —  nearly  half  lost 
their  funiling  and  went  out  of  existence.    Though  the  remaining  labs 
and  conrers  now  seeTi  to  have  a  secure  nictia  in  the  federal  educational 
R/D5i'1  funding  picjcure,  this  has  required  transformation  for  some,  en- 
tailing greater"  orier^tation  to'^ard  the  dissemination  function,  for 
instaace,  and  somewhat  less  emphasis  on  product  or  program  development*^ 
There  apoears  to  be -less  mention  of  ''k&D"  or  e^n  "developinent''  in  the 
literature  and  in  usage  patterns  th  policy  circles,    .£v,en  NIE,  the 
federal  agency  created  "to* build  an  effective  R&D  system,"  has  apparently 
denujted  developm^int  to  a  lesser  priority  in  its  funding  poiic^,  placing 
suDport  for  full-scale  development  work*  behind  a)  funding  applied 

r^'zser.rcr,  b)  fa^Xli:a:iu^  d^elopnent  work  of  others,  and  c)  sponsoring 

'  ft 

only  prolotyp*^  development  to  achieve  the  agency's  social  policy  ob- 

3 

jectiv^s.      More  and  more,  attention  seems  to  be  shifting  away  from' the 

engineering*  model  of  R&D  and  toward  the  Ktf  end  of  t^e  spectrum  ~ 

increasingly  larger  shares  of  tbe"  total  educational  R/D^L  dollar  ap- 

'  gear  to  be  going^&N.^sseniination,  implementation  support,  and  building 

operating  systey capacities  for  the  less  l^gorous  forms  of  local, 

practice-based^evelopment, 

»  f 

What  iyis  happened  over  the  past  decade  or  io  to  change  the  climate 
sorrounding^  the  educational  R^  enterprise?    What  went  wrong,  artd  Why?. 
IVhat  directions  and  trends  arS  apparent?    What  have  we  l^Slr^e^  from 
the  experience  that  may  be  usable  to  strengthen  the  enterprise  in  t^he 
future?  '  *      '  * 

The  analysis  which*  follows  con^slders,  first,  the  rather  sparse  liter- 
ature on'-the  developnient^f unction  in  Education  atid  raises  questions 

'  about\tiow' we  may  learn  from  the  experience  of ;  the  past  decade  given 
how  little  inquiry,  analysis,  or  even  sEralgh^^r;jfard  docui^entation*  is 
Available^  to'date,  *    Si^JconcI,  <we  Consider  a  nutrtber  of  modes  of  develop- 

'ment  activity;     (a)  the  conventional'  fori^^.pf  practice-^based/practice- 
related  developmei^t  chiiracteristic  of  education  pr!ior  to  the  emergence 
of  R/^icI  '-In-  the 'fHi^  *60s:     fb)  the  rigorous  en^tiheerinf^  model  o£  devel- 

*  opment  borrowed  ftom  industry the  focus  of  attention 'in  educational 

\  ■  ■ 
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^R/D^SiI  in  the  late  '60s  and  early  '70s;  ^nd  (c)  the  exemplary  practices 
approach  of  local,  prac tice-baseA  development  linked  to  various  vali-  * 
dating,  packaging,  and/or  dissemiiiation  mechanisms,  an  approach  which 
has  been  attracting  increasing,  attention  as  enthusiasm  for  the  rigoroxis 
engineering  ntrfdel  of  educational  development^  has  cooled.    We  note  the 
distinguishing  charac^teristics  of  each  of  these  inodels  and  the  strengths 
arcd  weaknesses  of-each  %x\  tha*  educa tion  sector-    Finally^  based  on 
this  analysis^  we  point  to  a  number  of  policy  optlqns  that  might  be 
considered  for  strengthening  educational  development,  and  consider 
what  more  we  would  want  to  know  as  a  basis  for  .choosing  among  the 
available  options  in  designing  workable  approaches  to  strengthening  ■ 
oJ^icationai  development  in  the  future. 


ERIC 
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THE  LITERATURE  OF  EDUCATIOMAL  DEVELOPMENT 

tPaiicity  o£  the  Literature        '  ^ 

Considering  the  pivotal  , role  of  the  development  Eunction  in  the 
educational  R/D&I  strategy*  the  paucity  of  literature  on  educa- 
tional  development"  seems  somewhat  astonishing.'    What  little  is 
available  has  generally  been  produced  by  jstaEf  members  of  the 
regional  laboratories  (particularly  the  Far  West  Lab) >  and  many 
of  the  same  pieces  are  reprinted 'in  one  or  another  collection 
or   :irtlcles   on  che 'develop;::^ac  function.      We  ar^;  lndet)ted  to 
those  who  ^ave  published  these  pieces  for  providing  us  with  what 

L  4 

little  information  exists  in  print  at  this  time  on  the  develop- 
ment process*    Tne  brujit  of  our  criticism  is  not  directed  so 
much  at  what  is  there  in  the  literature  as  it  is  concerned  wifh  ^ 
what  is  not  in  print  for  others  to  read  and  analyze.    There  is 
relatively' little  process  documentation  by  part;icipants  or  by 
third^party  researchers;  relatively  little  in  the  way  of  inquiry- 
into  what  is  being  done,  why>  and  how,  with  what  outcomes;  little 
analysis  of  the  nature  of  tha  development  function  and  its  require- 
ments>  conditions  conducive  to'l^igh  level  functioning,  etc, 

The  available  literature  is  j)robably  somewliat  larger  than  wha^ 

we  have  been  able  to  gather.    We  are,  for  instance,  aware 'that  . 

the  University  of  Pittsburgh  K&h  Center  (LRDC)  subjected  itself 

to  the  scrutiny  of  an  in-house  sociologist  for  .several  years  and 

'  that  some  analyses  have  been  forthcoming,     ^nd  we  are  aware  of^  ' 

at  least  one  metfaodolo*gical  volume  on  development  proce.dures  that* 

6 

we  have  noJC  bsen  able  to  review.      But  aside,  from  these  sources,  ^ 
it  is  likely  that  we  have  seen  most  of  the  existing  literature, 
And  what  we  have  sisen,  unfortunately,  would  be  o^pflatively 
little  use  for  giving. a  novice  developer  much  insight  into  how 
to  carry  out  the  development  function.    The  literature  raises 
some  useful  questions  that  should  be 'of  concern  to  top-level  R£(D  r^- 
management.      But  even  here,  oi)^  would  hop^- to  see^eater  rith- 
-ness  of  descriptive  detail  and  more  analyses  of  the  nat^re^^oT"*  " 
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!■     ■  ■ 

development  work  in  jeducation  and  the  difficulties  tfiat  have 
been,  encountered*       ^  "  ^ 

B-    Categorisation  oE^  the  Available  Literature 

The  available,  development  literature.  can*be  categorised-  as 
follo^js: 

,  1*     Calls  for  develoTpment  as  the  missing  function  needed 

to  transform  research  findings  and  exemplary  practices 
into  uSable  packages  for  wide  scale  dissemination;^  ^ 
2\  ^^^j&f Initional  piecesi,  describing  developnent  processes 

and  outputs  in  terms  that  distinguish  it  fron  conventional 
developmental  activity  or  fi;otn  research>    or  that  fur- 
ther define  types-of  development  (e.g*j  product  develop- 

'  '      *  10 
ment  vs*  change  process  development)*  "  ^ 

.  3-    analyses  that  consider  development  in  relation  to  other 

functions  such  as  research  or  dissemination  or  evalua£:ion> 
either  describing  ideally  what  .the  relationship  should 
be  or  describing  the  nature  of  t^e  integration  as  it 
has  unfolded  in  particular  projects;'^ 

4.  reproduction  of  documents  generated  ifti  the  course  of 
individual  development  projects^ '^published  in  the  hope 
of  providing  the  reader  with  some  insight  injo  the 

thought  processes  and  activities  of  the  developers  in 

'         "  12 
carrying  ^ut  a  particular  project; 

^      ,  ^  i       -  .13 

5.  case  studies>  either  by  partitipants  in  a  project  or 

by  third-party  rgsearchers  studying  individual  projects 

'  *  lA 

■  an^Garrying,.out,cro^s-case  analyses>    ^  perhaps. the  most  | 

useful  , items  in  the  avai^lable  literature; 

6.  aur  ^arlier  'analysis  of  the  nature  pf  the  development 
function  and  j-ts  requirerie'nts,  based  on  examination  of_ 
hov  the  development  function  is  carried  out  in  other 
fields  sfich  as/aerosp;ice>  industry>,  health>  and  law 

■  enforcement;      and      '  -  ,  ' 

7.  our^  earlier  »oVerv^ey  analyses  5f  the  development  function 

in  educ;ition  based  on  the'available.  literature  personal 

■  w  '  ^  .  16 

■  expferiGnce>  and  impressionistic  evidence,  ■ 
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.We  tjill  draw  iieavily  .OR  our. earlier  analyses  in  the  remainder  x)f  v 
this  chapter-,  updating  the  analysis  wherever  this  seens  warranted 
*by  new  circun^tai^ces  or  new  information.    ^  -    -  ^ 


C.    Needed  Literature 

What  the  field  would/seem  to  need  is  considerably  more  documenta- 
tion and  analysis  of  \the  development  process  —  the  tasks 


activities  ^carried  outl  the  ^^lls  and  competences  required;  the 
often  difficult  interpersonal^comraunicaCion,  and  orgaaizational 
picoblems  inherent,  in  large-scale^  development  projects  generally 
requiring  hererogeneous^  skill  mixes,  complex  multi-unit  organiza- 
tionat  forms>  and  difficult  collaborative  relationships  among 
developer  organi'^sations,  user  settings^  sponsoring  agencies^  etc* 
Althougi^  our  description  here  foc^ises  somewhat  on  the  need  for 
greater  understanding  .of  the  systegiatic  R^D  mode,  we  woulrd  be 
equally  interested  in  seeing  studies  done  of  development  work  of 
both,  the  practice-abased  practice-related  and  mixed  modes  described 
later  in  this  chapter-      ^  *     '  * 

"  *- 
Ideally,  we  would  ^like  to  see  such  analyses  carried  out  by  third- 
party  field  researchers^  spending  long  periods  of  time  working 
with  ongoing  development  projects  (both  some  that  are  succeeding 
and  producing  high  quality, work  and  others  performing  less  well) 
Case  studies  with  cross-ca^e  analyse^^s  would  be  highly  Useful,  The 
case  ^tutties^of  development  projects  included  iri  the  Oregon  Stud|.es 

are  highly  useful  examples-of  what  can  be  learned*  from  such  a 
17* 

format.        However,  we  would  like  to  see  the  kinds  of  process     '  - 
■  -         *  "  * 

documentation  ^hat  re<|uire_  li^ving  with  a  project  for  some  tiroi  — 
perhaps  a  year  or  more, 

G^ven^the  probably  high  cost^  of*such  a  project,  and  its  likely 
low  priority  given  the  current  deemphasis  on^  the  defeelopmeitt 
function,  a'lcBS  costly  alternative  to^ provide  the  needed  inr^>c^  - 
mation  might  be  to  use  oral  history  techniques  to  gather  rich, 
descriptive  detail  about  th^  development  process  from  developers 
who  l^ve  actively  carried  out  development  projects  over  the  past 
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11^     three' BASIC  OP^RATINfc  HdDES  IN  EDUCaTIONaI  DEVELQPMECT 

* 

Depending  ori  how  one  defines  educational  development,  it  is  either 
one  of  the  oldest  or  onei  of  the  newest  R/D^I  activities  in  the  educa- 
tion sector;  virtually  all  products  used  in  the  education  sector  ar^ 
thti  outputs  of  development  work  or  relatively  few  are.    The  core  of 
developmental  activity  is  the  translation  of  a  conception  into  a  use- 
able product  or  program*    Geaerally  in  the  field  of  education,  the 
conception  involves  some  specifi'c  instructional  objective  and  a 
particular  app^oach  or  strategy  for  achieving  that  objective.  The 
trrTHsI^cinn  ;>rocess  tends  to  involve  the  selection  and  sequencing  of 
a  'nuTiber  of  learning  experiences  aimed  at  achieving  the  particular 
ir^str^ctional  objective.    Monre  often  than  not,  the  translation  proces^s 
involves  the  design  of.  matg^rials  of  various  kinds  to  support  the 
instructional  pro'cess*  "  '  ^ 

As  long  as  there  have  been  teacHeJCg^^nd  schools,  educators  have  been 
devising  te^^hing  approaches  arid  preparing  instructional  materials, 
though  not  using  the  ter:n  **deu6Iopment*'  for  what  they  wece  doing.  More 
recently,  the  engineering  mo^el  of  development  borrowed  ffom  industry 
*added  ses^eral  distincfive  f^eatures  which  transformed  t'g^  nature  of  this 
developm^int  process*  and  shif^ted  its  locus  from  the  professional  educator, 
and  the  school  setting  to  specialized'  development  organizatj^ons  and\.' 
personnel  identified  as  **develbpers"  external  to  the  operating  system, 
creating  newS^ndS  of  products,  and  also  new  kinds  of  problems  in 
securing-  the  adoption  and  use  of  thes&  outputs  back  in  the  classroom* 
A  third  niode  of  development  combines  elements  of  both  the  earlier  vari- 
ants, both  school-based  development  of  innovations  and  external  verifi- 
cation, elaboration,  and  'packaging  for  dissetr-ination  by  a  combination 
of  ;state  and/or  federal  level  bodies  , and  specialized  development  or- 
gani:sations-  ^  ■     ■  ■  ^ 


There  ar^,  -then,  basically  thr^e  different  opeif&ting  modes  through 
which  the  development .  function  is  carried  out  in  education.      For  cor 
venienc£\  we  shall  describe  the  three  modes  in  terms  of  the  settings 
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where- they  take  place:,   (1)  development  that  takes  place  in  prdctic^ 
based  or  practice-related  settings;^  (2)  dbvelopnent  work  in  specialized 
development  organizations;  and  (3)  mixed  modes  involving  a ^sequence 

■  of  development  work  beginning  in  practice-based  settings  and  continuing 
in  other  settings  (possibly  including  specialized  development  organi- 

^zations).    Each  node  is  His^nctive  not  only  in  the  ^particular  setting 
in  whifcH- it  i^  carried  .on  but  also  in  the*  nature  of  the. development 

process*  the  "outputs  produced^  organizational  and  management  requite- 

^  ly  - 

nients>  cofets,  streng'ths  and  weaknesses.  ^ 


Ij  Prac  tlce-Rased/?rac-tlce-Related  bevelopnfeiy^  (aisc!%  referred  to  ±n 

the  ijfterature  as  ^^conventional  development      "local  R^D/'  or  ^ 
,     "school-based  R^D") .  *       '  v  ■ 

ft  '* 

A-    Settings  an;i  Personnel  ,    .  . 

Traditionally,  the  design  and  development  of  instruc^onal 

^        strategies,  programs  and  materials  have  taken  place  in  pr^actice- 

based  aq|^  practice-related  settings*    The  traditional  developers 

of  educational  products  and  pr<^rams  hav^e  been  classroom  teachers 

and  curriculum  specialists  working  in  LEAs,  SEAs,  or  "the  new 

ISAs,  or  in  such  practice-r^ated  auxiliarx^rganizations  as" 

r      schools  of  education,  publishing  houses,  or  commercial  suppliers 

of  audio-visual  or  multi-media  instructional  materials'  On 

occasion,  as  in  the  NSP  Course  Content  Improvement  Program  of  the 

late  /50s  and  early  '60s,  eminent  university  scholai^s  joined  the 

'   ranks  of  educational  curriculum  developers,  participating  in  im-, 

pressi'ive  efforts  to  improve  K-l^J  level  curricula  and- instructional 

IS 

(materials  in  the  sciences  anc^  mathematics.        There_^ere  some  less 

successful  programs  in  otl^er  fields  as  well,  notably' social 

^  19  t  ^ 

■   studies-  an^^J^ngllsh,  , 

^  .Funclin^  So* trce^^s  * 


Generrilly^  traditional  development  work'has  been  funded  out  of 
the  operating  "budgeJts  of  IAEA's  and  SEAs  or  the  development 


budgets  of^  the' publishing  hoas^jjj^nd  coijjpfercial  suppliers: 
Over  xhe  ^st  t^o^decades,  hoiieve'r,  there  has  alsp.  been  a  sub- 
^^KitiaL  rinfusion  of  federal^  categorical  funds  to  support  sp&- 
tific  kinds  of,, development  work*    NDEA^|^i>he  KatioDal ;Def ense  ^ 
Education  ActJ  aod  CRA,^he  Coppetttive  Rese'arch  Act)  in  tlie    -  ' 
JLate  '50s  and  earl}?  *60s  suppo^rted  wor^       foreign  Languages,  1# 
English,  3pd  social  studies,  for  instance,  mostly  In  university 
research  settlings,    KDEA  funds  alsg  gave  a  ^^^^^  Boosts,, to  the 
audio-visual  indus.t/y,  providing  substantial  s^s  £ot  ,school 
*sVsteiii5  to  ^purchas^  audio-visual  equipment  and  material^.     At    -  ' 
^zhe  sane  time,.  XSF  rioneyl  supported  such  important  curriculum  * 
^jceviston  projects  ds  PSSC  phys4*cs,  B$CS  biology^  CH^l.  chemistry, , 
aQd^S/fS*"!  mathematics",   to  mame  o"n3;y  a  few.        .  -         .  ,  ^ 

Beginning  w^th  ESEA  (the.El,emej:itary  and' ^ecgndarry  K^jdcaqion  Act) 

in  1965,  ■sub^tant;^l  federal  £undi^§  has  t^Vn  g^flftig'di^ec^l:)^^ 

*LEAs  to,  support  the.  development  of  programs  to  improve"  the 

^<?hie]/euiipt  of  disadvantaged  sttldeats  (Title  I)  aod  to  support 

^he' de^oto>pnient  and  demonstr&tidii  of  educatipnal  innovations 

V  f  ■   '  ^        ^  } 

(TlWe  III).    Additional  categorical  federal  funding  "has  gqne  to 

LEAs       support  development  work  targetted  at  assis  ting,  handi- 
^dapped  students,  and  bilingual  studeilts-      5pme  stat'^  provide^.,,,^ 
^I^Kiraflel  s^a^e  fundirfg^For  categorjcal  prograiji^^  ^espec ially 

'4hose^  tajrgetted  at  disa'Svantag^  students.    ^  - 

C-   'Tbe  p^'velc^pment'TPirocess  *  '  '      .  #^ 

THe  devo-lopm^ht  appro^^ch  used  in  these- settings  is'genetallj 

,characterized  by  a  number,  of^  distinctive  featfures:^  '  .  ' 

*  '/  /  .     ,     .       ^  5  *  " 

.     .    :  y    '  ■ 

First, -the  development,  pri^pess^^^ends  to  be' somewhat -casual  —  a 
.creative- teacher  w^'ites  down  iiSr*  ideas'  in  rou^h  form  for  her  own 
,use;\a  curriculum  iiommittee  of  a  smaH  number  of  tea^*hers  spends 

a  f-t;w  veeks  over  the, summer  revising  th^  curriculum  "for  inBtruc-  v 

tion,:^n  ^  4>articula^j^ujD^ect;  the  small  pirr-riculum  $taff  6^  an^j.. 

LEA' or  Sf;A  prepare  a  n^w  curt^culm^jb^e ;  ^tffe  author  prepares" 


^  the  draft*  of  a  textbook  i^^J^s  spare  time  and  worKs  with  an 
editor  fro:n  a  publ4shing  house  t^redfl/  ^  f or  coiGinercial  disCFi-  ^ 
^    buci<xi;' a  number  of  university  pro^f^spors  and  ^fieir  assistants        ^  ' 
/devote  a  small  porcion-of  their  time  each  week  to  a  curriculuni  t 
project  chat  "elaborates  a  particular  conception.  *  tfhat.is  dis-  ■  ,    .  ' 
tinctive  is  the  casualness  of  the  enterprise,  the  absence  of 
much  in  the  way  of   disciplined   inquiry  accompanyiag  the  work. 

Second,  evaluation  of  'the  outputs  of  this  developmer^t  process 

-  'tends  to  be  equally  casual  ^nd  informal;  it  ''places  little  bur- 

'21  *  ,      V  ^ 

dea  of  proof  on  ,the  product,*'       Field-testii^g  is  non-exigent  or  . 

miniinal  —  "casual*  tryout"^^/,  at  best,,   Whatever  evaiu'^roS-.a^id 


revisj-ons  are^made  tend  to  rest  on  criteria  of  face  validity 
4   .  ,     ,  *Ce,g,,  self-criticism,  teachers'  subjective  perceptions  and. 

^  reactions?  expert  judgments,  etc*)  rather  than  measured  effec- 
,    .  '  .    ttveaes's  'in  achieviog  prespectfied  impacts.    Even  where  some  re- 
J  '       vision  ^oes  take  t>lace,  there'is  not  likely  to  be  an'' ^tensive 


,    -recycling  of  the  development-revision  sequenp e^, 

Th4r<n  the  pers€?nnel  involved' tend  to       relatively  few,*and 
^atever  skill  nrixes  are  present  Cn-  a  dev<?I<gpment  team  tend  to 
be  relcitively  homog^eneous-        "  ^  ^  -  -  -  ' 

Fourth,  Tn|nagement  is  g^erally  informal  and  highly  flexible.  *  * 

.      '        f        -  '  '  •  -  ,  - 

And  firtftlly,,  because  of  all,pf  th^  above,  costs  tend,  to  be 
"^lltl^iveiy  low,       ,     i     .  '*  ' 

.  V-         ;  ^   ^    *  .   . .  - 

Th^ire  is  of  courst; *signlf'ica*it  variability  wXh^n  this  mode', 
Tftere 'are , obvious  ^itferences  of  -scale  and  sophistricationj  ^tho     ,         '  ft» 
rah^e  l0t'us  say  frotr/a  single  teacher  working  alone  oji  somejfhing  ■ 
for  her  classes  to  the  tiniversity  ^^up  of  sever^ij.  professors  and 
-,f   graduate  student?;  collaborating  with  the  (jditori^il  arih  production 
st^iff  of  a  commercial  publishing  house.    But  in  addition,  other 
^differences*  ^houlfl  be  qofed.  ^.^.^  - 


er|c  '   ^  \  ' 
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^  For  ias  taace,  thouah,  geaerajLleatioa  based  'on  impressionistic 
evidence  is  somewhat  risky,-  the  work  done  iR  $cho"6I  systems 'and 
in  universities  seems  to *dif f er.somewhat  in  the  Prigin  of  con- 
ceptions  and' in  chfi  ^dertjiion  criteria  used  in  the  selection  and 
sequencing  of  learning  experiences.     In  school  systems,  both  the 
origin"  of  t,he  conceptions  and  the  decisions  r^aJt^  tend  ta- be  some- 
what Intuit'ive.^  ^nd  the  focus  of  actenttbn  seems  to  be 'on  the. 
^^4jnrent  to  be  co[/;1eyed  rather  than  bn  conceptions  of  how  teachers 
,  go  about  providing  instruction.    The  dfevel^jp^ent  work  of  univer- 
sity-based curriculum  specialists,^  in  qpntrast*'  is  more  likely  4:0 
reilect  par»ic\j^ar  cheoriefs  of  curriculum  or  Ins^truc tion .  But 
even  hetG^  more  ^^usWiT^an  not,  ti)e  selection  atid  sequencing  of  ' 
learning  experiences  t^nds  to  reflect  theoretical  coitsi<ieration^\ 
rather  than  ,experir::>entation  in  classrooms  or  a^^l5^sis  of  data  on 

^implementation  processes  or,  tondi tidhsjDr  . student  impact* 

■  .  '  * 

.  * 

Development  processes  and,  outputs^  also  differ, dcpefiding  on  * 

''Whethec  oj^not  a  give*^n  produq^t  or  program  has  been  developed  witli 

the  iatent 'of  wide  scale  dissemination.    Where  textbooks  or  " 

materials  packages  are  being"  de7^op%d.* foV  large-scale,  riation- 

i^de  dissemination  (as  would  be  the  case  in+a  publishing  hguse 

in  many  Vniversitp  curriculuRT"  prpjects)*_an  effort  is  usually^: 

'  >  T     .  »\ 

made  to  include  implenentatign  supports  in  the,  form, .of  te^c^ers^^'^ 

guides-,  testing  materials,  e^.    IJhere  materials  are  ^^velop^d 

locally  ^jithin  the  operating  system,,  for  use  by  "^j  single,  teacher 

or  group  of  teach^i?^  in  S  single  school  Qr  district;,  far  less  of 

rtbie  Impjcmentitioli' process  is  likely- to  be  comm'it^S,  To  print  or 

captured  An  media  i^resentatioris.     In  such  instances,  the  sl^ate  of 

^^evelo^Dmenc"  of  the  materials  or  j^tpacegi^JS'  remains  icfadequat^ 

to  pdrmLcr  use  outsitli*"  this  s:nall 'tjrigina  ting  growp .  u  Critical  im- 

■  pJementation.'information  ^bout'what  works,  why,  and  how  — 

'  Informatio  ar<fund  in  tlie,  iread  of  the  originator  of  the 

*  project  —  is  not  provided  to  assist  dthers".    Generally^  these. 

■  lojcally  develope'cl  innovatipt^  are  nqt  disseminated*    But  in  case3 


>r 


where 


wide  scale  '^diss^imination  is  attempted  as  Sn  af'terthou^t,*  M 

>  '     -.r  ....  r 


without^  adoquc^te  attention- to  "dlssemidatiofl  or  implementation 


*.conct\ms  tluring^the  deveXo'f^nt  process,  these  Aopovarj^p^t^tcnd 

to  Kava  mininal  success.    The  reason,  sinply,  isxhax  the  develBp- 

^  merit  w<jrrk  was  not  carried  far  "enotigh'to  E)ermit  the  innovation  to 

be  inpflernerfted  oaslly'^and  e'ffectively  by  others.   .  \     '    -  ^  " 

V  " '  '  ^  '  ■  ■ 

Regardless^  of^  these  variations,  _  \^Jfat  is  most  distinctive  about' 
this  mode  of  .developoient  is  the  cJ^ualness  of  product"  eva^luatioc 
and^r^^ision  follow^jj^  initial  ^preparation  of  the  development^ 
outputs,  and  tha  consequent  low  cps^t-  *     .  ,    "  , 

D.  Outputs 


is  difficult  lO  characterize;  or  assess  the  outputs  that  have 
been  produced  ov!;r  the  >ears  tHroiigh  this  Aodfe  of  devel'iSvpfnental 
.  -activity.    The  output  has  been  enonnous .    Its  variability  , 
considerable,  from  commercially.^pjablished'  textbooks  to.  an 

inijividual  teacher's  lesson  pla\i.    And  most  of'all,  the  tasic  is 

'        *  "J  23 

made  particula:*Xy,^dif f icult  \>y  the  r.^afive  '"-invisibility*'  of 

this  output       most  lacally  developed  materials"  are  to  be  found  \ 

tfeachers^  files  or  supply  cattinets,         in  any  qentral 
depositories  or  materials  cytfnters  or  dissemination  pipelines,^ 

'  One .ass^e^menc  of  this  output  is  likely  to  be  dependent  on'.Sfe's 
iocaDipn  (insiBe  o^  outside  thB  us^r  system,  in  an  innovative 
district  or  a  more 'traditional  one)  and  on^fr  point  of  view  (for 
instance,  an  educational  refomej:  looking  for  e^^ence  of' 
exten^ve  innovation  or  a  practiti*c>ner  looking  fojr  useful  materials 
that  i^^t  particular  perCeivetS  needs). 

.  Clearl')'.  though,  an  iipportant  ^int'to  be  \inderscoT,ed  is  that 
goner^al'ly  "thij  'output  is'  uscd^^  esipecially  the  commerVially  ^developed 
produ^s  and  the  m&^eri^ls 'prepared 'by  practitioners  'for  their  own 
use.    Although  the  number  of  students  e^osed  ,to  each'^^et  of    "    ■  ,^ 
localJy  developed  materialsyrtSi^  not  b^  high)  the  pJr- "SJiudfent  cost 
is  probably  qui*tc  litw  —  a*  point  in  sHarp  cotitt-ast  rp'^the  high  per 

'  student  costs  of  many, of  the.  outputs  of  the  specializdii'developmenti' 
ocganiz^tiorrs  wtfich  we  shall  consider  shortly,.  y  _    ■  /  . 


In  some 'instance^,  as  for  insCance  the  science  and  mathemacics 

curricula 'produced  by  uhiverslty  s€hol£yrs  with  ^JSF  funds,  the 

number  Qf  studofits  *using  *Che  materials  is  especially  high. 

Therefore,'  though  theses-projects  cost  considerably  moreAtlian 
•  '      ■  .J  i  ^ 

TBOsf^tleve^opment  work  of  the  practice-based/practice  related 

wrie  tVi,  given  thfe  extensive  utilization  histories  ,of,^  tjheir 

,output;s  the  ppr^student  costs,  "are^probably  still  quite  low. 

.  StrehfithgyAdvaj)tafies 


Practice  bas^d^  and  to^a  l^esser  e^ctent  practice-relat^|tdevel- 
oonient' ha\rB  a  nunb^^jfTj^stjrengths,  especially  in  cofep^i§pn  to 
L?ie  eij§ineering  modeVoi  development  we  shall  turn  to  shortly*  '  * 

First,  the  .costs  are  relatively  low* 

Second'^  this  mode  of  development  is  closely  and  effectively 

linked  tO'  the  user  systeta,  .  The  programs  and  materials  that 

are  prqt^eh^ced  are  ^fesponses  to  perceived  user  needs  or  problems. 

This  i^  espec*lally  true  ^in  caSes  where  the  developer  is^  the 

user  or  is  at  leas't  a  part  of  the  user  system,    But  even  where 

the- work  Is  done  In  practice-related  settings,  vhat  are  thought- 

of  (not  alw^s  correctly)  as  Close  and  ongoing  relationship 

between  'practitioners,  on  tjie  on'e  hand', 'and  fersonnel  in  schools 

of  education  or  commer-clal  publishing  houses,  on  the  other;  aire 

assumed  to  ijic;rease^  t:he  likelihood  that  t^e  developmeiit-  process 

will  be  responsive  t6  the  usejr*s  felt  needs*    Therefore,  t 

■      '  - 
specially  in  <the  case  of  practice-abased  devei^oprnerit ,  littl^  or 

* 

no  marketing  effort  is  required  to  persuade  users  .to  adopt. or 
\isQ^%^';.2  materials  produced!^     ^         ,  ,^ 

f     ^       ■     ^  ■     -  s    .  * 

'Third,  where  development  work  is  carried  out  for 'loc^l  use,  it 

is '  likely ^lo  reflect  use*  systetii^condltlons,  teaching  styltes, 

-values,  etc/,, the  very  factors  that'^^icrf-tqft^^^  to  V 

adoption  of  externally  developed  Innovations, .or  make  it  * 

nej^es^^ary  for  extern^Jlly  developed  innovations  to  be  .adapted 
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to  nt-et  .local  needs 'and  requirements. 

* 

Fj    Weaknesses/Disadvantages  ^ . 

There  is  also  a  number  ^  weaknesses  or  disa^antages  to  this 

approach,    ^hG  oritique  focfuses  on  such  pFoolems  as  the  lack  of 

Evaluative  Inforjaatioh  provided  hy^^^xs  process,  lack  of 

^■Sophistication  in  the  skills  of  the 'developers,  poor  docuroen- 

ration  of  the  outputs  produced,  difficulties  in  packaging 

locaVly  d^evelope^^Anmovations  for  u^e  elsewhere",  substantial 

problems  in  achl§%Tflg  vlder  disseniinAtion  and  diffusion,  and, 

finally,  the  argument  that  ^from  a  najcional  policy  ^perspective 
/      '     •  ^       *t  .  , 

(for  ali  of  these  ozh^t  reasons)  lecal  developr.ent  entails  an 

inefficient  use  of^scarce  resources,  .  •  ^  , 


First,  since  this  developri^ent  process  generates  little  if '  any 
empirical  data  on  degree  of  ef f ec tive^ess ^of  the  product  or 
program,  or  its  efi^ctiVeness*under  va^rying  conditions,  it  is 
difficult  CO  nake^udgments 'iibout  whet;her  a  given  outp'ut  works, 
for  yhon,  imdar  what  conditions,  whether  it  is  any  better  chan 
sou\e  alternative  product  or  program  that  might  be  used  instead, 
or  perhap^^  most  important,  of -a^^l,  how  it  ^ight  be  imp^ved, 
If  systematic  research  accompanied  ,the  development  and  refine- 
ment proc/ss,  it  is  argued,  our  knowledge  would  be  increased 
and  '-w'eNjould  be  able  to  achieve  -better  ^s^ults.  Also, 
potential  adopters  *wpul<f  be-in  a  bettei?  position  to  make 
infomal- ado9ti^>n  decisions-^  ^  » 

Sedftnd,  the  argusient  has^oen  made  that  there  has  been  relatively 

>  *^  J*  "  '  . 

*  littP'  i;tron^  innovative  devOop-^nt-  work  in  f.Ms  mode  bec^'se 

teachers  ancj  school  systems  lack  tbe  tiirie  and  ^resourc^s  needed 

for  high  quality  development  wc>rk\    They 'have  neither  the, time 

rtor  the  expertise  to  ke^p  up' to  date  on  the  latest  research 

fi:^d^ing?;,  or  development  stace-of-the-art>  or  even  innovation^' 

being  developed  in  other  school  systems.  * Cortsequendly, *  '  ^ 

pi'act'i'tioners  arh  constant ly* "reinventing ■  the -wheel,"    Kor  do  k 


•■"■•*'    ■     *.  .877  . 

.■ ,.,   .  .  ■/■...■. 

theyhave  the  time,  resources,  or  expertise  to  carry  out  rigorous^' 

developrttrnt  work.    Consequently',  -the  work  is  nonrigorous  and^the 

■*       -  25  .  ' 

results  are  mfediocre,       .         ,  ■  ■■ 


While  the  resource  picture  might  be  changed  by  providing  LEAs  and 

'  SEAs  with  tTie  fun'ds  now  given  to  ^specialized  development  organ- 

azations,  the  result^,*  it  is  argyj^^,- would  still  be  poor. 

Practitioners  would  stiiX  Ifeck  the  needed  expertSLse  and  would  *  ^ 

continue  reinventing  the  uhe^l.    X^ven  if  it  were 'desirable  for 

inc^?idual  LEAs  oi^  S£As  to  esiploy  development*  specialists ,  ^^^^ 

i^ad^tjuato  supply  of  trained  dev^opers  would  make  this  impos-' 

sibie.)  ' 
J*    '     ,  ' 

And  such  resourct:'s_  would  not  be  expended^ef  f icientXy:    the  nation 
could  not  expect  maximum  national  impact  for ^each^ dollar  spent. 
' Ejcpendi^upes  on  local -innovatiojis- -generally  produce  prograijs  for 
use  only  in  the  docal  setting.' .  Additional  funds  would  have  to 
be  expended  to;  ,  *  , 

1.     identify  and  disseminate  high  quality  djevejopm^nt  work 

'  for  us«  elsewhete;  ^  -  '  ' 

•2.    gather  and  analy;:e  impact  data  .to  provide  potential  , 

,  adopters  wit^i  a  rational- basis  for  decision-taaklitg;  / 

*      3.     ^aboi?ate  and  package  loc^l,  j^nnovations  sufficiently 

'      *-to  insure  th^t  they'could  be  used  effe<;tively  else-        ,  - 
'    *  ,  ,     ^-      ■  ■ 

vhpre,  Tepl'icating" the  "resulce  achieved  at  the.  Initial  ^ 

devej.6pjnent^  "sites;  and  ^     ^       \  .ll^; 

  f    *    '  \    ^-  *   *  ' 

ff.    disseminata  the 'lo^all:if  -dej^lop^d' innovations  nation- 

■  i     "     ^       ■  '    /        '  * 


r' 


 r^thing«"*biift/^*T*'^t  vor^ced  oiaj.*qii/^  were  expec  __ 

m  the  "Operation  i5fJti^,rig6^pu^'>Kgliri^efilt&*^  gf  educational 
,  cievelopraent;^"/ .^^'^  s^atl'Tj^tV^^  X^'fer-  point  in" 


erJc 


ms. 


'.^^fe:  s^al;l'Ttft"J#^;*^  to  €bi^  t^'fer-  point 


Che  field  is  too  nc*w  in  the  education  sector  for  development 
persDnnel  to  have  much  (if  any)  formal  training  in  development, 
tHey  have  generally  learne^*  their  jotis  thc«ft[gh  total  immersion 
in  the  davelop:jient  specialty  over  several  years^   By '  background,  ^ 
they  r^ay  coTife  from  practice  settings>_^OTn  universitTies ,  or  in 
soT?.s  cases  froni  industry  where  they  carried  out  development 
work  in  other  fields.    Many  would  seem  to  be  ^development  * 
generalists  vith  no  particular  specialization  t>r  else  identified 
-T^ich  *'curriculu:n'^  in  the  broadest  scnse^.    Others  may  be  curriculum 
specialises  in  particular  subject  matter  fields*    Still  others 
nay  :\ave  specialties  in  flesigri,  testing,  packaging,  media", 
\  -^.^^Tr^c:  Jor.al  t^;chr.ologv    e:c .  " 

What  distinguishes  these  developers  from  their  counterparts  in 
schools^nd  universities  "xs-tlieir  professional  orientation  to 
ihi^'devgiopment  function,  .the  full-time  allocation  of  their  tine 
^  Ke\^lop:?.ent  *work,  and  the  manner  iT>  which  their  work  is 
orgaVli^J^d  managed.    Individual  deyelopers  in  this  mode  function 
as  Di\^ets  of  generally  large  development  teams,  with  highly 
heterogeneous  skill  mixes, *and  generally  proceed  in  accord  with 
the  dictates  of  the  engineering  model  of  R&D, 

Clear Iv,  there  -  is  a  considerable  amount  of  development  work 
carri^rd  on  in  these  organizations  that  does  not  adhere'  faithfuily 
to  tha  rigorous  rj^del  of  the  development  funct^on\  *But  equally  . 
clearly^  this  does  appear  to  be  the  model  t^iey  are  trying  to  use 
in  planning  and  conducting. their  work..         •  ^ 


i*  * 

What  i5  also  distinctive  about  educational  development  work 
aarried  out  "in  specialized  development  organizations  is "that  it 
Is  aliT^^rifeanClrely  funded  with  federal  ^und^. 


The^ilfional  laboratories  and  university-based  R&D  centers  were 
crer^tod  by  OK  in  Dhe  *60s  for  the- specif ic  ^purpose  of.  carrying 


Che  field  is  too  nc*w  in  the  education  sector  for  development 
persDnnel  to  have  much  (if  any)  formal  training  in  development, 
tHey  have  generally  learne^*  their  jotis  thc«ft[gh  total  immersion 
in  the  davelop:jient  specialty  over  several  years^   By '  background,  ^ 
they  r^ay  coTife  from  practice  settings>_^OTn  universitTies ,  or  in 
soT?.s  cases  froni  industry  where  they  carried  out  development 
work  in  other  fields.    Many  would  seem  to  be  ^development  * 
generalists  vith  no  particular  specialization  t>r  else  identified 
-T^ich  *'curriculu:n'^  in  the  broadest  scnse^.    Others  may  be  curriculum 
specialises  in  particular  subject  matter  fields*    Still  others 
nay  :\ave  specialties  in  flesigri,  testing,  packaging,  media", 
\  -^.^^Tr^c:  Jor.al  t^;chr.ologv    e:c .  " 

What  distinguishes  these  developers  from  their  counterparts  in 
schools^nd  universities  "xs-tlieir  professional  orientation  to 
ihi^'devgiopment  function,  .the  full-time  allocation  of  their  tine 
^  Ke\^lop:?.ent  *work,  and  the  manner  iT>  which  their  work  is 
orgaVli^J^d  managed.    Individual  deyelopers  in  this  mode  function 
as  Di\^ets  of  generally  large  development  teams,  with  highly 
heterogeneous  skill  mixes, *and  generally  proceed  in  accord  with 
the  dictates  of  the  engineering  model  of  R&D, 

Clear Iv,  there  -  is  a  considerable  amount  of  development  work 
carri^rd  on  in  these  organizations  that  does  not  adhere'  faithfuily 
to  tha  rigorous  rj^del  of  the  development  funct^on\  *But  equally  . 
clearly^  this  does  appear  to  be  the  model  t^iey  are  trying  to  use 
in  planning  and  conducting. their  work..         •  ^ 


i*  * 

What  i5  also  distinctive  about  educational  development  work 
aarried  out  "in  specialized  development  organizations  is "that  it 
Is  aliT^^rifeanClrely  funded  with  federal  ^und^. 


The^ilfional  laboratories  and  university-based  R&D  centers  were 
crer^tod  by  OK  in  Dhe  *60s  for  the- specif ic  ^purpose  of.  carrying 


■'^      -     .  -  ■       ■      ■  ■  I 

on  educatiortal  They  were  created' as  hew  ins^citucion^  on  the 

.assumption  chat  none  .of  tjie  -existing  organizational  forms  could.  ' 
carry  our  the  development:  function  as  an  institutionalized 
specialty  on  the  scale  a^id  in  .the  t^gtrt^ly  managed  way  that  seen^ed  . 
to  ire  rt^quired .  " 

'  1  f 

As  the  source  of,  funds  for  virtually  all  of  tihe  operations  of 
alctkost  all  of  the  labs  and  centers,  Washington  calle^d  the  tune, 
and  various  messages  from  Washington  have^  largely  shaped 'system- 
atic  RccD  as  it  has  evolved  in  dhe  field  of  education.    By  1968  - 
(and  "for  a  few  years  thereat Cer)    .it  was  made  clear  to  the  labs 
ainj  C'jnzs^rs  chat  what  was  "in"  was  product  devaropmenl^sir.3  the 
systerratic  RisD. model.       ^         "        ^  -  ^  ■ 

When  by  &he  eatly  .'703-^  th^-  federal  ^f^ons^rs  of  the  labs  knd 
<*fente'rs  had  become  disappointed  with  the  ^g-eneraily  mediocre 
outpti^is  of-the^e  institutions,  development  contracts  were  opened 
to  broacier  competitipn,.    Non-profit  and  for-profit  research  and^ 
R^D  corporations  wer§  organiz^tibna^lly  su-ite^  io  function  as 
sp^cicLlized  RoD  organisations  and  responded  actively  to  the 
availability  of  funds.    Sew  c&rporations,  were  foinaed,  or 
existing  corporations  active* in  other  fields  added  »staff  and/or 
organizational  units  able  to  handle  contracts  for  development 
work  in  the  field  of  education.    Since  the  federal  government  was  ^ 
the  prime  source  of  development  dollars  in  these  yars,  federal 
policy  and  procurement  decisions  would  seem  to  have* beeo^ almost 
a^  iftf  lucintial  "in  shaping  the  pattern  of  development  work  carried 
^out  in  these  or'ganizations  as  it  ^ad  been  in  shaping  the  develop- 
ment  f-unction  in^  the  labs  and  centers.  ^■'^  ' 

'        '  '* 

C.    Thfi  DevfeloDn^ent  Process 

—  .  X 

The  engineering  nodel  of  rigorous  developto^t  work  Is  characterized 
by  a  number  of  dls tine t Ive^f eatures  that  contrast  it  with  ch^  kind 
of  developmental  activity  generally  carried  on  'in  practice-base^ 
and  pr^ctice-relafed  settings.  '  " 


First,  a:icl  ^ost  often  empljajsized  in  the  descriptions  and  dfefinitions 

of  this  nioJc'  of  development  is  the  systematic  nature  of  the  pro- 

cedure^^  us^d  to  create  the  outputs.    R&D  is  deKned  as  the 

''systematic  process  o£  creating  new  alternatives  that"  contribute  " 

28 

to  the  improvement  of  educational  practice;"    ^  the  systenuitic 

■  29 
adaption  of  knowledge  and  technology;       '^tha  systematic  use  of 

scientific  knowledge  directed  toward  the  production  of  useful  ^ 

materials,  devices,  systems  or  methods,  including  the  design  and 

30 

development  of  prototypes  aod  processes."-      And,  too,  it  is 

described  in  terms  of  providing  ''systematically  derived  "infona- 
m31 

ation.  ■  *  . 


^fnat  distinguishes  educational  RciD  as  a  source  of  change  is  its 
experimental  approach  —  an  insistence  upon  rigor  in  the  formu- 
lation of  problems  and  explanations  and  the  systeinatic  collection 

of  emtJirical  evidence  for  use  in  checking  answers,  developing 

'  '       .  .  ,    32  ' 

products,  and  devising-^appropriate  action,  ^    '  ' , 

Second,  included  ariong  the  various  systematic  procedures  used, 

and  an  essential  feature  distinguishing  R'^D  ,f rom  other^orms  of 

developrr^ental  activity  is  its  incorporatipn  of  systeriatic  methods 

of  inquiry,    R6D  is  often  described  as  "research-based"  or 

"research-linked"  developments    T!^is  usage  emphasizes  that  the 

cot^  activity-is  developmental  but  it'also  underscores  the 

,  critical  role  of  research  in  R^D  processes.    Research  is  descril>ed 

as  often  suggesting  and  leading  to  development  workj  and  supporting 

development  by  indicating  whether  or  not  and  how  well  an  butput 

V  ■  r 

works  under  various  circumstance's,  how  "Aiuch  better -it  does  or  does 

not  operate  with  one*  or  another  revision  or^  |rariation,  etc^  ^  At 

th^'  sa"^  time,,  the  rcisfcarclv-developruant  linkage  riay  flow  in  the 

reverse  dil^ction:    research  niay  not.ooly  lead  ^J^x-Oif  support  y 

development  wotk  but 'also  development  may  suggest  needed  research' 

to  uncover  why  things  are  or  are  not  working  and  how  a  product 

m^y  be  further  refined^  eUc.    A  key  tj'ait  distinguishing  RSD 

outputs  fro*  those  of  conventional  developmental  actiyit^y,  then, 

is  that  RSrD  outputs  are  carefully  tested  producfs  that  are  .  . 


supported  by      sound  research  foundation. 

Third,  develo^ent  work  in  tfiis  mode  is  directed  toward  Achieving 
prespecifiid  outcomes  known^r  esticiated  in  advance.    The  objective 
is  generally  stated  in  the  form  of  performance  specifications* 
■The  goal^s  to  froduc-e  an  output  that  will  perform  predictably,  to 
.a  prespecified  degree  of' success,* under  specif ied- conditions  * 
Development  ^work  on  the  product  continues  until  it  performs  as 
as  specified.    What  distinguishes  the  output^of  syst^.atic  R5tD, 
.then^  at  least  in  terms  of  the  ideal  mt>del>  is  that'the  output  is 
expected  to  perforn  with  a  "known  degree  of  success'^  in  bringing, 
aboyt  a  certain  out 
advisud  as  follows: 


3A 

,  aboyt  a  certain  outcome,      so.  that  a  prospective  user  can  be 


"If  you  use  (these  products)  w^th  (personnel)  who  have  been  ■ 
trained  to  perform  (in  these  ways    and  under  these  environniental 
conditions),  you  will  achieve  (these  results)  with  (these 
learners) .  ^ 

Fourth,  in  order  to  achieve  this  objective,  development  work 

+ 

proceedj5  in  a  syst'ehatic  and  sequential  raanner^  moving  in  a  smooth 
'progression  frorr>  prototype  design  (that  is  in  the  raost  rigo^us 
versions  of  R6D  often  the  end  prodyct  of  an  applied  research 
effort),  to  product  or  program  development *in  accordance  with 
detailed  specif ications >  to  evaluation  of  small  field  tests^  to 
revisions^,  to'^larger  field  testsi  to  nore  revisions^  to  an 
additional  field  test,^etc.  until  the  product  performs  in  accord 
with  t?ie  prespecified  performance  objectives.    The  process  is 
cyclical*    Products  go  through  successive  generations  of  revisions; 
e^ch  vcrfvion  ^  "ro^ijh  aporoxination  to  be  followed  by  a  series  of 
progr'essively  closer  approx iraax Ions, ''successive  approxarr^ations" 
to  the  performance  specif icaions  until  the  spec  evels  of 

Eiu:cc^s  are  achieved  or  "until  the  full  possibilities  of  a  given 
approach^arc  realized/^       As  described  by  one  developer  active 
over  the  past  decade;  m 
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"Development  is  a  process  occurring  in  a  finite  time  period  to 
reduce  uncertainty  regJIding  efforts  require*^  to  achieve 
prespecif^ed  outcomes*,  '  Developnien^proceeJs  over  timeCli^  ^ 

:t  aliong  dii 


aliocatihjg  and  reallocating"  effort  aiiong  different  uncertairtty-  \ 


reducing  possibilities,  as  activities  are  gpmpleted  and  knowledge 
37 

accumulate^-"  ^  -  / 

t    '  ■. 

Fifth,  as  implied  in  muoh  of  the  discussion  above,  decision- 
r:akin_g  in  the  systematic  R&D  inode  is  data-baseB,  with  empirical 
field  testing  and  rigoi^us  data  analysis'playing  critical  roles. 
Researchers  are  considered  key  menibers  of  the  development  tean.^  / 
So'-^.e  ^se  the  term  "applied  research"  for  what^  the  researchers  do. 
Others  prefer  the  cernj  "formatiye  evalOation-"  (Regardless  ot 
what  term  is  used,  systematic  R&D  is'' distinguished  from  less 
rigorous  developmental  activity  by  their  presence-.in 'the  davel- 
opniental  activity  by  their  presence  in  the  development  team  and 
by  the  fact  that  their  presence  insures  that  attention  is  given 
to  the  R  and  the  D  in  the  R&D  equation  (and,  with  proper  manage- 
ment, to  the  linkages  between  the- two)\    The  successive  revisions 
of  the  develop[;ient  output  are  based  on  empirical  field  test'^data 
that  ate  gathered  systematically  arid  analyzed  rigorously*  The^ 
evaluation  data  thus  gathered  are  used  not  only  as  the  ba^is  of  / 
RSD  decision-making  but  are  also  Expected  to  (provide  the  pot;jentiaI  

user  with  information  about  the  outcomes  or  effects  to  be  expected 
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fron  use  of  the  product  under  specified  implementation  conditions. 


:t  under  sp^^ifie 


The  development  process  in'  the  •systematic  R&D  E;iode,  then,'  is  one'^*^  ^ 

of  systematically  followed  seqjjential  steps,  ^recycling  of  develop-  $ 

nent,  evaluation,  and  revision  through  successiv'e  approximations,  '  - 

_u:>iT*t;  empirical  data  to  test  product  ef fe^iveness ,  and  moving 

progressively  toward  art  output  that  can' perform  at  prespeciMed 
.  *  '     -   *^  ,  - 

levels  of  effectiveness  which  can  be  indicated  in  advance  to 

.       ^  ^  I.  ■ 

inform  the  decision^-making  of 'potential  adopters  and  users^  -  , 

9 

As  a  consequence  of  this  processy  systematic  R&D  as  carried  out  " 


in  speciaTized  development  organizations  tends  -to  have  a  number 
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Other  distinctive  features  that  set  it  oEC  from  les$  rigorous**  " 
developmental  activl'^ty*    Contint^ng  our  listing^  then; 

Sixths  development  projects  implemented  in  accord,  with  this  model 
tend  ^to  require  large'  personnel  pools  and  heterogeneous  skill 
mixes  —  developers  of  various  kinds^  production  staff,  field 
researchers,  data  ha\d}.ers,  data  analysts,  liaison  workers  to 
-smooth  relationships  with  afield  si tes , -coordinators >  supervisors, 
and  managers  of  various  levels  in  an  aften  complex  organizational  ^ 
patterti.  -  *  - 

Seventh,  the^e  projects  generally  rcrquiro;  extensive;  cooperation 
between  th^  organisation  developing  the  product  and  the  school 
systen^s  agreeing  to  serve  as  field  sites  ^ 

Eighth,  as  a  consequence  of  all  of  tlie  above,  thest  projects  tend 
to  be  larg^e-sc^le  and  expensive* 

N'inth,  the  products  themselves  are  o^en  complex,  consisting  of 

many  and  varied  nodules  Qr  ^components,  and  often  several  forms 

of  medifi  as  well  as  pi;inted  Inaterials.  ,         ^  "  < 

Tenth,  given  the  ,scale  ^and  complexity  ox  thes  projects  and  their 
adherence  to  4  model  focused  on^  achieving  prespec^ied  objectives' 
ythe  mViagement^^'oTT^hes^  projects  Is  (^ten. highly  formalized,  usfng^ 
"chart^  and  sophisticated  management -too Is,  an^^ttempting  to^ 

adherS"'"E^tight  schedules-to  pe^it  effective  *coordination  of  the 
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work  o/  different  interdependentv  subgroups\ 

Finally,,  the  R6I>  node  tends^  to*  include  within  it  consideraDiort  of 
"user  t;y:;tem  qoiiditidn^*     Educational  R6D  ^theorists  Src  fond  of  ^ 
pointvlng  out  that  the  ultimate  objective  of  development  .work  is/ 
not  simply  to  produce  products  but  rather .to  produce  products  - 
that  aufe  usah le  wijihin  existing  operational  settings  and  that 
will  improve  education*        RfirD  outputs,  then,  must  not  only  ^be 
.^upportccf  by  dat.a  thcit  show  them  to,  b^^ipore  ctficient  and  more 


885 


effectivel  thap.  existing  alternatives*    They  must  also  meet  needs 
perceived  by'user3>       ways  practitioners  will  accept*  and  inust 
be  relatively  easy  to  use.   ^hi^  suggests  that  as  an  i^itegral 
part  of  the  processed'  of  project  selection*  product  design* 
development,  testing*  and  paclJaging  adequate  consideration  must** 
be  given  to  us6r  needs,  constraints,  (Jreferences ,  values teactf- 
ing  styies,  exis^ting- knowledge  and  skills,  and  problems  of 
dissemination  and  implementation*  ^  ' 

Clearly*  the  R&D  inode  is  considerably  more  complex  than  the 
practice-based/practice-related  developmental  activity  descrij^ed 
earlier.    There  is,  of  course,  some  variation  In  pattern  depending 
for  instance*  on  the  nature  of^the  outputs  being  developed  —  e,g,- 
tangible  products  vs-  harder-to-package  change  processes,  ,  But 
the  degree  of  complexity  in  conjfrast  to  the  single  teacher  working 
alone,  or  the  small  LEA  or  university  curriculum  team,  or  even  the 
textbook  writer  working  with  a  puljllsher  is  illustrated  by  the 
kinds  of  issues  of  concern  to  R&D  managers  regardless  of  the  form 
of  the  particular  output       e,g,*  How  much  research  is  needed  prio 
to  the  development  work?    How  much  research  c^n  proceed  parallel  , 
to  permft  initial  field  testing?    At  what  point  is  the  product 
sufficiently  developed  to  permit /initial  field  testing?    At  what 
point  has  the  product  been  tested  sufficiently  to  permit  dissem" 
ina^ijont    What  dissemination,  marketing,  and  implementation  fac- 
tors need* to  be  considered  throughc^ut  the  design  and  development 
phase?    At  wMt  point  does  the  responsibility  of  the  developer 
end  —  development?    dissemination?    installation?  ^  utilization 
and  maintenance? 


Outputs 


Elsewhere  in  this  volume,  we  have  discussed  the*outputs  of  eda^ 
cational  R^iD  at  great  length.       For  our.  purposes  here,  there  is 
basically  only  one  key  point  that  needs  to  be  unders<:ored.  With 
some  notable  exceptions  (i*e'*  exemplary  products  of  hi'gh  quality 
that  are  being  utilized  extensively),  the  products  and  .pjrogr^ms 
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p^du^ccd  at  great  expense  over  the  past  decade  or  sa>  by 
o8ucacioiVal  R&D -organizations  using  (to  varying  degtees)  the 
Rf^D  rnode>  have  had  relatively  little  impact  on  educational 
prac^e'         ,      4         *         '  ? 

There  is  little  in  the  way  of  -hard  evaluative  data  to  indicate 
how  many  products>  etc^  fall  into  each  category;  or  , whether  . 
thes^  are  even  appKopriates^-fategory  headings.    But  at  the  risk 
^of  being  called  to  task  far^^relying  largely  on  impressionistic 
evidence,  the  picture  appears  to  be  roughly  as  fol^lows: - 

Many  R&D^products  (nerhaps  ev^en  most  of  t^is  output)  are  generally 
viewed  as  mediocre  in  quality.     Some  (e,g,  >  the  much  acclfeimed 
Individually  Prescribed  Instruction  uniCs)'inay  be  high  in  quality 
but  are  far  too  expensive  for  school  systems  to  use.    Many  (if 
not  most  others)  have  been  unqbl£2  to  provide  persuasive  evidence 
that,  they  are  ^any  more  effective  than  existing  Alternatives 
produced  by  less' rigorous  ^nd  less,cost,ly  conventional  develop- 
mental activity.    Many  (perhaps  most)  are  collecting  dust  on 
shelves  rather  than  improving  education  in  classrooms  ™  either 
because  they  meet* no  perceived  needs  of  practitioners  or  because 
they  were  designed  in  a  way  that  made^^them  unacceptable  to 
practitionerSj  or  too  difficult  to  implement  undei4  normal 
operational  conditions,  or  simply  too  expensive  for  purchase 
and  use  by  LEAs  given  their  serious  current  budget  constxain  ts  ,■ 


There  is  also  a  significant  number  of  "exemplary  products each 

45 

reporting  use  by. thousands  or  even  several  million  students. 
It  seems  noteworthy,  though>  tTtat  30  or'  so  products  aroi^ repeatedly 
pointed  to  in  this  eKcmplary  category  while  a ^1975  NIE  survey 
tabulated  data  on  as  many  as  776^^0E/lUE  sponsored  products'*  -, 

>^       ^  ■  '  ' 

E.    -Stsren^ths^Advantages  *    '  ^ 

Where  systematic  RSD  is  don^  well>  this  mode  has  several  advan- 
tages ovet  other  kipds  of  develt)pmental  activity* 
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Eirst,  outputs  are  presumably  better  in  quality  since  chcy;^i*Ve^>t 
ofl  Strong  empiflcal  foundations>  have  been  extensively  tested 
afrd  reEined,  and  are  presented  to  potential  users  with  evajuative 
evidence  indicacLng  wliat  Segree  of  success  is  likely  to  bjG  ' 
achieved  under  what  conditions. 


Second  >  t;he  outputs  are  presumably  better  because  of  the  Jiigh  ^ 
quali;:y  resources  used  in*  the  process'.    Professional  devo'lopers 
with  strong  expertise  in  their  fields"  <^vote  100%  pf  their  pro- 
fessional time  to'  their  develop;nent'ifoles  and  redteive  considerable 
support  froni  other  members  of  their  teams  who  might  havfr'other*. 
sp^ecialites  called  for  in  a  given  project:    The  outputs  are  pre- 
S'.irr-jbly  better,  too,  'because  (development  specialists  ftinctionin? 
in  specialized  development  organi:;ations  are  more  likely  to  keep 
up  to  date  with^  development  state-of-the-^rt ,  and  reflect  this 
in  their  work. 


\ 


Third,  the  products  are  presumably  better  because  they^have  ^en 
designed  with  nationwide  dissemination  and  imgl^ericatipn 
siderations  in  mind  and  therefori;  packaged  with  sufficiently 
elaborated  ^implementation  supports  to  permit  practitioners  across 
the  country  to  use  them  effectively. 


And  finally,  since  they  were  produced  for  nat^^wide  di^seminatioh^ 
presumably  such  outputs  would  find  their  wayHnto  central  repos- 
itories or  nationwide  dissemination  or  marketing  pipelines* 

F.     Weakheses/Dls'aTlvantages  / ' 
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»  Given  the  poor  quality'-of  rarf^t  of  what  has  been  produced  by 
educational  K^D*  this  m^prfe  of  development  work  must  alsl)  have 
some  serious,  weakne^^s  or  disadvantages  relative  to  other  forms  * 
of  developjmental/^tivity.     In  considering  these  weaknesses  we 
must  distingL>ish  between  those  weaknesses  that  ^re  gerfferlc  to  . 
the  RSD  mp^e>  regardless  of  the  field  "in  which  it  is  applied, 
and  th^erse  that  are  contextual*  i*e<,  pecultLar  to  the  education 
sec-cor . 


^  * 


t1 
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a>      Generic  Weaknesses 

There  are  at  least  three  significant  weaknesses  generic  to 
the  R^Dmode,  regardless  o£  the  field  in  which  it  is  applied*. 


rst*  it  suffers  fronrits  isolation  from  the  user  system. 


Since  the.  work  goes        in  specialized  development  organ- 
izations external  to  the  operating  system*  and  is  carried 
*out  by  development  specialists  who  are  not  users  and  spend 
little  if  any  time  eit^her  with  users  or -working  ^in  the  user 
setting,  there  are  substantial  risks  that  the^woi^  produced 
^^ill  inot  reflect  use^>f^e^^ds,  tastes,  or  reqtiiren^^ts  -  The 
^  consequences  may  ber  that  these  externally  developed  R&D 

outputs  will  not  be  adopted  or  used*  or  that^they  will 
require  substantial  adaptation  to  ^ake  them  usable  in  the 
operational  setting.    A  further  difficulty  resulting  from 
the  location  of  R^D  outside  the  us)er  system  is  thfe  conse- 
quent need  for  dissemination  or  marketing*  and  the  problems 
and f costs  this  may  entail.    In  ad^dltion*  these  problems 
nfey  be  f ufther'intensif ied  by  the  likelihood  that  potential 
asers  ;nay  react  to  any  externally  developed  products  in 
terms^of  the  all-toO-familiar  "not  invented  here*^  syndrome. 


Second*  given  the  organizational  complexity  of  mosi  projects 

carried  out  in  the  R&D  mode*  communication  problems  tend  to 

be  considerable  and  there  is  often  serious  attenuation  in 

the  ex<5^tement  generated  by' a  particular  conception  or 

prot(^type  from  the  time  it  leaves  the  hands  of  its  orig:^jnator^ 

to  the  time  it  goes*  througb^^  the  various  phases  of*the  R&D 

cycle  and  is  ready  for  distribution  to  users-  Evidence 

suggests  that  these  problems  are  reduced  considerably  if 

the  originator  of  an  idea  continues  working^with  tlje*T>roject  * 
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from  its  beginning  to  its  v^ry  end.       HOwever*  the  organ!- 
ixational  climate  6f  tightly  managed  R^D  .projects  is  often 
Incongruent  with  the  styles  and  taVtes  of  some  creativie 


'talents*'  and  the{e  may  be  substfintial  difficur^ies  in  trying 
to  attract  comzept  originators  to*such  projec-ts*  or  to  keep 
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them  Chere' for  any  length  of  time. 

An^^hird^  systematic  R&D  is  generally  very  costly. 
According  to  one  source  citing  experience 'from  industry^ 
it  tskes  anywhere  from  five  times  to  eleven  times  as  much 
money  to  develop  an  application  from  a  research  finding 

as  it  costs  to  conduct  the  research  that  produced  the 
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*f;Lnding*       Qf  course,  i»f  the  development  output  is  a 

superior  product^ that  is  eventually  widely  used»  the  costs 

are  amortized  ovei^  the  large  numbers  of  units  produced  and 
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the  per  unit  costs  nay  not  be  prohibitively  high,     ^  But 
that  assumes  the  production  of  an  putput  that  is  widely 
used  —  something  achieved  In  relatively  few  cases  by 
educational  RW)'to  date.  '  ^ 

&.      Contextual  Weaknesses  ^  § 

!Jany  of  the  weaknesses  of  the  s>tstematic  R^D  mode  are 
traceable  to  weaknesses  peculiar  to  the  education  sector  - 
weaknesses  in  both  the  operating  systiim  and  the  R^D  sys- 
tem.   The  weaknesses  are  of  several  types. ^  We  consider  at 
some  length  throughout  this  volume  the  manner  in  which 
educational  R/D6[I  suffers  from  the  immaturity  of  its  per- 
sonnel,and  institutional  ba^:    there  are  some  strong 
development  organizations^  but  only  x^atively  few> 
especially  in  comparison  to  such  otfter  fields  as  health; 
and  there  are  personnel  doing  developm^t  ^wor^ 
relatively  few  .trained  in  the  development  process. 
Conceivably^  over  time»  with  3  sufficient  infusion  ^f  fund 
(and  wisdon)  into  the  enterprise,  and  sufficient  learning 
tirr.e,'  these  weaknesses  in  tjie  personnel  and  Institutioni^l 
base  of  the  RSiD  system  may  be  less  readily  identif iaj>le  as 
weaknesses  of  this  mode  of  developmeijt  in  the  education 
sector. 


More  critical^  because  so  much  mo^je  intractable^^  are  weak- 
nesses traceable  to  th<^mmaturity  of  the  knowJ,edge  and 
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technology  bases  of  educa,tion  as  a  field  of  knowledge, 
educcition  as  a  practice  field,  and  educational  develop-  - 
ment  ^  aa  R/DSI  specialty.  ^  The  seriousness  of  thesje 
difficulties,  and  their  implications  for  the.R^D  process, 
can  probably  be  grasped  mosC  readily  if  we  consider  firsts 
the  maturity  of  educa^tion  as  a  field  of  knowledge. 

T^e  R&D  ^<Jel  from  industry  assumes  thaE  complex  problems 

can  be  broken- dotvTi  into  **a  large  number  of  relatively  well 

defined,  small,  but  critical  problems, This  requires 

substantial  understanding  of  the  parameters  of  the  problem 

to  the  Solved,  the  phenoniena  to  be  manipulated,  the  , 

t^byervations  to  be  made,  the  measurements  to  be  taken,  tlie 

decision  rules  to  apply  in  interpreting  findings,  etc* 

And  it  assumes  the  .existence  of  strong  measurement 

instruments  and  methodologies  for  carrying  on'  the  process* 

How  much  research  is  needed  as  part  of  the  development 

procesvs,  hov  long  it  t^kes,  and  at  what  costs  are  related 

to  how  much  dependable  knowledge  alreadjr  exists  as  a 

basis  for  the  development  process  and  hov  <es^f ectiv^  the 

available  technological  *tpols  are  for  making- ttfS^equired 

measurements  and  manipulations*  ^ 

'  f 

i 

l^ere^  there  is  a  weljl  developed,  mature  knowledge  and 
technology  base  that  is  relevant  to  the  problem  at  hand, 
the  developer  s  role  is  largely  orte  of  translation: 

The  developer  translates  the  variables  of  the  practical 

problem  into  thife  variabiles  of  the'relevant  body  of  science,. 

TTiakes  the  necessary  measurements,  determines  '.jhat  predictions 

and  cbanges  of  state  ai'e  implied  by,  the  goals  of  the 

practical  pi^oblem,  and  idenCif ies^of  adapts  the  formulae 

required  by  the  solution.    Those  unknowns  that  exist  in  the 
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problem  can  be  readily  transformed  into  known  variabl^^ 


In  this  situation,' relatively >little  research  must  be 


f 


unUertaken  as  pact  of  the  development  process, 


\ 


However,  where  (as  in  the* case  of  education)  there  is  little 
relevant  d^endable  knovrlcdge  to  work,  witlj^and  little  valid 
instrumentation  to  employ^  the  situation  is  one  where  the  * 
unknoivns  in  a  problem  are  far  more 'numerous  than  the  '^nown^' 
-and  it  is  difficult  to  make  depend&ble  predictions  or 
manipulations*    Consequently^  a  considerable  amount  of 

research  and  Analysis  must  proceed  along  with  the  develop- 
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ment  vork  as  an  ^tegral  part  of  the  process. 

In  addition^  there  are  other-f^tors  that  make  it  f ar"  inore 
diificalt  'to  translate  perforrnance  specifications  into 
effective  products  in  the  education,  ssotor>  and  suggest  ths 
need  for  extensivfe  inquiry  on  product  implementation  as 
part  of  the  develo|^ment>  packaging^  and  installation  process. 
As  compared  to  most  other  fields^  outcomes  of  product  use 
in  education  tend  to  be  less  predictable^     In  part>  this  is 
attributable  to  the  limited  technical  capability  of  many 
practitioners  to  implement  complex  innovations  vithout 
substantial  itnplementati^on  support  and/or  assistance*  In 
parL^  though,  the  difficulty  %s  due  to  the  nature  of  the 
interaction  between  the  useir  (e.g.>  the*  teacher)  and  the 
product^    Teaching  is  a  craftlike  practice  field  rather 
than  d  tecl^ology4jj      Instructional  approaches  and  tlaeir 
delivery  are  highly  personalized.    Two  teachers  using  the 
same  Instructional  program  or  set  of  materia1:s  are  likely 
to  present  them  somewKat  dif feren^tly^  incorporating  their 
understanding  or  what  is  to  be  taught  and  how  into  their 
own  per3'>nal  teaching  styles.    The  consequence  Is  to 
increase  the  unknowns,  in  the  R&D  process^  requiring  additional 
inquiry  on  implementation  as  part  of  the  development  and 
packaging  process. 

■     ■         .  I' 

l^ereas  the  engin^riog  model  of  R&D  assumes  definable 
component  problems^  and  prespecifi^d  out/comes  for  ea^,  the 
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outcomes  of ^inquiry  cannot  be  predicted  in  advance .  Research 

I 

may  lead  in  different  unkno^^m  directions  —  soae  Mind  ctllciys 
sone  wholly  new  unanticipated  avenues  may  be  opened  up, 
'branching  off  in  various  directions,  etjp.  Consequently, 
detailed  planning  and  tight  scheduling  V-  the  hallmarks  of 
sophisticated  management  techniques  —  become  impossible  to 
adher^to.    The  failure  of  attempts  to  borrow  suclwophist- 
icated  management  technologies  as  PERT  from  industry^^nd 
apply  them  to ^educational  R&D  underscore  the  difficulty. 
Sophisticated  planning  tools  make  little  sense  when  applied 
to  contexts  where  we  have  relatviely  crude  understanding, of 
L.ic  phenomer^a  to  be  itar.iijulated  or  the  "isvelopnental  activiti 
to  be  planned, 


I 


Other  difficulties  are  traceable  to, the  weaknesses  of  the 
knowledge  and  technology  bases  of' education  as  a  practice 
field  «and  development  as*" an  "R/DSI  specialty.    As  an  immature 
craft,  education  has  a  relatively  underdfeveloped  body  ot-^^x 
craft  knowledge  to  pass  on  from  practitioner  to  practitioner 
and  inadequate  organizational  arrangements  to  support  the 
creation  of  such  craft  knowledge  and  its  transmission.^^ 
From  the  craft  perspectiye,   the  critical  point  of  interven-  ' 
tioQ^  for  the  improvement  of  Educational  practice  is  not 
producing  more  -fcientific  research^about  educational  pro- 
cesses or  better  materials  or  products  for  educators  to  use, 
but  rather  the  improveniei^t  of  the  field^s  experiential 

knowledge  base  and'a  sharpening  of  practitioners*  skills 
i 

and^ the  types  of  judgments  required  by  practice.  The 
implication  of  the  craft  perspective  is  tha£  the  RSD  emphasis^ 
on  developing  programs  or  products  for  practitioners'  xise 
before  developing  the  capacity^of  the  practice  system  to 
effectively  use  these  products  is  putting  the  cart  before 
the  horse,  ^nd  Inevitably  'dooming'  most  R&D  products  to 
failure  in  the  operational  setting:  ^ 

because  craft  knowledge  and  the  varied  orgatii^^ations 
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,  which  support  it  are  in  a^stace  of  sucih  weak  development  i 

the  fields  %t  practice  in  education  aye  only  marginally  ^ 

able  to  scrtitiniz^,  criticize,  raodify  and  use  aew  knowl" 

edge  arising  from  social  science  or  technology*  Thus 

practitioners  mostly  have  neither  th$  ticie\  the  training, 

the  professional  resources  nor  the  organizational  supports 
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for  such  scruLiny  or  absorption/'* 

"The  R£(D  perspective  ijt  education  has  been  modified  somewhat 
over  the  years>  increasingly  taking  into  account  the  key 
importance  of  the  practice  setting.    The  notion  that 
"teacher-proof*'  materials  could  be  developed  by  educational 
R4D  has  gone  into  general  disrepute.    There  has*  been  sub- 
^  stantial  recognition  of  the  importance. of  teachers*  tech- 

nical, competencies  in  planning  for  product  installation* 

4 

And>  increasing  awareness  of  the  critical  effect  of  the 
,  ,  interaction  between  the  produce  and  the  user . (defined  here 

as  Che  practitioner)  has  led  to  a  shift 'in  emfrfiasis  from 
the  notion  of  product  adoption    (as  produced  and  packaged 
by  the  developer)  to  product  adaptation    in  specific 
operational  settings. 

Even  so>  if  one  accepts  the  craft  perspective>  all  other 

* 

things  being  equal, r^elatively  little  impact  can  be 
expected  in  the  form  of  improved  student  performance  as  a 
result  of  the  use  of  RiiD  fJroductS  by  school  systems,  unless 
substantial  resources  are  focused  first  on  the  strengthening 
of- educational  practice,    Tlie  dtata  of  the  art  of  educational 
practice  s^tands  between  the  ^roduct  aijd  the^scudent  as  '^end" 
user";    the  R6D  program  or  product  must  be  delivered  by  the. 
practitioner,  whose  ability  to  do  so  is  limited  inevitably 
by  the  immaturity  of  the  craft.    The  provision  of  triiinihg 

i  programs  specific  to  each  R&D  product  to  be  implemented 

m  becomes  a  patchwork  affair,  effecting  limited  payoff*  *A 

particular  product  may  have  slightly  mo^re  chance  of  sucpees  . 
*  iB.  achieving  its  intended  effect,  but  it  is  likely  to  have 

Q  ^  *     little  effect  on  increasing  the  likelihood  of  success  for 

ERIC  . 
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the  next  product  to  be  implementtid .    ftore  substantial  payoff, 
oveA:  the  long  run,  ^  could  be  expected ,  according  to  this 
arguTTient,  by  direct  support  to  the  strengthening  of  practice, 
so/  t^at  some,  time  in  the  future  new  approaches  (from  R^^D  or 
ot,her  sources)  tcquld  he  absorbed  ef^fectively  and  efficiently. 


;re  oie  'St; 
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Regardless  6i  where  one  'Stands  in  this  debate,  the  i^Tiinaturity 
c^Ti,  educational  pragitiee  has  undeniable  significance.  Given 
th'e  immatarlty  of  the  practitioners'  craft>  practitioners  • 
.  not  only  find  it  diCfitul%-to  incorporate  externally  developed 
innovations  into  their  pi;actice.    They  .also  find  if  difficult 
to  specify  ;;hat  they  ne(^d;  developers  have  a  hard  tine 
developing  a  clear  sense  of  the  require^ients  of  the  practice 
setting>  and  the  critical  "fine  tuning"  that  is  the  essence  ^ 
of  the  R^D  proems  >  making  the^prpduet  fit  closer  and  closer 
tcj  the  user's  needg  >  is  majie  all  the  more  difficult.  * 

The  problem  is  complicated  further  by  the  immature  stat^  of 
the  art'of'R^D  technology  in  the  education  sector,  Theie 
are  two  problems  here.    One  is  si'mply -that  the  technology  ^ 
is  not  yet  mature>  i-e.^  the  development  state  of  the  art 
in  education  appears  (;o  be  relatively  low  compared  to  more 
mature  fields.  A  second  problem  is  that  few  educational 
develSpers  appq^r  to  be  sufficiently  versed  in>  or  able  to 

keep  up  withj  the  development  state  of  the  art,    l^Tiether  or 

y  t 

*  not  it  is*  even  possible  to  develop  a  specific  product  is 

determined  by  what  the  sta^te  of  the  art  permits.  Whether 

*  or  not  a  product  should    be  developed  also  depends  on  the 
s^ate  of  the  art>  for  there  is  no  point  in  developing  a 
product^  "that '  is  in  fact  obsolete  if  the  state  of  the  art 
permits  a  superior  product  to  be  developed.    In  education>  ' 
developers  as  .well  as  'practitioners  fiften  seem  to  be 
"reinventing  the -wheel"  or  developing  inferior  products  that 
seem  obsolete  before  they  are  even  ready  for  distribution^ 
The  reason  simply  is  that  educational  developers  do  not 

seem  to  be  as  profjassional  as  they  might  be.    Most  developers 
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seem'not  to  Itnow  what  other  developers  are  doing  or  can  do. 
'  Even  if  one  were  i?hcltned  to  keep  up  with  the  development  ^ 
state  of  the  art>  this  would  be  difficult  to  do  in  educationc^l 
R£(D.    Tli^re  is  little  codification  of  development  knowledge 
or  technology>  the  kind  of  codification  to  which  developers 
■could  turn  and  on  which  they  could  rely.    There  is  an 
absence  ©f  ''handbooks.**    Lacking>  too,  are  distinct>  dis- 
create,  development-relevant  categories  that  might  facilitate 
informatiojfj  searches^  -  ^  * 

As  a  result  of  all  these  fact^^>  R&D  in  the  education  sec- 
.tor  is  ^  father  different  pheiionenon  iroir.  R&D  in  inaLur^  fields 
with  strong  knowledge/technology  bases.    In  mature  fields> 
users  can  clearly,  specif y  \^t\at  they  need;  developers  and 
producers  know  exactly  what  the  user  means;  the  developer  is 
then  capable  of  producing  the  product  and  saying  with 
assurance  *  to  the  user,    "Here  is  what  y,ou  asked  for;"v  and 
it  is  ttien  obvious  to  users  what  to  do  with  it.    As  an  example,, 
an  airplane  manufactOrer  may  well  be  able  to  specify  so  . 
clearly  the  requirements  for  a*  needed  airplane  part  that  the 
part  cant  be  developed  to  specifications  and  then,^in  effec^t 
simply  be  "plugged  in/^    In  edacatlon>  however>  the  typical 
situation  is  one  in  wijich  the  user  cannot  clearly  tell  the 
developer  what  is  heeded",  and  t'^e  developer  is  not  certain 
^  how  to  interpret  what  the  user  says  he  needs;  even  if  the 
user  could  provide  clear  specifications,  the  developer 
probably  would  not  know  how  to  develop  the  product  or  pror 
gram,  and  once  developed,  the  user  mi^ht  not  be  certain  what 
to  do  with  it.^^  '     \  f 


In  mature  fields,  \fhe  /pansformations  from  stage  to  stage 
of  the  development  cycle  tend  to  be  largely  translation 
processesj  translating  one  set  of  unknowns  into  another> 
performing  a  few  manipulations  to  translate  unknowns;  into 
additional  knowns  to  solve  a  problem.    In  education,  however> 
where  the  unknowns  are  so  numerous  (and  the  knowns  so  few),* 
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tlie  process  is  far-more  complicated.    The  transformations 
from  stage  to  stage  of  tKe  development  cycle  rcquire'm^re 
than  simple  translation.    Considerable  amounts  of  inquiry 
are,  likely  to  be  required  before  one  can  move,  for  insjcancG, 
from  concepti'bn  to  proto'type,  from  prototype  to  full  scalie' 
deviclopment,  froni  unearthing  of  implementation  problems  in 
field  Cest  sites  to  devising/appropriate- rQ;^lsions,  from 
initial  pacjfage  to  packaging  in  a  form  that  can|^e  readily 
dissetninated  and  impleitiented  easilyvjand  effectively.  *^ 

,As  a  consequence  of  these'dJf ficultiesj  development  work 
in  education  .requiices  a  far  greater  investment  of  time  apd 
money  in  the  research  and  evaluation  components  oj  the  k^tO  '  - 
process  than  would  be  the -case  in  fields  ^itj?  strong 
knowledge/ technology  bases*    R£(D  costs^in  edtication>  then,  ,^ 
are  high  relative"^  to  practical  payoffs.        And', ^ regardless 
of  cqst,  the  impaction  "en_d_- users'*  (i.e/>  students)^  is  ■ 
inevitably  severfy^'liraited  by  the  immaturity        the- craft 
}cnowledge  that  supports  educational  practice/ 

Given  all  of  the  above,  it  may  simply  be  that  the  * ^bstantial 
f^cleral  investment  in  educational  R^D  over  the  past  decade 
or  so  may  have  been  premature.    The  knowledge  and  technology 
base  of  education  as  a  fideld  of  knowledge,  e<Jucation  as  a 
practice  field,  and  development  as  an-R/Ctl  specialty,  and 
tf^-^^rsonnel  and  institutional  bases. of  educational  R&D,    .  ' \ 
may  simply  not  have  been  sufficiently  mature  to  enable  the 
funds  to  be  put,  to  effici^ent  use  on  the  scale  with  wl^ich 
they  were  allocated.     ^  ^  ,  ' 

We  will  explore  some  possible  policy  implications  of  this 
conclusion  later  in  this  chapter.    For  th^  present,  let  us, 
turn  to  the.  mixed  itiode,  0hich  has  cetiie  to  increasing  prom-^ 
inence  in  recent  years  as  the  strengths  and  especially  the 
weaknesses  Of  eaeh  of  the  p^reviously  considered  mode?  ha^e 
"become  all  too  apparent. 
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_yhe  fortune  of  systematic  R6d)  iii'the  education  sector  appear  now 
to  be  on  the  decline.    The  reaction  that  has  set  in  Reflects  the 
view  that  the  systematic  R&D  mode ^as  been -insufficiently  responsive 
to  operating  system  needs  and  requrements,  has  failed  to  produce  a 
sufficient  tftipibei|i  o^high  quality  outputs,  and  has  been  far  too 
costly  relative  to  the  slim  payoff, 

The^  cycle  has  turned  full  circle.    Initially^  the  case  was  made 
that  specialised         oi^jani^aticcis  dKterjial  to  Vtie  operating  system 
ware  needed  because  few  schools  were  innovative  and  opeiating  system 
cociditions  tended  Co  be  inimical  to  innovation,    NowT  ^>^^  behalf  of 
various  mixed  modes  of  educational  development,  increasing  recpg--  ' 
nition  is  being  ^iven  to  local,  practice-based  innovation  as  alive 
aft  well  in  niany  school  districts  acro&a^the  country.    The  potential 
tif  the  various  mixed  m^des  wouH  see:n  to  be  that  thejc  a^emf^t:  to  . 
build  on  the,  stre^ths  of  both  practic&^based  development  and 
systematic  RM)  while  overcoming  soate  of  the  ^^eaknesses  6f  each. 

Settings|and  ^er Sonne  I 


The  wor  k  done  in  mixed  develop:nent  modes  generally  spans  a 
.  r^jnge  of  settings.    Although  thefre  is  some -variability  in  tbe^ 
later  stages  of  the  process,  what  ali  variants  seem  to  have  iii 
conmon  is  the^  inilS^atioa,  of  the  d&v$lopaental  activity  in  prac- 
tice-ba^'ed^siittiJrgs.    A  ke^  element  in  this  approac^Ji  i'S  prac- 
.tition^r  develoj^ant  of  conceptions  into  progra;n^  or  pifojects 
yhfch  come  (by  one  means  or  oth^r  )to  be  Idehtificd^gjg^  ^'eK'--  " 

^j^emplary"*  ihd  wox-thy  of  diffusion  to  other  practitioners.  What 
^  <L  tends  to  distinguish  this  ap^oa^;^!  frotn-the  practice-b'a^ed -mode 

.  'we  considered  earlier  is  the  continuation  of  R/bficI  processes 
past  the  point  of  th6  developmental  Activity  that  Ifed  to  the 
establishment  and .  demonstration  Vf  the  exemplary  prograTi  at 
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its  site  of  origin.    Generally*  this  mode  includes  \arioLis  vali- 
da^ingj  packaging*  ^ud/or_ d isscmination  mechanisms  loceted  in 
various  other  settings  exterfl^l  to  the  originating  school  district* 


The  validation  stage  is  intended  to  provide  a  quality  control 
mechanism  for  the  practice-based >  mixed  mode  development  work> 
The  validation  work  generally  invol^^es:     (aX  gathering  informs- 
tion  abf>ut  t^^  effectiveness  of  the  exemplary  project  (from 
evaluation  findings  produced  by  LEA  personnel  and/or  third- 
pa'rty  evaluation^  cont]factors) ;  and  (b)  assessing  the  worthiness 
of  a  given , pro gr^Ti?.  for  .dissemination  as  judged  by  the  signifi-  . 
Cance  of*  the  program  and  the  soundness  f o  *^h6  evidence  in  support 
of  its  effectiveness. 


Etife 


The  validation  work  can  be  carried  out  in  any  of  several  settings; 
(a)  SEAs  have  become  increasingly  ^tive  in  the  identif ication> 
validation>  apd  dissemination  of  exemplary  program^  developed 
by  LEAs  within  thetr  state* boundaries .    States  with  particularly 
strorig  ^programs- have  specialized  staff  assigned  to  Che  validation 
function*^    (b)  In  the  *60s>  OE  established  a"  bissemination  Review 
Eaael  to  assess  the*  ?^aimsr,made  for-^^xemplary  programs  developed 
with  OE  funds  and  identified  as  worthy  of  further  fed^al  funding 
to  support  their  dissemination*    Since  the  creation  o^  NIE>  this 
has  become  th^  Joint  Dissemination  Review  Panel  ( JDRP) >  which 
reviews  program  evidence^ and  approves  programs  for  dissemination* 
,(c)  Following  the  Consumers^  Union  type  of  model>  some  indepen- 
dent  private  .sector^  (gpganizations  review  evidence  on  programs 
and  products  of  various  kinds  and  submit  repKjrts  assessing 
the  relative  merits  of  eachi    The  Educational  Products  Informa- 
tion  Exchange  is  a  good  example  qf  this  pat.tern* 


nnel  who  carry  o^t 


The  personnel  who  carry  6^t  this  validation  work  may^or  may  not 
have  full-rtlme  rgsppnsibilities  for  validation  functions*  Cer- 
tairUyMiti  the  case  of  the  JDRP>  thisflprk  takes  only  a  small 
percentage  of  the  time  cif  the  participating  members*  Ht)wever> 
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whethl^r,  carrying  out  validation-responsibjllit^ies  as  a  full-time 
or  part-time  responsibility,,  o.ur  impression  is  that  the  personnel 
assigned  to  this  work  gen*erally  have  Scane  specialized  expertise 
iri  assessment  o^evaluation  research  findings  or  have  access"  to 
staff  with  this^nd  of  specialized  expertise.  ^ 


The  disse^nation  activities  connected  wi£h  .this  m^>^e  may  be 
carried,  out  by  any  of- a  large  number  of  public  or-private  sec- 
tor, organisations       through  state  dissemination  networks;  ^ 

+ 

through  the -ERIC  system  and  its  hookups 'across -  the  country  with 
$du(aation  information:centers>  .education  information  agents> 
faciiitatorsj  and  och^r  kinfris*of  change  agents;  througti  such 
"OE-funded  mechanisms  as  tae  National  Diffusion  ^twork;  etc» 
The  personnel*  ir^Volved-^  c^r)d  to  be  a  new  breed  of  dissemination 
specialists^    In  soma  cases>  notable  the  Rational  Diffusion  "^Net- 
wark,  the  initial  program  developer  may  be  actively  brought 
into  the  process       difeseminatirtg  a  given  program  and  assisting 
in  its  implementation  at  k  new  site.  .     ^  * 

Our  imprt?ssipn  is  that  rfelatively  little  packag^^^Jg  of  exemplary  . 
projeccs^actually  takes  place,  and  that  for  the  fhost  part  this 
mode  relies  on  th^  dempnstraticm  strategy  and -interpersonal 
communication  to  convey  the  prototype  program  to  potential  adop- 
ters.   Conceivable,  where  |)ackaging  is  included  in  this  mode,  it 
could  be -carried  ^  out  by  the  specialized  development  prgani'zaCions 
that  now  perform  systematic  E^^D.    We  will  have  more  to  say  about 
this  late;--  '       ^  .  '      ^  \ 

■  ■  .  4  ' 

,  '  4 

'        '      '  '    '       ■       .  V; 

^  FunHing  Sources        ^  ^     .  ' 

Most  (if  n(Jt'all)  work  carried  .Qut  in  the  Aixed  mo^e  appears  to 
be' suf)ported- by  "sj>^e  ami/or  federal  fund'lng*    Although  the  ini- 
tial  developmental  work  on  an  exemplary  program  may  have  been 
carri€<J- cTitt  with  no  s;>^ciali^cd  funding,  or  under  the  auspices 
of  one  or^^nother  stat^  or  federal  categorical  funding  program. 


-900 


tho  identification  ef*programs  as  exemplary  artel  their  validation, 
packaging*  and/6i>_  d issemination  are' geoetally,  supf^ortod  with  s'pe- 
cial^zect  di&semination  allocations,' 


Some  few  states  had  strong  ^programs  o£  this  kind  before  'the  federal 

government  toojc  an  active  irrteres^  in  EurtJhering  this  m^e  of 

R/D&I.    Others  developed  these  programs  over  the  last  7r-8  years 

with  federal  (OE  and  th^  NIE)  seed  noney  provided  to  suoport 

62  ' 

dissetr-inatrlon  capacity-building.        Evan  where  private  sector 
organizatiqns- (such  as  EPIE)  arer  it^volved,  their  activities  are  J 
.generiTIy  supported  by  f ederalr^^rdnts  c»r  contracts. 

 >Iixed  Mode  r/d&I  Processes    *         .  ■ 


^^ei;a 


What  makes .  the  Jifl^ted  mode  distinctive  are  not  the  R/D&I  p/o<3fesses 
used  *but  rather  the  set;tingi3  where  t;he  vaifioiis  stag'^s  of/the  """f 
l^eajall  sequtenre  t^ke  place.    The  Initial  developmental  ac  tivity 

ers  little  fron  the  practice-based  development  mocte  we  con- 
sidered, earlier.  ,It  is  cii'ried  out  by  practitionera/worktng 

within  the  operational  setting.    Generally,  it  is  undertaken  to  , 

V  /  '  * 

meet  a  particular  need  o£  the  part;lcular  school  system  where  the 

*  ^ / 

work  is  carried  out.    The  program  is  rarely  viewep -by  Its  develo- 

'  I  '  * 

-pers  (at  least  durirtg.'^the  initial  developmental  ^hase)  as  a  pro- 
totype'to  be  developed  further^  Eor  national  use/ or  as  an  e^en- 
plary  program  to  be  disseminated  and  used  else^ihere.  However, 
what  occurs  after  the  initial  developmental  s£age  distinguishes 
outputs  produced  in  this  {Ttode  from  those  generated  By  the  prac- 
tice-based  mode*    Some  agency  or  organization  External  to  the 
originating  site  ,identi£i$s  the  f$6gram  as /'exemplary"  .and  then 
gath&rs  and  submits  information  about  thls/projecfe  to  some 
other  agency  or  organizational  unit  for  validation  of  the  pro-, 
gram's  claim$  of  effectiveness,  ^  If  the  nfirogram  passes  this 
"5t;age,  it  may  dj:  (more  likely)  ^tay  not  bje  sent  on  to  some  other 
organtzaitorr  or  organtstat^^onal  unit  for/packaging  of  one  kind 
or  anr-ither;    IVHtether  "packaged"  or  not/  Information  and  materials 
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on  the  program  are,  then  turned  ove^r  to  one  or^rcL-other  organiza- 

^  /A 

tio^_s  or  uni^^j  for  purp^s4s  of  disseminatitig  the  prograii^'On 

'    ""either  a  .stat^jwide  or  [f/tionwide  baais. 


Consequently,  this  gicuae  is  characterized  by  the  large  number  of 
organizations  and  personnel  involved  in  carrying  out  the  various 
phases  of  the  over/iil-  R/D£(I  process,  and  therefore  su)>starfti^X  \ 
Hiangerial  complexities- in  carrying  out  this  mode  well*  / 

The  Tifixed  mode  falls  somewhere  between  the  practice-ba^eW  and 

""styst-ematic  R£(D  modes  in:     (a)  the  -amount  of  evaluat±6n  data  pro- 

vid^ci;  (b)  the  extent  "of  "development*'  of  the  product;  ^tid  (c)  the 

costs  incurred ♦    Gene rail y^  though*  onfall  three  dimensions  (but 

ccrt^inly^  the  first  two)  th$  mixed  mode  is  closer  to  practice- 

bas^d  development.    In  affect,  as  presently  carried  out,  it  is 

only  a  moderate  extension  erf  the  practice-based  mode,  undertaken  - 

prinarily  as  ^  dissemination  rather  than  a  deyelofim^t  activity". 

>  ♦ 

D.  .  Outputs  ^  ^    ^    *  ■  , 

Tha  exemplary  programs  identified  with  the  mixed  node  have  re-  > 
ceived  mixed  reviews,  depending  on  who 'is  making  the  judgments 
and  w^a^t  crit^ia  they  are  using*    The  precise'  meaning  of  "exemr 
plary"'  has  defied  rigorous  definition  or  elaboration  of  -standard 
criteria.    Still,  ^t  least  in  comparison  to. most  educational  pro-* 
grans,  we  can  tentativelydescribe  them  as  relatively^  stronjg;  ^         ,  - 
all  outputs  identified  j^t^h  ^b^^  mode  have  been  screened,  judged^is^  - 
by  sOTie  body  as    exemplary",  and  validated  by  ^ome  quality        ^  , 
control  unit  prior  to  their  dissemination  for  broader  use, 

■J 

E,  SrcenRths/Advanta^es  *  ^  ^ 

The  mixed  mode  has  all  the  strengths  of  pragtice^based  develQp- 
ment:    »tliG  costs  are  relatively  low,  and  the  "outputs  produced 
reflect  user  needs,  and  operating  system  tequ Lrements , 
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The  mixed  mode  also  has  additional  advantages  that  overcome  sOfiie 
of  tiie  nost  s^irious  weaka^sses  of  practice-based  developmental 
activity.    It  does  produQO  some  evaluation  Infornation' to  pennit 
the  outputs  to_  be  asses^d>  and  it  provides  relatively  good  quality 
control  mec'hanisms  such  3iS  the  JDRP  or  SEA  validation  units. 
Since  the  validated  projects  are  generally  inpiit  into  sona  state- 
wide or  federal  dissemination  network  (e.g.;    the' >jational  Dif- 
fusion Network)  >  there  is  some  degree  of  documentation  of  the 
available  outputy'aftd  ^thert-  is  an  effort  to  disseminate  these 
outputs  more  broadly. 

And  finaily>  comparcsd  to  systenatic  R£,D  or  to  ^distributing  funds 
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to  LEAs*  to  permit  them  to  build  development  capacity>  this  mode 
may  provide  th^  most  substantial  payoff  per  dollar  of  public 
funds  invested^/  the  r;Lsks  are  relatively  minimal  sin'ce  'the  bulk* 
of  the  funds  are  invested "  iini  progr.ams  alreadyCin  operation  and 
identified  as/*€?5cemplary">  with  perliaps  relatively  small  sums 
invested  in  mechanics  tq  seek  out  and  ideatify  them* 

t^eaTcnesses/Pisadvantages 

Stillj  compared  to  the  best  of  the  .outputs  produced  by  systematic 
R&D>  this  mPde  also  has  one  significant  weakness*    Relatively  few 
of  the  mixedmode  program^* are  adquately  packaged  for  dissemina- 
tion  antj  uje  elsewhere>  increasing  implementation  difficulties 
and  the  possibility  that  initial  successes  will  not  be  replicated 
elsewhere*^  We  shall  return  to  this  point  below'    *   *  ' 


III,  POLICY  OPTIONS 


Despite. the  misgivings  that  have  been  voiced  about  the  quality  of 
educational  development  work  to  date>  the  substantial  investment  'that 
tidsNarrc^idy  been  made  in  educaticmal  R/D^I  ^ove^  the  past  two  decades 
soggests  that  investment  in  the'  developnient  function  will  conti'ftue, 
But  which  Tnode>»  of  developmental  a<:tivity  shall  be  supported,  to  what 
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extent?    And  what  kinds  of  policies;  are  mosC  lik$iy  to  s^trengthen  the 
d£?v;elopLnenr  ftinctioN  in  the  education  sector  and  produce  the  greatersC 
payoff  in  the 'form  of  improved  functioning  of -educational. institutions 
and  improved  performance  of  students?      ,  *  > 

4  * 

Preferences  for  one  or  another  of  the' thtee  modes-^f  development  work 
are  likely  to  reflect  one's  assumptions  about  which  factors  are  most 
important  In  e.^plaining^  the  poor  performance -to  date  of  the  operating 
y^tem,  on  th,e  one  hand,  and  the  educational  development  function,  on 
the  other-  :  ^ 

Ir  one  subscribes  t4^  the  view  tliat  the  most  serious  barrier  to  educa- 
tional  itnprovetnenc  has  been  the  inadequacy  of  available  materials  and 
^programs*  a^d  if  one.  believes  that  the  weakness*es  of  systematic  R£cD 
in  the  education  sector  ^are  largely  a  reflection  of  iicmaturi  ty  *  (and  are 
therefore  n^iither  inherent  nor  insuperable  barriers),  then  one  is 
likely  to  argue  for  substantial  investment  in'sy^tematic  R£cD  carried 
<>ut  in  specialized  developr^ent  organizations. 

One  is  likely>  on^-the  othgr  hand,  to  call  for  funding  capacity-building 
in- the  practice  setting  (and  with  it  probably  some  practice-basfed 
development  work)  if  ^ne  holds  to  a  diff<^rent  set  'Of  beliefs:  rthat 
the  key  barrier  to  educational  improvement  has  been  the  inadecfjiiacy  of 
the  experiential  knowledge  base  of  educational  practice  and  the  lack 
of^ organizational  Supports  for  developmetn  of  educational  practice 
as  a'cra£^;  and  that  educational  R^D^as  failed  in  part  because  deve- 
lopment  work  carried  on  outside  the  operating  system  cannot  bring 
j^bout  substantial  improvement  until  the  craft  of  cducationaj.  practice 
is  mature  enougn  to  absorb  externally  developed  technology.  ' 

*  *     •  ■ 

,If,  however,  one  sees  in  the  education  sector  B  substantial  amount 
of  local  innovation  and  exemplary  practice,  and  identifies  key  bat- 
i?iers  to  educational  improvement  as  inadequate  dissemination  of  exis-* 
ting  ^xenplary  practice,  then  one's  preferences  are  likely  to  be 
^oward  'the  mi;:ed  mode  strategy  (es,pecially  if  one  is  unhappy  J^ith  the 
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investment  thi^^t  has  been  made  in  systematic  R&D). 

,,If  recent  experience  is  any  indication  of  what  is  likly  for  l:he  near 
J     V     future,  all  three  modes  are  likely  to  continue  to  have  influential 

pro?K5nents  in  educational  policy  circles  and  all  thre^  are  likely  to 
receive  continued"support  (albeit  with  shifts  in  the  proportion  of 
the  av^ilaUle  funding  pie  allocated  to  each).    We  see  little^ to* be 
gained  in  trying  to  with  one  approach  against  thj|  others,  in  "search 
of  the  "one  best"  option.    Policy  choices  are  likely  to  reflect  value 

'  positions  and ^belief  systems  about  causes  and  effects,  at  least  as, 
iLuch  as  t*h^/  a;e  likely  to  reflect  wha-tever  imperfect  empirical 
^vi^ence  one  might  try  to  muster  on  behalf  of  one  mode  or  th^  other 
especially  since  all  three  must  be  viewed  at  this  time  rupre  as  emer- 
gent possibilities  than  as  mature  patterns  of  functioning  to  be 
»     assessed  xn  terms*of  evidence  on  past  performance.    Choices  ^ill 

reflect  th^  current  ^wlng  of  the  pendulum  favoring  one  or  anothQr  of* 
these  options  as  the  preferred  mode  of  bringing  about  educational 

improvement,  and  the  pendulum  is         ly  to  swing  back  and  forth,  re- 

64 

•   fleeting  the  continuing  "dialectic"  iVi  e«Iucation,        Besides,  it  seems 
to  us  tha,t  each  of  these  approaches  simply  emphsizes.a  different 
^   '       poinf  in  a  s^mless  web  of  interrelated  difficulties  in  th^  eduction 
sector^ . 

* 

Although  certain  kinds  of  strategic  considerations  might  suggest  the 
advisability  of  intervening  first  at  one  point  rathe^;  than  another 
(e.g^;    the  argument  that  external  Ri(D  cannot  be  absorbed  by  the  user 
system  until  educational  practice-matures  as  a  craft),  as  long  as  an' 
'    effort  is  made  to  take  into, account  the  whole  interrelated  web  of 

dif fij^Jlties  progress  at  any  of  &iese  leverage  points  would  seem  to 
^     be  possible  and  admirable*    Therefore,  they  key  question  wot^ld  seem 
to  be  not  which- of  these  modes,  should  b^  Strengthened,  >ut  rather  ■ 
\  how  we  may  strengthen  each,  and  what  mere  we  need"  to"  know*  before  we 
can  devise  policies  that  are  likely  to  be  .effective  in  achieving  th^s 
end^    Tlie^ipemainder  of  *this  chapter  focuses  on  these  maf^^rs, 

4  # 
h  ■  '  * 

Er|c   .  5b3  •  ■. 
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1.'       Strengthenini^  Svstemacic  R&D 

Given  the  we^iknesses  of  systematic  RfiiD  in  the  education  sector> 
there  would  seem  to  be  several  kinds  of  things  that  we  need  to  do  to 
strengthen  this,  mode  of  development  work. 

Firstj  to  Overcome,  the  isolation  of  this  mode  from  the  user  system 
(and  its  needs  and  requirements) >  mechanisms  must  be  developed  to 
more  effectively  link  specialized  development  organizations  to  user 
systoips  —  e.§,:     (a)  recruitment  of  more  practitione^rl  for  positions 
in  developnent  organizations  (whether  as  temporary  or  perman^;nt  staff 
or  as  consultants);  (b)  temporary  assignments  of  developers  to  operating 
systems  to  enable  them  to  observe  classrooms  and  schools  In  operation> 
^  to  talk  with  Rractit;Loners>  and  t&  learn  about  thftir  needs>  requiirerr-erits 
preferences*  cqnstraints>  etc.;  and  (c)  ongoing  need  identification 
linkages  with  user  systems  throughout  tfie  R/Did  process  to  provide 
practitioner  input  into  not  only  the -initial  need  identification/pro- 
ject selection  decisions  but  also  into  the  successive"  fine-tuning 
of  product^  throughout  the  cyclical  deve^lopment  work  and  into  the  ' 
^  de^iniatlon  of  needed  packaging  and  implementation  supports' to  permit 
effective  use  of  the  product  invfe  range  of  operating  systems. 

Second*  given  the  serious  weaknesses  of  the  institutional  and  personnel 
base  of  systematic  R£(D  in  e"ducation,  i£  would  seem  essential  to: 
(a)  develop-  some  clear  &*formation  on  the  e^cisting  organizational 
,  capabilities  .(?Lnd  per^sonnel  competencies)  required  to  carry  out 
6  systeMtic  R&D>  where  .these  capabilities  and  competencies*  can  curtiently 
-be  ^Gun'd  (ahd  to  vh^it  degrt*e)  >  an^  what  strategies  might  be  most  use- 
,>-ful  far  building  R£rD  capabilities  Lx\  those  existing  strong  basesT 
■(b)  screen  and  select^  carefully  the  organizations  provided  funded 
'  to  carryxon  wprk  in  the  systematic  R&D  node  >  even  if  that  me^s  seeking 
ou^  contrafctors  arid  using  sole  source  procurements  or  'limited  competi- 
tiort&       an  alternative  to  open  competition  in  the  RFP  pattern;  5 
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(c)  organizing  consorcia  of  concractors  if  nt;cessary  .for  carrying 
out  specif ic 'contracts  If  the  different  capabilities  ^eeded  for 
various  parts  of  a  given  project  are  best  deyeloped  in  several 
different  organi2ations  rather  than  all  being  developed  adequately 
within  a  single  organization;  and  (d)  designing  R&D  procyrement 
policic^s  to  achieve  the  dual  objectives  of  R&D  capacicy-building  as 
well  as  product  developmertt  *  "         ■         ,  - 


Thid,  given  the  weak*hesses  of  the  knowledge  and  technology  b^se  of 
education  as  a  field  oi  knowledge,  education  as  a  practice  field>  and 
development  as  an  r/d&I  specialty,  it  ^jould  seeij'  essential  to  develop 
^project  selection  and  review  mechanisms  vhich'^ke  into  account: 


(a)  what  .areas  of  knowledge  are  best  and  least 


developed,  sufficient 


to  support  R&D  work  with  a.minitnum  of  applied  rea^arch  and  a  inaximum 
of  translating  ^unknowns  into  knowns;  ,(b)  what  types  of  development  " 
work  the  state-of-the-art  of  educational  R&D' and  £h^  available  instru- 
mentation  make  feasible;  and  (c)  what  t^ractitioner  behaviours  and 
organisational  arran^gmenet^  arp-most  or  least  likely  ta  be  effectively 
implerrJ^nted  given  the  state  ot  the  knowledge  land  technology-  ba^e  of 
educational  practice.    Further>  given  the  critical- constrining  in-' 
flueno'e  of  the  state  of  maturing  of  these  knowledge  and  technology 
basesj.  it 'would  seem  essential  to  strjLngthen  all  three>  and  especially 
to  f\in(^  the  s&l/ -conscious  d^elopment  of  the  methodology  of  the  R^D- 
mode  (d^stematizing  the  stat^-of-the-art  into  hand^?ooks>  profession- 
alizingUthe  developer  role ^through  the  creation  of  specialized  journal 
professional  associations  csr  subgroups  within  associations  such  as 
AERA>  eti.),  \    ^  ^  '  ' 

Fourth,  to  minimize  the  dif-f  iculties  of  getting  exterrially  developed 
outputs  disseminated  to,  and  implemented  effectively  in,  operating 
sys-t£mSv  development  policy,  needs  to  Be  made  with  dissemination  and 
implementation  constraints  in  mind  And  A  systematic  orientation  to 
linkage  and  use  problems.  .        ,   ,        ^  ,  "  "  _ 
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Finally, 'given  the  relatively  high  costrt  of  systematic  RSD  follo^sning 
-the  rigorous  engineering  model,  and  given  the  inevitable  adaptation  ' 
rather  than  adoption  o£  R&D  output^  in  opeating  systeraSj  ic  would 
probably  be  usefi^  to  evolve  other  forms  of  R&D  that  may  perhaps  be^ 
cl'foser  to  the  practice-'based  eV  mixed  modes-  of  development  rather 
that  the  rigorous  engineering  model*    l^fhat  we  have  in  Etiind  is  a  kind 
of  "good  enough"  development*  —  f.e,,  R&D  to  a  point  where  a  product 
might  become  as  attractive  as  an  exemplary  program  developed  by 
practitioners  J  but  need  not  necessarily  be  developed  to  the  point  of 
n-^f^riag  d^vtilopers    prespecifiod  p&rforDaoca  outcomes  Prior  to  being 
turned  over  to  operating  systetr^  for  use 

T  f 

While  any  or  all  of  these  st«tegies  might  hold  out  some  promise  of 
strengthening^ the  systematic  R^D  mode  over  time>  there  would  seem  to 
be  several  kinds  o^f  information  we  would  need  to  have  before  we  would 
devise  policies  likely  to  be  effective  in  achieving  ^his  end, 
^Considering  how  little  empirical  work  or  even  polic'y  analysis  has 
been  ^iirected  at  ,the  development  function  as  it  exists  in  the  edu- 
cation sector  today>  it  would  seem  essential  to 'carry  out  several 
kinds  of  data-gathering  and  analytical  efforts  firs^  as  a  basis  for 
planning  and  program  development.     Illustrative  of  the^  kinds  of 
questions  we  wee  in  need  of  answers  as  a  basis  for  policy  formation 
are  the  following:*  "  if  ■ 

Identification  of fPrRanizational  Ca'pabillties  and  Personnel 


ComT^etencies  Required  for  Systematic  R&D 


What  person.iei  competencies 
systematic  RtD  in  the  educa 


are  required  by  the  tasks^  involved  in 
imattc  HtD  in  the  education  sector'?.   \Shat  organizational 
capabilities  are  required  to  eff(^ctively  muster  aOd  manage  needed 
resources  to  conduct  educational  R&D^is  carried  out? 


ERIC 
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^ich  of  thesG  competencies  and  capabilititiS  seem  most*  signif ic*int ^ 
in  distinguishing  the  organizations  that  were  judged  to  be  strongest 
in  performing  educational  R^D  and  producing  the  highest  quality^  most 
widely  used  outputs?  ^ 

"  •    \  ■ 

Ass€issment  of  Existing  Capl^ilities  and  Competencies,  Location  ajid 
Distribution  Across  Organizations 

Among  all  the  organizations  currently,  carrying  out  systematic  RfiD'^for 
rhe  cdL;cation  sector,  how  are  these  capabilities  distributed?    In  terns 
of*  rough  ratings,  how  well  developed  are  each  gf,  these  capabilities 
in  each  ofy^these  organizations?    How  many  organizations  already  show 
high*  levels  of  work  it*  ^ach  area  of  capabilities?    How  many  organi- 
^zations  show  moderate  levels  of  development  in  each  area  of  capabilities, 
and  sho^  promise  tH?t  higher  levels  of  work  may  be  possible  over  time? 

Are  strong  capabilities  in  specific  types  of  skills  distributed 
equally  well  across  the  country?  S^^o  they  tend  to  be  clustered  in 
only  certain  geographic  areas^^of  the  country? 

% 

How  many  organizations  show  high^levels  of  sk^ll  across  a  wide  range 
of  development  tasks  and  activities?'   How  many  show  strong  levels  of 
skilfs^n  only  certain  types  of  tasks  and  Activities?    Given  the 
existing  patterns,  how  feasible  might  it  be  to  arrange  multi*-institu' 
tional  procurements  in  which  several  institutions  carry  out  different 
as"Pects  of  a  single  project? 

Surveys  of  Existing  Resources  for  Expanding  and  Strengthening  Existing 
■Culpabilities/ Competencies 

> 

How  many  **centers  of  excellence"  in  development  work  of  various  kinds 
exist  currently? 
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How  many  ae\^'  developMat;  specialists  might  be  trained,  over  how  long 

time  period^  through  current  (and  various  Jiypothetical  expanded) 
scales  oE  operation  of  e^h  of  these  centers?    HoW  many  of  these 
centers  might  be  linked  to  other. development  organizations  as  a  means 
of  strengthening  R&D  work  carried  out  in  these  other  orgaijitations? 
Through  what  linkage  patterns?    At  what  costs? 

VJhat  other  bases  might  be  built  up  for  strengthening  sysftetnatic  R£tD? 
l-Zhat  universities  might  be  sites  for  suitable  training  programs? 
^^^.at  professional  association  activici^? 

PossibiliL'^!f*for  gtrehgtheninj^  Need  Identification  Linkages  *  ' 

What  possibilities  currently  exif^t  between  specialized  development 
organizations  and  school  systems? 

Row  many  school  districts  would-be  willing  to  particij^te  in  personnel 
exchanges  with  development  organizations,  consultative  arrangements, 
and  similar  mechanisms  for  strengthening  need  identif icationr  linkages? 

Informatj-on  System  on  R&D  Feasibility  ^ 

.  \ 

Wl^at  areas  of  knowledge  are  sufficiently  developed  to  serve  as  a  basis 
>  for  systematic  R&D  using  the  engineering  model:    What  kinds  of  RfifD 
outputs  might  be  developed  applying  the  accumulated  base  in  these 
areas  of  knowledge? 


Which  of  the  above  are  feasible  given  the  state-of-the-arc  of^ 
development  and  R/D&I  in  education?    IJhich  are  feasible  given  the 
t    vexisting ^instrumentation  for  measuring  the  effectiveness  of  outputs 
beingi  developed? 

■  '  ^  V 

Which  of  the  above  are  most  reasonable  to  fund  given  the  sTreas  of 
strength  and  weakness  of  existing  educational  practice? 
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2,        Strengthening;  Prficcice-^Basod/Pract ice-Related  Devcl'opnient. 

Since  most. of  the  products>  progr£^Bs,  and  practices  developed  in  the 
.'education  sector  are  the  outputs  o£' the  practice-based/practice-re'lated 
mode>  initiatives  to  strengthen  this,  type  of  development  workinight'' 
conceivably  have  the  broadest  impact.    However,  for  must  *ttfe.  sane^ 
reason  —  traceable  to  the  enormous  scale  of  this  development  system  ^ 
(potentially  all  schools>  SEAs>  Rub^shers  and  other  commercial'suppliers; 
schools  of  education,  etc.),   tt)is  set  of, options  might  ,*lso  be  the  ^ 
costliest  and  most  difficult  to  imple^nent  effectively  an  a  b^oad         r     .  - 
scale.         /     *  "  *  ■      .  " 


Clearly>  several  kiiids  of  .things  need  to  be  done  to  strengthen  this 
mode  of  development  work,  ^  * 

First,  dt  would  seem  essential  to  proviie  laechanisms  to  upgrade  the  / 
development  skills  of  the  personnel  producing  ^ducatflonal  programs, 
materialSj  etc.  in  LEAs^  SEA'S,  schools  of  education,  ^nd  private 
sector  commercial  firms.     This  jnight  be  accomplished^  thVj6«%h'' various 
means:    for  instance,  (a) ^special  in-service  or  summer  workshop 
programs;  ojr  (b)  linking  internal^ development  sites  to  technical 
assistance  fgroups  or  Reorganizations  wh6'*could  work  with"  praQti-  ■ 
tioners  qrpublishing  house  personnel  on  packaging^'conce^tions  or 
approaches  in  a  way  that  would  increase  their  usability  elsevhere'. 


lifhile  at  the  same  time  upgrading  the  skills  of  those  iaj^rnal 
personnel  carrying  out  the  development  tasks.  ^  ^ 

fn  a'ddition,  it  would*  seein  important  to  establish  Trechnnlsms  ois 
strategies  to  link  these  internal  personnel  to  up-to-date  resources^ 
on  the  development  state-of-the-art.    This  might  take  the  form  of  a 
referral  or  consulting  network>  wit^^^h  inte^rnal  developers  able,  to 
get  referrals  to  sp'ecjtalists  in  developfltent  work  (or  development 
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nodes)  nalev^nt  to  what  they  were^  doings  who  could  or;Lent  them  toward 
'other  developers  t<5  whom  they  sfi^ut^'talk^  other  davelopment  i/ork*^si¥ 
should  axamij[\e,  etc.    Strategies  of  this  kind  directed  toward  up- 


grading -the  pKills  and  sophisti«ation  of  practice-based  developers^ 
bringing  part-time  developers  up-tot-date  with  state-of-the-art 
coasidcrations,  and  linking^^^em  to  high  quality  development  resources, 
might  prodjLice  significant  gains  in  the  quality  of  the  development  outt- 
puts  produced  in  practice-based  and  practice-related  settings. 

Second, /if  the  field  at  large  is'to  be  able  to  draw  on  the  vast 

body  of  trtdterials,  programs,  and  practices  produced  in  these  settings, 

priority  attention  will -need  to  be,  directed  towards  doctS5p.entatlon  of 

the  outputs  p%»dM^ed  in  these  settings*    Practioe-^baseS  development 

*  *  *  ■    t  66 

work  has  been  characterized  as  "invisible"  innovation,    ^^n  illus- 

tration  of  the  old  philosophical  dilemma.    "If  a  tree  falls  in  t^e  ^ 

forest  and  no  one  is  aroundVto  see  it,  did  the  tree  fall?"  Is 

practice-based  innovation  alive  and  well  ^ut  not  visible  because  it 

has  notj^een  documented  for  the  world  to  see?    Or  is  little  such 

innovation  ^to  be  found,  whether  documents  or  not?' 

What  seems  to  be*  called  for,-  at  the  very  le^nst,  is  a  catalgog-type 
listing  of  what  has  bee  rv^r  is  b  eing) 'pr'oduc'ed,  where,  and  how  a 
potential  us^  might  acqulr^  sample  outputs  to  examine  or  arrange  ' 
for' site  visits  to  observe  a  program,  or  strategy  irt  oper^tipn  and 
speak  with  practitioners  who  have  used  it.    Even  more  desirable 
would' be  an  £RIC-type  operation  t^at  not  only  publishes  abstracts 
of  yh^t  is  available  but  also  (a)  acquires,  stores,  retrieves,  and 
distributes^ documents  in  response  to  specifi^requests,  and  (b)  is 
^linkecT^  educational  ^formation  centers  and  various  active,  inter- 
personal,  assistances-providing  mechhnism?  that  work  with  practi- 
^tioners  to  enable  Ehem  mor^ef f ec  tively  to  draw  on  and  use  wKat  is 
availabl!^.    Thig^lnd  of  output-accessing  facility  might  be         -  ^  ^ 


established  vithin  the  ERIC  system*     (The  producft^^Jel^^l^meE^fe/reports 

^    ^  ■  -it'  7    '-  \  ^'^•^ 

corapl%ted  by  developers  using  NIE  funds  and  inco^^rattid"*?ttl^in  the 

ERIC  library  ate  one  example  <jf  this  kind  of  str*t^gy/^^->(^:(^S^j  it 

might  be  set  up  fes  a  separate>  computerized  stora 

system.    Or  it  might  be'linked  to  planfied  programs  suc^'^s'^ilE's 

68  I  '  " 

,  R5tD  E);change  Program.        Or  it  might' be  linked  to  SEA  information 

bases  already  operating  for^urposes  of  disseminating  exemplary 

^  *       69  * 

practices  originating  in  their  schools. 

Whatever  form  the  accesslng>  storage,  and  retrieval  system  takes> 
.Its  degree  of  success  is  likely  to  be  dependent  on  the  '^^echanisrts 
developed  to  get  school  systems  to  report  on  the  TGaterials>  programs> 
and  strategies  they  develops  and  contribute^  these  outputs  to  the. 
system*    An  annual  s^irvey  might  be  conSucted^  perhaps  incorporated 
yithin  (or  associated  vith)  NIE's  planned  survey  of  school  practice.'*^ 
Participants  mlghj  be  stimulated  fy  financial  incentives*  e*g. ;  the 
Creation  of  a  royalty  type  of  arrjahgement  through  which  contributing'^ 
scjiool  "systems  might  receive  payments  for  each  Item  contributed  to 
the  system.    The  size  of  the  payment  for  each  item  might  be  determined 
by  the  coqiplexity^  degree  of  develoi^tnent^ -and  perhaps  too>  judgments 
^  the  quality  of  each  item  contributed,*,   (The  range  plght  run  from  a 
Single  interesting  lesson^  on  the  one  hand>   to  ^  full  curriculum 
^ancP^instruct'ional  system  vlth  supportive  materials »  on  the  other^) 
The  paymeiit  formula  might  be  applied  by  a  review  panel  of  judges^  who 
Would  thereby  also  provide  the  field  ^ith  a  .oo^ly  of  p^opl^„  intimately 
familiar  vith ^th^  .full  range  of  practice-based  ievelopment^jj^k  going' 
on  across         country*    Additional  royalties  might  be  provided  to  ^ 
contributing  school  systems  over  time>  based  on  the  number  o^  other 
scliool^  systems*  adopting  (or  adapting)  and  usiag  these  items  for  one 
year>-tfiree  years^  etc.*  V 

Ob^ously  Such  ^  proposarl  contains  within  It  ^  number  of  risks  —  such 
■as  tha  oft-cited  fear  in  the  education  sector  of  introducing^ 
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■'hucksterisfr*. '*  ^u't  in  the  long-run,  with  sufficient  safeguards, 
such  a' system  might  bei less  costly  than  investing  heavily'ln  systematic 
R&D  by  special,i*zed  development  ^organiza'tioris .    And  toor,  it  jnight 
produce  a;  substantial  body  of*docuTnented,  accessible  materials,  programs 
and  products  already  in  use  In  School  systems*    And  most  attractive 
'of  all,  ^it  might  well^entice  financially  hard-pressed  school  districts 
not  only  to  document  the  innovative  programs,  and  materials  thoy  have 
already  developed  Sut  alsos^  tb  *take  advantage  of  th^s  new  source  of 
needed  funds,,  it  might  spur  the^  districts  to  so  arrange  staff  time 
that  a  grci^  deal  of  new  development  work  might  be  forthcoming* 

A  third'  kind  pf  initiative  would  .seem  to  Ije  deeded  'to  provide  evalu- 

ative  inforniation^.on  the  programs,  ractices,  and  products  ^accessed 

*  **  -■ 

and  stored  in  the  new  s^ysjtem.    One  of  the  key  problems  hampering 

i;ational  decisionmaking  by  school  systems  considering  the  adopti^  , 
of  new  j)rograms  or  practices  is  the  fact  that  even  where  .evaljfiative 
"i^nformation  is  availab^e  from  fi^d  tests  of  a  given  program  or  pro- 
duct, that  progtam  or  product  competes  with  an  enormous  body  of 

'      "  71  * 

unvalidat^d  practices,  programs,  or  products*        Consequently,  the 

,adof)kting  school  system  has  ^o  way  of  assessing  whether  a,  program  that  , 
provided  ^aluative  information  is  or  is  not  more  effective  than*  an 
alternative  on  whiclf  thera  is  no  evaluative  data*    The  choice  among 
Such  alternatives .then,  i^  likely  to  be  made  on  bases  oth^r  than 

'the  evaluative  information  provided* 

If 'mechanism^  were  available  to  assess  all^o^f  the  existing  alternatives  ' 
accessed    in  the  kind  of  system^  we  have  been  suggesting,  adopting 
school  systems  would  be  in  a  much  better  position  to  judge  alterna- 
tives  In  terms  of  data  on  e'f f ectiveness*    Such  validating  mechanisms 
are  likely^^to/6e  costly.    But  they  would  seem  to  be  essential,  and 
well  worth  Ihe  ,cost.  •It  may  be  passij)le^  to  reduce  costs  by  building 
on  existing  mechanisms  that  provide  such  information,  e*g.:  SEA  units 
responsible  for  va^lidating  exemplary  practices  sclented  for  statewide 
dissemination. 


t  work  suffer  from  weaknesses  in  the 
dissemination  or  outpu^^j    tiut  of  all  thr^e  modes,  the  problems  are.' 
cearly  the 'most  severe  in  the  prac  tic^*-based  type  of  development  - 
(Jorkt '  Systematic  R&D  is  carried  out  by  specialize^  R&D  organizations*  ■ 
who  generally  undertake  to  dissefliiH^e  the^ir  outputs  (however  poorly) 
'  and.  of  ten  provide  imp^nientation  assistance  asjpart  of  their  ^deve- 
lopment enterprise*  ^The  mixed"  ra^e  is  t^eci/fically  designed  to  over-^ 
come  the  dissemination  weakness  of'  the  practi^e,-based  mode  and  m^xed 
mode  a^trategies  are  *gene:rally -designed  to  include  linkages  to  ' 
di3££emination  networks  (however  inadequate  these  may  be)*  The 
problem  is  most  severe  in  the  practice-based  mode  because  here, 
unless  there>  is  a  specific'^linkage  to  mixed  mode  packaging  and  ^ 
dissemination  mechanisms,  the  work  is/generally  undertaken  with  no 
thought  of  broader  dissemination,  no  provision- for  personnel  to 
carry  out  disseminatioij  responsibilities,  and  little'  if  any  effort 
to  turn  over  a  locally  developed  output  to  some  other  institution  or 
network  for  broader  disseminatioT)>  Therefore",  practice-based  develop- 

ment  remains  "invisible"  innovation. 

,    '  ■         I  ' 

To  overcome  this  difficulty,  a  needed  fourth  kind  of  initiative  for 
strengthening  this  kind  of  development  work  should  focus  on  dissemination 


)  issues.    Clearly,  one- option 


is  simply  to  try  to  link  all  practice*-' 


'based  development  (and  whereyerv  possible  practice-related  development 
work  as  well)  to  external  dissemination  mechanisms  ™  i-e*,  to  trans-* 
foriti  the  practice-based/prac^ice'-related  mode  wherever  possible  "into 
the  mixed  mode.    Another,  prpbably  more  costly  and  less  efficient 
option,  would  be  to  fund  dissemination  activities  by  the^LEAs  them-  a 
Selves,  or  to  link  LEAs  regionally  througj^j^^ome  mechanism  such  as. 
NIE*s  R&D  Exchange  Rrograifi  t^  stimulate  LEAs  to  exchange  ideas,  programs^n 
and  materials-    ^ "    ^  ; 

Regardless  of  how  the  dissemlifwtion  problem  is  overcome,  the  greatest 
weakness  of  thfr  practice-bas^d^mode  (and  probably  too  the  mixed  mode  as 


/ 

\ 
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well)  is  likely  tcremaia  the  lack  of  attention  to  packaging  af  locally 
developed  outputs  for  use  elsewhere*    Several,  kinds  of  initiatives 
might  be  attempted*    Those  that  seem  most  reasonable  to  us  link 

developers  in^practice-based'  and  practice^related  settings  to 

*■ 

packaging  spe<iialists  employed  in  other  settings,  such  as  specialized 
R&D  organizations*  'In  essenge>  then^  what  we  are  suggesting  trans- 
forms thef  praccice-based/practice-related  development  pattern  ipto 
the  mixed  mode.    For  instance>  LEAs  who  believe  they  have  some 
locally  developed  programs  or  materials  that  -should  be  input  into 
a  nationwide  dissemination  system  night  take  the  initiative  to  link 
themselves  to  any  of  an  array  of  packaging  resources  publicized  io 
an  annual  catalog  of  sorts  *    Such  resources  might  include  private  or 

pu?iXic  sector  R£(D  organi2ations>  technical  assistance  organizations  > 

*  *  ^ 

poblishing  houses  or  madia^  f inns >  consultants  in  university .settings> 

etc*    Each  of  the  potential  resources  might  be  described. briefly  in 

^  catalog  in  tferms  of  types  of  specialties>  track  records  of. similar 

packSglng  projects  completed  in  the  past  (along  with  past  clients 

as  references)  >  fees  or  future-royalty-sharing  arrangements  pos±»ible, 

etc.    As  an  a-lternative  to  LEA-iniCiated  search^  for  such  resources> 

a  referral  service  could  be  set  up  to  match  LEA  needs  with  available 

re£$ources>  a  referral  service  could  be  set  up  to. match  LEA  needs  with 

available  resources*    As  an  even  mpre  proactive  option>  we  might 

envision  setting  up  specialized    units  to  search  out  high  quality', 

potentially  packageable>  locally  developed  outputs^  and  then  assist 

the  LEAs  in  using  the  referral  service  and  collaborating  with 

packaging  specialists  to  increase  the  usabilitTy  of  their  outputs 

(and  thereby  in^rpase  their  royalEiy  potential  if  thcy^  were  input 

into  the  kind  of  system  we  suggested,  earlier)  *     In  SE^'^  that  already 


have  specialized  units  which  identify  ex^plary  practices  in  the 
schools  of  their  state  for  val£datlon>  packaging",  and  dissemination > 
these  units  might  be  used  for  thi5  purpose*     In  other  statGS>  similar 
units  might  he  establis'htid. 
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We  need  not  tar ry^  this  discu^ssion  further-    ,Clearly>  thert*  are  s%yiBxa\' 
kinds  of  setps  that  might  be 'undertaken  to  strengthen  this  mode  of 
development  .work-    ^ome  of^  those  we  have  envisioned^  are  quite  <ila\i^rate 
Gathers  are  le$s  complex.  *The  possibilities  arc  endless.^ 

Some  kinds  of  initiatives  might  be  llnjced  to  other  purposes,  for 
instance,  broadening  the*  base  of  spons'orship  for  educational  R/Dol 
activities.    Clearly,  it  the  profit  potential  seemed  rea^ionably  good, 
publishers,  film  makers a^i^id  other  private  sector  commercial  firms 
/  ^l^ht  be  enticed  into  inve.stlng  rore  heavily  in  deyelopr.^nt  work, 
'I    especially  if  they  eacered  the  development  process  afCer  the  high- 
^     riak  early  conceptioii  afid  design  phase  and  were  brought  in  primarily 
at  the  point  of  packaging  for  brpader  distribution  and  use  programs 
and  materials  already  identified  as, high  in  quality  and  potential 
fecale  of  utilisation,  ,    ■  "       *  . 

Some  initiatives  might  be  linked  to  system  capacity-building*  e,g^; 

slowly  builditig  packaging  capabilities  within  the  educational  R/D&I 

system  while  using  as  a  stopgap  "reivted"  packaging  capacity  frota 
72  4 

other  fields. 

.  ■  * 

Other  initiatives  might  be  linked  to  reviving,  the  "best  minds" 

development  model  used  in  the  early  history  of  educational  R/D&I, 

when  ^eminent  scientists  and  mathematicians  participated  in  the  NSF 

Course  Content  Improvement  Program  an^  produced  exciting  new  high 

'73 

■  ^  school  curricula"  and  materials.       That  model 'was  rejected  in  favor 
of  new  organizational  forms  such  as  the  labs  and  centers.  The 
argument  for  that  course  of  action,  iapart,  was  that,  the  materials, 
produced  by  the  /'best  minds'*  model  were  not  developed  with  sufficient 
attention  to  instructional  requirements  and  were  not  sufficiently 
tested  in  the  manner  of  systematic  R&D>  to  insure  theit^sability 
'^and  effectiveness  with^a  wide  spectrum  of  students.    The  KSF  model 
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was  a  practice-^related  forni>  a  more  elaborate  version  of  the  , 
curriculum  projects  '^that  had  been  carried  out  by  one  or  more  university, 
professors  for  school  system  ush-    Clearly>  instead  of  rejecting  this  ^ 
modeis  federal  policymakers  could  have  opted  to  strengthen  i-t  by 
broadening  the  curriculunl  development  teams  to  include  practitioners 
and  learning  theorists  and  expanding  the  development  process  ^o  include 
nore  elaborate  tield  tesdng  and  revision  cycles.    Revival  and  strength- 
ening of  this  approach  would  seem  to  be  an  option  worth  considering. 

Before  we  woul^d  be  in  a  position  to  design  the  kinds  of  initiatives 
we  have  been  suggesting,  we  ^jould  need  to  know  considerably  more  about 
^e  pre^erences>  needs,  and  perceived  interests  of  practitioners  and 
others  who  ciight  be  involved^in  such  programs.    At  the  very  least,  we 
would  need  to  know:        _  ^ 

-  what  development  skills  practitioners  who  carry  out  this 
woi;k  perceive  they  need  (and  how  this  compares  to 'a  similar 
assessment  by  development  specialists  in  specialized  R&D 
organizations) ; 


-^hat  resources  practitioners  thinTc  they  would  (and  would  not 
use>  and  why,  among  all  the  hypothetical  possibilities  we 
might  describe  that  could  be  made  available  to  them; 

-  what  kinds  of  arrangements  school  districts  would  find 
acceptable  to  enable. their  personnel  to  carry  out  more  deve- 
lopment work,  and  what  financial  incentiyes  might  be  required 
before  this  could  be  made  acceptable;  ** 

-  what  kinds  of  outputs  they  would  want  to  see  accessed  and 
*  Stored,  in  what  forms; 
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^    -  what  kinds  of  accessing  and  retrieval  mechanlsins  they  wowld' 
be  most  likely  to  use; 

-  what  kindfe  of  evaluative  informatid>n  they  would  want  to  have 
available  as  a  basis  for  adoption/adaptation  choices; 

~  what  evaluative  procedures  th^^  would  find  acceptabl^e  to  permit 
validation  of  outputs  they  contribute  to  the  system; 

-  what  kinds  of  incentives  would  enable  theas  to  participate  in  tl^c; 
system  we  suggested  for  documenting  their  outputs  and  cohtribuCing 

thetn  to  a  nationwide  system  for  possible  royalty  psjyments;  and  \ 

+  I  * 

^  what  kiiula  of^  safeguards  they  would  see  as  required  to  prevent 
"hucksterism"  and  other  potential  risks  in  such  a  system. 

We  would  aV?^^-need  to  know  considerably  more  than  we  know  now  about  the 
resources  available  for  transforming  ttie  practice-based/practice- 
related  mode  into  a  pattern  resembling  more  closely  the  mixed  mode.  That 
is,  we  would  need  to  know; 

^  what  dissemination  mechanisms  are  already  ayallable  (and  what 
others  might  be  readily  developed)  with  the  capacity  to  handle 
*  the  enormous  quantity  of  outputs  likely  to  be  forthcoming 

from  documentation  of  practice-based/practice-related  work; 

~  what  quality  control  and  validation  mechahiems  might  be  used 
as  models  for  iacorporation  in/such  a  system; 

~  what  kinds  of  packaging  resources  gre  available,  were,  and  ^Slf^ 
what  likely  costs;  what  kinds  of  packaging  capacity  are  available 
for  "rent";  what  organisations  with  some  degree  of  packaging 
capacity  might  be  used *as  centers  around  which  to  build  packaging 
cap^ity  within  the  educational  r/dS(I  system. 
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ScrengCheninR.'che  Mixed  ^fc>de  of  Development  Work  ^ 

Much  of  our  discussion  of  initiatives  "that  miaht  be  undertaken  to 
strengthen  practice-based/practiae-realted  development  work  suggested 
that  what  was  heeded  was  to  transform  tbatjdnd^of  development  activity 
into  the  mixed  mode.    However,  we  also  pointed  out  in  that  discussion 
that  for  the  mixed  mode  to  work  we  needed  to  strangthen  m^hanisms.  for 
identifying  iQcally  developed  outputs  worthy  of  broader  dissemination 
I  and  use,  for  validating  these  outputs*  and  especially  for  packaging 
^  them  in  ways  that  would  oermits  them  to  be  used  effectively  elsewhere. 
We  noted  coo  What  kinds  of  information  ,we  need  to  gather  about  existing 
resource^  for  cari;y?^  put  th^^e  tasks,  and  what  current  bases  exist 
for  strengthening  and  expanding  such  capacities  to  the  scale  and  qyality 
required.  *  *  * 

t  '      .  ■ 

1 

There  is  little  we  could  add  to  that  discussion  at  this  point.  Clearly, 
we,  see  great  promise  in  the  mixed  mod^  of  development  work*    It  may 
Over  time>  if  sufficiently  strengthened,  combi-ne  tbe  advantages  of^b'oth 
the  systematic  and  practice-based  modes  while  overcoming  some  of  the 
mcLt  serious  weaknesses  of  each  —  in  sbort>  it  may  offer  the  promise 
of  being  "the  best  erf  both  worlds,"    As  yet,  however^  little  of  tbe 
needed  capacity  for  this  kind  of  work,  exists,  much  less  the  Critical 
coordinating  and  linkage  mechanisms  that  may  be  tbe^ey  determinants 
of  success  or  f^ailure  for  such  a  complex  multi-institutional  approach- 
The  possibilities,  though>  are  attractive>  and  db  seem  to  warrant 
further  policyconsideration. 
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IV*  cosca'sxoss 


When  R&b  came  to  be  insticutionalizefd' as  a  key  scracegy  for  improving 

educational  practice,  che  rationale  was  chat  t;he  development  funccion 

was  Che  missing  link  needed  to  cransform  research  findings  and 

exempiary  practices  into  usable  packages  for  wide  scale  dissemination* 

The  lofcy  iropes  for  systemaclc  RSD  have  not  as  yet  been  realised. 

But  there  does  seem  to  be  some  projnise  for  the  future  in  the  fact  chat 

soqe 'exemplary  oiitpucs  have  been  develc<)ed  thVo.ugh  syscematic  R&D  - 

procedur^-s,  anci  there  appeases  to  be  a  vase  storehouse  of  undbcaT-ented 

practice-based  development  ^outputs  that  probably  could  b,e  developed 

to  the  point  where  thay  carr  be  used  gn  a  wider  sc'ale*  .  The  rationale 

for  the  development  function  in  education  seems  almost  as  persuasive 

I  »  ^ 

now  as  it  was  fifteen  years  ago,    Buc  we  are  probably  in  a  stronger  ' 

position  no:j  co  realize  that  potential,  for  we  have  learned  a  great 

deal  over,  che  past  fifteen  years  about  how  the  systemacic  ^R&D  model 

needs. to       adapted  to  the  educational  context,  and  how  development  * 

work  going  on  in  practice-based  and  practice-related  sectings  can 

*  »    ■  * 

be  strengthened*  '* 

It  will  take  decades  to  realize  that  potential,  if  ic  is  to  be 

realized  at  all*    For  che  kinds  of  capacity-building  and  linkage-^ 

building  strategies  we  hav^  suggested  here  are  extremely  co^mplex 
* 

and  will  takfe  a  good  , deal  of  time  to  carry  out*    At  this  point,  it     ^  * 

would  seem,  consideracon  needs  to  b^  given  to  the  long-term  prospects, 

the  costs,  and  the  requirements  for  successfully  implementing  such, 

complex^trategies*    Project-by-project  funding  alone  is  ttot  likely 

to  take  these  broader,  ^long-term  consideraCioos  into  account. 

A  ''development  policy*'  would  seem  to-be  needed,  based  oh  considera- 

^  -  * 

tion  of  the  available  options  and  tentative  choices  about  the 

tive  investments  to  be  made  in  each,  embodying  a  long-term  commitment 

to  develop:nenc  work  (whethe/  carried  on  in  sites  within  or  external 
'  * 

to  school  syscems)  as  a  key^.strategy  for  cHe  improvement  of  educa-  ' 
clonal  practice,  '       .  * 
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T.     DEriMTIOX  OF  THE  SCOPE  OF  THE  DISgEMIWATTON  FUXCTIOM  ' 

Although'  the  term  "dissemination"  has  been  widely  used  in  education 
for  some  time,  there  is  clearly  little  consensus  on  the  scope  of 
activities  subsumed  under  that  label.    The  problem  has  been  compli- 
^cated  somet^hat  by  the  changing  natur^  of  the  dissemination  function 
in  educational  R/BsI,  with  more  and  more  active  strategies  gaining 
'increasing  acceptance       part  of  the  dissemination  function. 

At  leasc^  four  terms  have  been  used  to  describe  this  function  in 

other  r/d^T  systems:  "dissemination,'*' "diffusion/'  "marketing/'  and 

''distribution,"    For  simplicity,  we  shall  use  the  term  "dissemination"- 

to  cover  all  four  meanings.    Neither  "marketing"  nor  "distribution" 

seem  well  suited  usages  for  describing  (The  reality  inseducational 

R/D&I,    Despite  several  discussions  in  recent  years  about  bringing 

a 'marketing  apptoach  to  educational  R/D&I,"'"  and  despite  tlje  current 

2 

focus  on  user  needs  and  viewpoints,     the  marketing  perspective  appears 
to  be  almost  totally  absent  from  educational  r/d&I  policy  making  &t 
prudent.    And,  with  the  exception  of  commerically  developed  products, 
there  has  been  little  in  th*  fiel^  of.  education  that  could  appropriately' 
be  described  as  a  "distribution"  system.     In  fact,  lack  of  availability  ^ 
or  access  to  R&D  outputs  that  have  been  developed  is  repeatedly  pointed 
to  as  one  of  the  Key  problems  to  be  addressed  by  the  dissemination 
function  in  educational  R/D&I.      Of  the  two  remaining  terms  ('Missem- 
ination"  and  "diffusion"),  "dissemination"  seems  to  be .more  widely 
used,  perhaps  because  "jdTif fusion"  generally  suggests  a  less  proactive 
process.    At  some  point  in  the  future  developiilent  of  the  dissemination 
function  in  educational  R/D&I,  there  may  be  well  developed  marketing 
and/or  distribution  systems  for  segments  of  the  available  inventory 
of  educational  R/D&I  outputs.    For  the  present,  though,  wer  must  focus 
on  dissemination  alone.  ^ 


*This  chapter  presents  in  Summary  form  material  that  will  be  e^^anded 
extensively  in  the  next  draft  of  this  4folume,  already  in  preparation. 
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There  have  been  several  recent  attempts  to  define  the  diss^inatlon 
function  in  a  manner  that  takes  into  account  both  newer  and  older 
perspectives  on  the  scope  of  activities  falling  within  the  .dissem- 
ination  function.      One  of  the  most  useful  tff  chese  was  developed  by 
the  Dissemination  Analvsi^  Group  (dAG)  established  by  the  Office  of 
the  Assistant  Secretary  for  Education,  JJHEW*    The  DAG  defined  dis- 
semination as  including  four  types  of  activities: 

a)  Spread:  The  one-way  ^casting  out  of  knowledge  in  all 
its  fornis*  inf otmationj  produces,     ideas  and  materials, 
"as  chough  sewing  seeds/*    Examples:         journal  and 
magazine  articles,  books ,  newsletters . 

b)  Exchange:  The  two-way  or  multi**way  flow  of  information, 
prodjacts,  ideas  and, materials  as  to  needs,  problems,  and 
potential  solutions*    Examples:  need  arousing,  need- 
sensing,  and  "feedforward"  (user  influence)  activities; 

^feedback  activities  a&  user  surveys,  use*r  panels,  and 
site  visits;  and  sharing  activities,"  such  as,"conferences  . 
among  peers . ' 

c)  Choice;  Tne  facilitation  of  rational  consideration  and 
selection  among  those  ideas,  materials,  outcomes  of 
research  at>d  development,  effecting  educational  practices 

*and  other  knowledge  that  can  be  used  for  the  improvement 
of  education.     Examples:  Incentives  for  LEA^  to  engage  in 
search  behavior  before  making  decisions;  training  in 
decision-making;  visits  by  decision-making  practitioners 
to  a  variety  of  demonstration  sites;  searches  of  resource 
bases,  and  comparisons  of  the  array  of  relevant  programs^ 
products,  or  ktvowledge  so  generated;  catalogs  comparing 
alternatives;  traveling  exhi|,blts, 

d)  Implementation:  The  facilitation  of  adoption,  installation 
and  the  ongoing  utilization  of  improvemements.  Examples: 
Consultations,  on^'usei'-site  technical  assistance,  locally 
tailored  training  programs  in  required  new  behaviors;  , 
laboratory  settings  for  the  practice  of  new  behaviors. 


Our  analysis  in  this  chapter  is  conceriied^ith  activities  that  fall 


wltfvirr  the  first  three  of  these  categories.    We  deal  with  implenten- 

:  on 


tation-related  activities  in  a  separate  chapter  on  the  implementation 
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and  utilization  functions  in  educational  R/D&I.    And>  it  should  be  ^ 
noted  that  there  is  soSle  overlap  between  activities  in  the  ''choice*' 
category  and^some  of  the  material  covered  in  our  chapter  on  the 
acquisition  function.    Our  analysis  will  f^^usfon  how  th'e^field's 
understanding  of  the  nature  of  the  dlssemlnatipn  function  has  been 
■changing  over  the  past  two  decades >  encompassing,-^  greater  and  greater 
range  of  activities  and  strategies,  requiring  increasingly  more  active 
postures  in  relating  t6  the  operational  system.    We  shall  consider>^ 
too>  the  evolving  institutlonal>  personnel>  and  knowledge  bases  of 
the  ^ield  and  what  more  may  be  needed  to  strengthen  and  expand  t5e 
disseniciation  capacity  of  the  educational  J^/O&I  system, 

II,  THE  TRANSFORMATION  07  DISSEMINATION  FROM  A  MISSING  LINK  TO  a' 
MAJOR  FOCUS  OF  FEDERAL  AKD  STATE  POLICY  INITIATIVES 

Over  the  past  decade>  ,there  has  been  an  extensive  amount  of  federal 
and  state  level  attention  to  educational  r/D&X  dissemination  issues- 
Dissetninati<^  concerns  are  not  new  to  either  federal  or.stat^  educa- 
tion-agencies*   The  Office  of  Education  functioned  through  most  of 
its  history  since  1867  largely  as  a  dissemination  agency*  And 
dissemination  has  long  been  onfe  of  the  major  areas  of  activity 
'  performed  by  SEAs.  *  ■ 


1 


But  what  is  particularly  striking  about  federal  and  SEA  dissemination 
polftzy  making  over  the  past  decade  has  been  the  considerable  concern 
with:  (a)  system-level  (rather  than  simply  program-level)  dissemina^ 
tion  issues;  and  (b)  building  disseniin^ft^  capacitj;, 

Consequently >  an  enormous  policy-oriented  literature  on  dissemination 
issues  has  been  proliferating  —  much  of  it  produced  by  acvisory  panels 
an/or  groups  brought  together  to  coordinate  diverse  federal  and/or 
state  dissemination  programs^  —  and  a  substantial  institutional  base 
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for  the  dissenination  function  has  been  evolvlng>  along  with  new  * 
approaches  to  disseminating  informacio^,  reseajrch  findings,  products, 
programs,  practices,  instructional  and  organizational  strategies. 


Clearly,  the  dissemination  function  has  coine  a  long  way  in  a  shblft 
time,    A  pervasive  theme  of  the  educational  R/D£fl  literature^  of  the 
'60s  was  the  enoriuous  gap  that  e^iisted  between  research  and  practice 
and  the  relative  absence  of  institutionalized  roles  or  arrangements 
to  link  educational^esearch  and  R£rD  to  educational  practice. 
Research  (and  R&D)  and  practice  were  described  as  existing  in  two  - 
separate  ^;orids,  relatively  isolated  and  insulated  from  one  another- 
'^tesearch  produced^? indinjgs  that  had  no  discerrtible  impact  on  practice. 
Development  activities  generated  produ<jt^  and  programs  that  ^ere 
implemented  in  relatively  few  schools.  And  all  the  whole,  difficult 
operational  problems  of  practitioners  were  either  ignored  by  research- 
ers  and  R&D  personnel,  or  were  solved  by  practrtioners  themselves^ 
without  the  help  of  the  ressarch/R&D  community  and  without  using 
their  systematic,  rigorous  approeches  to  inquiry  and  design. 

Although  there  are  a  number  of  possible  explanations  .for  this  state' 

of  affairs,  a  su^stantiel  portion  of  the  literature  of  the  1960s 

attributed  the  problem  to  the  weaknesses  of  the  dissemination  function 

* 

in  education*^    Proponents  of  this  view  argued  that  highly  useful 
information  and  programs  were  available  and  could  be  applied  to  solve 
operational  problems  and  improve  practice,  if  Jnly  practitioners  could 
be:   (a)  made  aware  of  their  existence,  tb)  motivated  to  consider  their 
use^  and  possibly  (c)  shown  how  to  Use  them.  ^ 


There  is  same  disagreement 'in  policy  circles  about  the  extent  to  which 
dissemination  strategies  can  be  expected, to  improve  educational 
practice.    An  individual's  coitftnitment  to  the  df^semination  approach 
seems  related  to  the  extent  to  which  he  agrees  with  two  fundamejjxal 
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^sum^tions;  (a)  that  the  outputs  ^o£  educational  research  and  R&D 
to  date  include  a  significant  enough  amount  of  usable  information 
and  first-rate  programs,  products*  and  strategies  that  effective 
dissemination  and  use  of  these  outputs  could  substantially  improve 
educational  practice;  and  (b)  that  practitioners  will  accept  and  u 
in  some  form  or  other,  RM)  outputs  developed  by  others* 

Still,  regardless  of  where  one  stands  on  these  issues,  it  became 
increasingly  clear  to  education  policy-makers  in  the  late  1960's 
that  tha  investment  that  had  bsen  uiads  in  educational  R&D  would 
not  bear  fruit  unless  better  mechanisms  were  developed  to  insure 
effective  dissemination  of  these  outputs  to  potential  users. 
Simple  "building  a  better  mousetrap"        if  indeed  these  education- 
al  R&D  outputs  were  "better  mousetraps"  —  did  not  aean  that  the 
world  would  beat  a  path  to  their  door.    At  least  this  had  not  been 
the  case  in  education.    The  response  was  a  number  of  significant 
federal  initiatives  to  strengthen  the  dissemination  function  and. 
establish  needed  linkages  between  the  KP  and  KU  ends  of  the  KPU 
spectrum  iiv^ducation. 
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111.  TRADTTIOMAL  DISSE>tINATION  CHANNELS:  INFORMATION  FLOHS  PRIOR  TO 
THE  EMERGEaCE  OF       ACTIVE  tT.DERAL  ROLE  IN  DISSK-IINATION 

TraditiQiiaily,  the  dissemination  fi^nctiog  in  education  had  two 
distinguishing  features.    First,  it  emphasized,  the  flow  of  inforna- 
tion>  mostly  the  o^itputs  of  research.    >There  was  relatively  little 
that  could  bedescribcd  as  marketing  or  distribution  of  packaged  K^h 
products  X 

And  second>  dissemination  strategies  tended  to  be  so  passive  and 
uncoordinattrd  taan  che  burden  of  etfort  in  retrieval  was  ort  thti 
researchers  and  practitioners  seeking  information.* 

The  (characteristic  channels  were^  publications  —  reports  of  research 
findings  In  technical  reports  to  sponsors >  or  In  scholarly  journal 
articles  targeted  at  the  research  community >  or  in  non-technidal 
form  irt  articles  appearing  in  the  magazine's  and  newspapers  read  by 
practitioners  and  laymen.    Informal > "interpersonal  Information  exchanges 
took  place  at  professional  association  meetings  of  researchers  and  at 
other  meetings  of  practitioners >  and  at  occasional  conferences > 
seminars>  or  workshops.    The  universities  and' teachers-training  , 
institutions  also  performed  a  key  role  in  passing  on  a  field*s  know- 
ledge base  in  pre-service  training  programs>  or  i^updating  knowledge 
and  skills  thorugh  in-'Service  training.    For  the  most  part>  hPwever> 
this  pattern  involved  dissemination  of  individual  pieces  Df  informa- 
tion products  designed  to  produce  changes  in  practice. 

The  exceptions  here  were  the  publishers  and  equipment  manufacturers  ^ 
who  packaged  information  or  technological  products  into  immed lately 
usable  forms  and  had  well  developed  marketing  and  distribution 
operations  to  get  their  products  Into  the  hands  of  practitioners 
with  a  minimum  of  effort  on  the  part  of  operative  system  personnel. 
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IV,     -FEDERAL  DISSEMINATION  INITIATIVES  IN  THE  1960s  A^iD  1970s 

Federal  R/D&I  policies  in  the  '60s  added  several  new  dimensions-  to 
the  then  eicisting  modes  of  dissemination. 

1*    The  ERIC  Sy&tem  ^ 

The  ERIC  system  was  clearly  the  single  most  sizeable  undertaking  in 
federal  dissemination  policy.    The  ERIC  system  was  created  by  OE 
to  acquire>  store,  abstract,  reproduce  and  distribute,  and  pro-- 
vide  easy  computerized  retrieval  of  sources  from  th,e  er^ormous 
fugitive  literature  of  the  field  of  education.    Its  network  of 
clearinghouses  each  specialized  in  selected  topical  areas  Ce*g*, 
vocational  and  technical  education,  education  of  the  disadvantaged, 
teacher  education,  early  childhood  education,  exceptional  children, 
educational  administration,  higher  education,  etc,)-^    The  ERIC  system 
provides  publications  that  announce  acquisitions  to  the  field  and 
therefore  are  expected  to  make  them  more  visible;  indexes  the  jour-- 
nal. literature  of  the  field  as  well  as  the  fugitive  literature 
stored  in  the  ERIC  collection;  and  provid^^^hundreds  of  information 
analysis  products  that  synthesize  information  in  selected  topical 
areas. 

The  ERIC  system  is  clearly  a  Valuable  resource.    However,  it  has 
5een  ^riticized  repeatedly  on  at  least  two  grounds.    One  of  these 
is 'quality  control.    Most  of  the  clearinghouses  appear  to  have 
trj^ed  for  comprehensiveness  rather  than  selectivity  in  their  coverage 
of  the  literature  produced  in  their  topical  areas.  Consequently, 
the  user  o£  the  system  is  often  overwhelmed  by  the  huge  amount  of 
literature  the  system  retrieves  in  any  area,  'and  discouraged  by  the 
poor  quality  of  much'of  what  must  be  reviewed  before  he  can  separat*» 
out  the  few  high  quality  documents  he  needs  to  moet  his  information 
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requirements.    The  effeot  is  often  to\iscourage  further  use  of  the 
system.    A  second  focus  of  criticism  has  been  che  system's  bias 
towards*  the  needs  of  researcljers  rather  than  practitioners.  More 
recently>  in  response  to  practitioner  n^eds>  ERlC  acquisition  ^ 
prograns  have  included  efforts  focused  on  storag&'and  retrieval  of 
curriculum' packages  and  other  development  prq^iucts  (e.g.^  product 
informa^on  packages).    As  yet>  thoughTERIC  appears  to  be  used 
relatively  little  by  practitioners.  ,      *  , 


2*    Other^  Federal  Dissenination  Iniciatives  in  the  I960g  ^ 

Disseminacion  was  also  a  concern  in  some  of  the  other  federally 
funded  programs  b^gun  in  the  1960s.    For  instance  the  network  of 
instttucions  created  by  the  federal  government  in  the  '60s  included 
organizations  charged  with  responsibility  for  acquiring  and  dis- 
seminating instructional  materials  in  given  areas  Ce,g. >  the  instruc- 
tional Materials  Centers)  $nd  organizatlonsTdesigaed  to  demonstrate 
and  disseminate  exemplary  local  practices  (the  ESEA  Title  III  demon- 
stration centers)  ►    Dissemination  of  the  R^tD  outputs  afthe  laboratories 
anc  centers  was  consider-ed  a  major  function  of  these  organizations 
(atr  one  pointf  approximately  25%       the  budgets  of  each  of  tKese 
organizatons  was  mandated  for  dissemination) »    And  categorical  pro- 
grams  Ce,g.,  ESEA  Title  I>  Upward  Bound,  programs  for  the  handicapped, 
and  vocational/career  education)  have  always  included  dissemination 
components.  ^  ** 

Clearly,  then,  a  substantial  amount  of  dissemination  activity  was 
funded  by  the  federal  government  in  the  1960s.    Still, ^  4efepite  all 
^  this  "Sctivit3^>  it  seemed  clear  by  tbe  early  '70s  that  the  outputs 
of  educational  research  and  R&D  were  not'  reaching  the  user  system 
,to  any  signfficant  degree  or  having  clearly  visible  impact*i5n  improv- 
ing  educational  practice.  - 
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3*    The  bevelopmeab  of  MoreWtive  Fo.deral  Dissemination  ^ 
StirateRies  in  the  1970s    '  * 

'Current  fedei^al  dissemination  programs  have  been  built  on  many  of  * 
tKe  initia^tives  l)E  the  '60s,  but  carry  thetn  further  and  change  the 
^foj:us(^of  iederal  dissemina^tion  strategies-    Historically,  the  over- 
all'federal  strategy  could  be  characterized  as; 

a)     initially  one  of  laissez-faire  .  (prior  to  the  mid-'' 60s  and 

in  the  Initial  concept^n  ot  ERl^C  as  a  passive  information^'  ;  ' 
»  repository);  ^  '  _  j*.  ^  ' 


then  a  strategy  of  product  adyocacjr    (the  instructional  - 
Materials  C^giera,  l^boratot^es  an<iSifcenters,  and  Title  III      ,  ^ 
demonstration  centers  advocating Jfihe  use  of  particular 
products  or  programs  they  select*ea,or  developed); 

^  ■  c)    and  finally,'  strategics  of  -  *  ^ 

\  '     ^  10  '  * 

^  coordination  of  existing  d^crete  efforts,  and 

change  process  advocagirr^^  replacing  ^flv%^acy  of 
parftfcular  programs  apd  prodqcts  with'^ffiforniational 
and  capability  bui^ing  approaches;  providing  exten- 
sive amounts'*^^^^^^d  easy  actess  to)  fnformai^^n  on  ^ 
tlie-full  ^'^Vj^^^^^^^^^^-'-^  iKroduct^,  prograios,  and' 
practices  ^ff/ttjf  given  hSeds^^Jjpovidlng^  easy  access 
to  education  exyension  agents,  in  local  ^ducati'on  ^ 
y   ^      /  information  centers;  cie\?eroping  users'  -capability  far 


evaluating,  adapting'  a     'implementing  tfie  products  of 
*  '  '  their  choice 


The  federal  role  ik  riow  often  d*escribed  as  ane  of  facilitt^tioft, 
coordtrTitihg,  and  providing  fit^art-^Iip  funds  to  moblliise  f*t:ito  and 
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dissemination  resources/    The  focus  is  6n  building  networks  that 

,  bring  together  and  strengthei^  the*  dissemination  resources  of 

existing  organizations  that  carry  out  dissemination  activities, 

13  ^  - 

^especially  the  SEAs* 

PrograiR-level  dissemination  progrSSs^of 'the  traditional  one-way 

*   informa^tion  flow*  (or  **spread*^)  variety  continue  as  a  vital  coinpo- 

'  nent  of  federal  sponsorship  of  disseminatiorr  in  education.     In  fact, 

;  * 
the  btilk       education  dissemination  funds  obligated  by  federal 

agencies  id  FY^1975  Tell^into  this  category.    The  approxlmtitely 

$A£^000,000  In  FY  1975  obligations^for  education  dissemination  wa*; 

^  distributed  as  follows: 

^  $  (in  millions) 

'    Pub-  Distribution  of  Social  Scientific  and 

Technical  Information                   '         '  "  2 
. Documentation r  Ref erence j  and  Information 

'  '     '            Services  8 

'Res^rch  Synthesis  for  Use  of  Practitioners  5 

tTechnical  Assistance  to  Disseminate  Knowledge  It  ^    '  * 

Conferences  to  Disseminate  Knowledge  ^0 

Creation  of  Dissemination  Networks^  -  11 

-       '  Miscellaneous  Dissemination  Activities  \  'A 


*  Clearly,  though,  these  data  alsp  suggest  substantial  funding  of  more 

\   active  modes  of  di^ssemination  £h an*  simply  publishing  and  dissemination 
information  or  storing  It  for  retrieval.    Research  synthesis  repre- 
sents  one  sizeable  category  (nearly  10%- of  the  total) ; "technical 

*  assistance  to  disseminate  knowledge  represents  and  even  larger 


"category  (nearly*  17%  of  the  total);  and  the  largest  -category  of  all, 
%3  areation  of  dissemination^  netwo^s  (nearly  23%  of  the  total)  .  And 


it  appeatrs  from^j^her  sources  ^o  be  considered  below  that  even  the 
inft^rmatLon  service  category  includes  more  active  forms  of  informa- * 
tion  service  supplementing  the 'traditional  passive  library  reference 
modes.     *  ,  ' 


When  one  focuses  on  the  newer  dissemination  prcj^raj^i^nitlAtiv.es  ■  ■  X 
of  NIE  and  OE,  it.  appears  that  the  approache's  receiving  *lncf^sdlng 

funding  are  thJTse  that  tend  to  be  active"  and  interperson^i,^     g'^^C  ' 

»        .  ^ 
vorking  through  educational  extension  agents,  local  edUCnatlon  infor-^ 

mation  centers  J,  networks  of  consultartta^  and  interactive  c<liiiftuter- 

i^ed  retrieval  mechanisai&^^   Educational  extension  agents  arui^i^ther 

personnel  workiffig  in  local  districts  are  linked  to.  centfaliiaed 

resources  and  specialists,  often  tn  the  state  cafjitel;  information 

needs  of  local  users  are  determined;  in£(^rmatiori  aii^ 'inctterials  A 

required  co  ^eec  these  needs  ar^  transformed /tv^6:.p;akCicage&  tailor^ 

to  the  user  s  needs^^^^d  consjtraintsj  and  fpHovtiip'  svpp9rt;s  and 

'      ■         *  '  *  "  15 

feedback  mechanisms  are  built'  into  tlje  c^erall  design*^  - 

Initiall-y v*.these*atSproaches  were  developed  itl.OE-funded  pilot 

'  ^  '  16 
state  dissemination  programs  in  four^states*        Under  NIE's  State 


Dissemination  Capacity  Building  Grants  Prog^^,  funding  for  the 
development  of  similar  approaches  was  provided  t;o^  15  states  In  FY 


■J975*     By  FY  1978  as  many  as  AO  states  were  expected  to  receive  such 

17  '         ^  ^  ,  ^ 

grants,      and. plans  called  for  eventually  extending  this  funding  to  ^ 

his  * 
states,  . 


This  active,  interpersonal,  user-oriented\and  field-abased  networking 
strategy  appears  clearly  to  be  the  direction  ifh  which  much  educational 
dissemination  activity  in  the  U.S.  is  moving  at  this,  time^  Additional 
evidence  of  this  is  to  ^e  found  in  OE*s  support  of  the  National 
Division  Network  (NDN)  and  NIE^s  planning  work  on  its* new  R&D  Exchange 
(RDx)  Program.    The  NDN,  for  instance,  links  adopting  school  systems^ 
with  developers  of  validated  exemplary  progarms,  through  the  use *of 
change  agents  who  faciLitfite^he  adoption<|||ofeess.^^    The  RDx  is 
structured  as  a  regionally-based  exchange  mechanism  linked  to  national 
resources,  on  the  one  hand,  and  linking  ^^ents,  on  the' other*  The 
program  is  orienced  toward  a  w1,de  range  of  objectives  which  include: 


-oT  .products,  to  'TOSfit  "V  giAi.ea  ;iieed,;.  .^fdvld^ffrg  direc  t  _seryi<f^  jto-    '  , 
ii%ige  a^ot^ts  .iio-^     Vh^m^^^ulire ,  ii^^^^  /j^t^.  needed 

to'^h^l^f^  pra^titX^c^ri^jc^"  ^dent:^f_^^K&D^  .  which -me§t  tlieir  needs ; 

proN^Stte^  jbrohera^fi^;te^tef.elfrql  s;e't^"i6es\^  help  Iin"ke.ts  identify 
andr^us^  ■^<3isseminacio,Tt*  resovfPcea,  fnore  .ef^ect^fely^  ^tnd  helping*linkage  ' 
agents  "to  facilitate  the  two-way;  fib*^'.:i2i_Jjaf  the  . 

R&D  and  pr/ictice'comunities j  esp^ciii^ily'irtrormatlbn  ab6ut  ptacti- 

■ .  ■    ■      ■  '  '     '  ' '  .  .  V     ^  *  ^l) 

tioner-dfifintid  ne^d^  and  pract^ttlonerrdeV^loped- tKemplary  practices-' 

■     ;        .     ^"       ■ '     ^  ■  %.  ^ 

4.    FaderaX  add  State  Concerns.  Wjth  Coordinating  Dlsgemina^i^^  > 

. .  ■  ,\  ^ 

'  Activities  '  -  " :        ,  ■  ■ 


pver  the  last  few  years,  there  has  ^eri"  growing,^cOfic«rn' about  the 
lack  of  cpordlnatipm  across  the  enormous-'  number  $  of  dissetaination 

programs  in  education.    Poll^y-niakers  have  directed  attention"  at  what 

■     "     ■  ^  *      If  ^        '  '  21    -  '  *  ■ 

.  ".they  describe  as  ^fragmentation  and  duplication,       and  seve^ral  dis- 

r  -  /  ■  ' 

cussions  o£  the  subject  .point  to  Jthe  total  of  208  legislative  mandates 

r '        '  "       "  *  22 

dr  regulations  dealing  with*  dissemination"  in  educatiotl.. 

.    Since  OE  and  NIE  sponsor  more  Vthan  half  of  all  federal-level  education 

'  ■  '  23 

disseminiitidn  activities,  muth  of  the  recent  attention  to  coordi- 
nating dig^^iaation  .prog^rams  has  come  f*rom  the  DHEl'J,  A  Joint  Dis- 
semination Review  Panel  was  established  to  review  claims  of  effective- 

ness  for  prrfduots  developed  under  OE  or  N*IE  sponsorship  and  certify" 

"  .  ,       *  ^  • 

those  products,  which  the^  Evidence  suggested  were  worthy  of  wide  scale 

dissemination-^   A,  Dissemination  Policy  Council>*ftfs  established  to 

cpordinate  th^  dissemination  activities  of  (JE^and  NIE  and  to  consider 

broad  dissemination  policies  for  the  Education  Division  of  DHEW  as  a 

whole.    The  Disseminaf^loa  Policy  Council  created  the  Dissemination  , 

Analysis  Group  (DAG)  to  study  fedei^al  dissemiftation  activities  and 
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to  develop  rfecoiDcien<faE;ions  for  a  comprehensive  education  disserain- 
ation  policy."      MIE  has  supported  the  Interstate  Project  on 
Disseiiiination  (IPOD)  to  identify  state  dissemination  policy  concerns, 


reconimend  rieeded  dissemination  policies  at  the  state  levei>  make 
recommendations  to  DHEW  on  what  they  see  as  needed  federal  dissemin-. 
at,ion  policies  >  and  develop  recommendations  on  the  appropriate  . 
relationships  between  federal  and  state  dissemination  programs.* 
And,  in  addition>  NIE  and  OE  sponsored  a  week-long  conference  of  a^  * 
group  01  more  than  200  dissemination  specialists  representing  a  range 
of  disssTiination  interests*    The  ^conference  produced  a  "Statement  of 
Agrae.:^:-nt  by  Prof ^fss lonals  In  the  field  of  Educational  Dii>semination" 
calling  for  th^  development  of  a  loosely  organized  Natijtwide  J^issem- 

'ibfl.tion  Ct>nfiguration>  recognizing  the  diversity  and  pluralism  in 
the  field  of  dissemination  and  the  range  of  institutional  types* 

■  irtterest.Sj  and  approaches  that  comprise  the  field  of  educational 
disser^inatiorij' and  urging  relationships  that  emphasize  cooperation 
and  accomodation* 

Examination  of  the  literature  produced  by  these  various  groups >  and 
other  riaterial  on  disseminatio  poli<fy>  suggests  that  there  is  di&a- a 
gr^ement  within  the  dissenvination  community  and  among  dissemination 
policy-makers  about  the  forni  and  degree  of  coordination  that  may  be 
needed  to  increase  the  ef f ectiyeness  of  educational  dissemination  in 
thi^  country.     Eotli  the  DAG  and  IPOD  reports  bemoaned  the  fact  that 
there  is  no  single  comprehensive  national  dl'S semination  system>  and 
both  call *for  planning  toward  the  creation  of  such  a  coordinated> 
integrated  nationwide  system^^  _The  existing  f ragmentation>  overlap > 
and  redundancy  in  the  system  are  "viewed  as  inefficient-    For  instance 
the  IPOD  report  prgu^;s  that  "Wtthoud  a  coordinating  dnd  guiding  mech- 
anigT^i,  th^  separate  activities  are  seldom  integrated  atid  directed 
toward  common  priority  objectives/'    The  DAG  analysis  is  concerned 
rliaC  the  existing  multi-centered  strategy  creates  comp^eti tioiS  among 
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dissemlnatiQij  prograuts  and  ilhat  even  sysCem-level  disseindnation 
issiies  are  bein^  addressed  Tmostly  in  a  piecemeal  fashion/* 

i\ 

The  DAG  thus  has  fobused  its  recoinmendaCions  on' steps 
to.be  takerb  to  increase  the  "fit**  between  the-many 
different>  on-going^ac tivities  at^the  Federal  levei> 
and  on  bringing  about  a  '*fit'*  between  Federal  acti- 
vities and  the  numerous  discrete  slevelopments  th^t 
stateSj  local  districts> .and  private  groups  are 
undertaking yto 'improve  their  disseminati<?n  efforts. 

the  vl5Jion  they  descrl&e  Is^  for  ol^mning  toward  a  Fingle  coTipr^ 
hensive  system  —  **&n  overarching  plan  for  integrating  sll  of  the 
various  dlssensinatic^n  network'^  and  activities," 

However*  "cKe^'StatemenV  of  Agreement  by  Professionals  in  the  Field, 
of  Educational  Diss^inatiQn"  suggests  a  much  looser  "configuration^ 
of  autonomous  agenties  and  institutions  simply  cooperating  and 
working  together  as  and*  when  iheiy  see  fit,  ,And  clear  opposition 
to  the  idea  of  a  single^cotnprjehensiye  system  was  suggested  in  some 
of  the  policy  analyses  ^e  carried  out  for  fllE..    The  gist  of  our 
argument  was  as  folIoW;'      •  ^ 


Fail-Saf e  Mechanisms  / 

 '  m  '  ' 

In  spite  of  tne  premium  on  reinforcing  successes  and 
*  avoiding  failure^*  failures  will  iijevitably  occur. 
There  are  ^yst  too^  tn^iny  piiints  of  uiicertainty  and 
unreliability  in  the  chain  connecting  R&D  to  utiliza- 
tion which  in  combination  result  in  low  success  proba- 
bilities.   Fui^the^j  when  the  R/V&l  system  is  iinroature> 
it  becomes  imperative  that  the  dissemination  system  be 
designed  to  be  fail-safe,*  That  is  tOrsay,>  if  the  user 
experiences  failure  in  one  instance>  he  will  be  aware 
that  ^ther  alternatives  are  available  —  as  contrasted 
to  the  user  seeing  the  dissemination  system  as  a  mono- 
lithic: 3ystem>  wherein  the  whole  systenf'is  deemed  use- 
less by  the  usejr  when  he  exp^t*iences  failure  with  one 
part  of  it- 
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Design  Requirenent:  Tt^e  dissemination  system  must  be 
designed  so  as  to  provide  alternative  channels  of  *' 
dissemination  to  the  user*       *  ; 

Streteg^es:    Strategies  should  put  a  premium  on  redu^-  ^ 
dancy,  on  nicking  competitive  alternatives  available^ 
to  th6  user*    Such  redundancy  can  be  achieved  in  either 
o£  tvo  ways; 

1.  Natural  decentralised  variation  and  adaptation: 
When  natural  decentralized  variation  and  adapta- 
tion ^a  re  allowedj  a  variety  of  alternatives 
(even  redundancy)  may  become  available  to  the 

I  user  >  and  the  user  is  thus  less  likely  to  tratisr 

fer  hi^  perception  o£  weakness  in  one  par^t  o£ 
>  the  dissemination^  system  to  ,th^  other  pari;s* 
The  various  dissemination  mechanisTus  shbuld> 
o£  course>  -be  orchestrated  £tom  r  higTier  level, 
*  but  with  a  minimum  o£  visibility* 

t 

2,  A  fail-safe  centralized  sysitem  design:  While  a 
centralized  f^il-sa£e  system  design  is  at  least 
theoretically  possible,  it  is  complex  and  thus 
very  difficulty  to  develop  and  manage*  If 
attempted,  it  would  include: 


a)  disaggregated  parts; 

* 

b)  built-in  competition  aniong  parts; 

K  .  . 

c)  built-in  redundancy  of  a  fev  things 
done  veil* 


Clearly,  regardless  of  what  degree  of  system  integration 
may  be  possible  in  tjie  future>  ve  are  still  a  long 'way  off 
from  either  a  single  compriebensive  system  or  a  fail-safe 
centralized  system  design*    Greater  coordination  and  a, 
orchestration  across  agency  programs,  and  ^icross  fcdemlV 
state,  and  private  sector  institution$> '  is  clearly  ^ca'lled 
for<    Hovever>  ve  voulJ  argu(i>  too,  tljat  the  gains  to  be 
expected  fron  redundancy  shoudl  be  borne  in  mind  in  the 

r 

planning  and  implementation  of  coordinating  mechanisms^ 
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V.     THE  CURRENT  ST^E  OF  DEVELOPHE\T  OF-THE  DlSSEMIN-ATION^  FUNCTIOM'S 
K.NO»LEDCE,  XNSTITUTIOm,  AND  PERSONNEL  BASILS 

The  dissemination' funct ion  appears  to  be  experiencing  rapidi 
development  of  its  institutional  base,  without  adequate  expansion 
of  the  personnel  base  of  trained  dissemination  specialists  or  suf- 
ficient attention  to  strengthening  the  field's  knowledge  and  technology 
^base. 

.   There  have  been  several  signific^snt  efforts  to  synthesirse  the 
^theoretical  knowledge  bese  of  the  disserdnacion  function.        -gut  the 
translation  of  this  knowledge  base  into  usable  strategies  with  known 
"  "effects  appears  to  hav^  ha^rdly  begun. 

'  The  dissenination  specialty' is  a  new  one",  and^  although  there  are 
many  people  carrying  out  dissemination  roles,  there  appear  to  be 
relatively  few  trained  dissemination  specialists.    Most  of  those 
currently  carrying  out  dissemination  activities  appear  to  be  precti- 
tioners  b\  training-    They  are  proceeding  intuitively  and  learrving 
•^%he  dissernj-nation  specialty  on  the  jot.    The  AERA  Task  Force  on 

Training  has  identified  sojme  ,o£  the  competencies  required  for  ef fee-  ^ 

^      '    *  *  J  ^     '  30 " 

'  tiVe  performance  of  disseminatijon  roles.       And  sonje  new  training 

'Vprograms  and  models  for  new  training'programs  have  been  developed  to 

'31 

pnovide  formal  training  for  the  dissemination  specialty.       As  yet^ 
#  ■ 

'   however,  there  do"  not  appear  to  be  more  than  a  handful  of  such  train- 
programs  in  operation.    Consequently,  the  institutional  base  is 
expanding  at  a  rate  faster  than  the  personnel  base  of  trained  dis- 
semination specialists.    The  e£fe<:t  of  this  lacV:  of  synchronization 
is  likely  to  be  serious  staff ing  problems  for. these  new  initiatives  — 
either  unfilled  vacancies,  or  vacancies  filled  by  poorly  qualified 
personnel.    Clearly^  If  this  difficulty  is  to  be  overcome,  a  signifi- 
cant resource  investment  will  be  needed  in  developing  the  knowledge 
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apd  technology  base  of  the  disseoination  -function,  translating  this 
accuiJRjlating  knowledge  b^se  into  training  programs,  and  establishing 
these  training  programs  on  the  scale  warranted  by  the  sfcope  and  rate 
of  expansion  of  the  educational  R/D&I  dissemination  function* 


VI.  CQ^aXI^ING  0?E!^ATION'AL  'EROBLE-MS  11^  EDUCATIONAL  DISSEMINATIO^' 

She  Dissemination  Analysis  Group's  review  of  dissemination  operations 
pinpointed  ll^^operational  problems  oo  which  they  recomnterjded  that 
action  be  taken:  ^      ,  .  ^ 

1.  Target  groups*  for  dissemination  (particularly  <iecisiv>n- 
tnakers)  are  .not  identified  vith  sifficient  precision. 

2.  'Th^tfontentr  and  ^fona  of  much  of  what  is  disse^^inatec^  is 

of  relatively  poor  quality.   '  ^  '  * 

3.  Present  strat^jgies  ^nd  n:^ithods  for  dis;sepina t ion  are  not 
likely  to  achieve  higl\  i^iipsct .  "  ^ 

A.    The  few  Enechanisrns  for  practitioner  influence  and  feed-    '  ^ 
back  to  assist  educational  dissemination  are  weak  and 
irregular*  *  ,  ►  . 

f  w 

5.  Few  mechanisms  exist  ^or  sharing  among  peers,  and 
betweerr  different  groups  of  educational  specialists. 

6.  In  spite  of  the  enormous  number  and  variety  of  educa- 

*  tional  programs  and- materials  in  existence, -  rarely  are 

alternatives  readily  available,  to  practitioners. 

7.  The  practical  blocks  to  effective  prac  t  Ltio  n"5tac  c  es  s 
to  the  existing  educational  disseminautlon  systette^^are 
'great. 

8.  The  incentives  for  practiioners  to  use  the  existing 
dissetnination  systems  are  weak\ 

9.  Evaluation  information  for  judging  among  relevant 
alternatives' is  insufficient.  * 

A 

,10,  The  present  dissemination  system  neglects  the  support 
o8  local  development,  adaptation,  and  unique  mixes  of 
ideas  ^nd  materials  taken  from  a  variety  of  sources. 

11 .  ,The  availability  to*^ practitioners  of  locally  tailored 
training,  tecHinical  ^assistance,  and  on-user-sit^  con- 
sultation is  inadequate^^^^ 


Thetr  analysis  of  how  near  or  far  away  the  field  is.  from  solving 
each'-of  these  operational  problems  was  most  interesting. 

While  there  are  no  simple  solutions  to  any  of  these  problems  >  the 
DAG  believes  the  problems  fall  into  three  broad  groups: 

1.  Sone  have  known  solutions.    The  main  problem  Is  finding 
'  the  personnelj  resourcfes,  and  political  power  to  imple- 
ment the  solutions*     (Tlie  DAG  Suggests- that  problems  1> 
2,  3,  and  5  fall  here*0        '  ^ 

2.  Sone  have  been  studied  sufficiently  to  suggest  approaches 
.with  a  high  probability  of  success*  In  many  cases  devel-- 
opment  of  these  exemplary  approaches  is  underway*  and  for 
some>  Successful  dasionstrations  exist*    The  task  is  to 

^  extend  these  successful  models*     (The  DAG  suggests  that 

^  problems  ^>  10>  and  11  fall  here*)  - 

3*   'rhe  rernainder.  are  merely  in  the  conc_eptual  stage>  with 
mu'ch  more  research^  development,  an<f  searching 
^ exemplary  models  required,     (Probably  problems  6>  7>  8^ 
and  9  fall  hereO^^ 

If  their  analysis  is  correct,  even  with  a  significant  investment 
of  resources  it  will  clearly  be  some  time  before  the  dissemination 
function  in  education  shows  evidence  of  a  high  1-evel  of  maturity* 
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VII.  *T1=E  mURK  ^ 

At  the  present  point  in  time,  the  dissezhination  function  must  be 
assessed  as  underdeveloped  and  weak  in  its  impact  on  the  practice 
system.    IE  it  is  to  be  strengthened,  collaborative  federal/state/ 
local  and  private/public^  initiatives  will  be  needed,  designed 
specifically  to^take  into  accpunt  the  essential  requirements  of 
the  disssaination  Eunctimrai>d  the  current  staJ^e  of  development  of 
this  function  in  the  field'^f  education. 

i 

1 .    Assessment  Basis 


The  Eunct'ion  of  dissemination  Is  critical  to  the  entire  r/D&I  system- 
It  i3y  in  essence,  a  linkage  process  which  "connects"  knowledge 
producers  with  knowledge  users.    Thus>  the  R/D&I  dissemination  system 
Eoust  provide  formechanisms  w^iich:  catr  deterine  what  is  avllable; 
can  ^ort  out  the  "good**  form  the  "bad";  will'  allow  users  to  identify 
and  obtain  the  particular  , products  which  are  relevant  to  their  neads; 
^  can' **ta^lor"  products  as  needed  to  fit  user  needs;  can  motivate  users^ 

>  to  ^^fty"  a  product;  and  can  insure  effective  user  implementation  and 

utilization. 

■  'i  .  * 

Assessment,  then,  must  be  made  in  t^nas  of  caPac ity  to  achieve  and 
success  in  each  of  the  above  re^luirements .    Overall  we  would  wish  to 
know  this  with  respect  to: 

tent  and  quality  of  "reach"  into  user  systet^s  (e.g., 
number  being  reached,  t^e  extent  of  repeat  utilization 
of  dissemination  services,  and  user  satisfaction  with  * 
sucn  service).       *  ' 


■ 
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Leve'ls  of  user  awareness  and  trail  of'R£(D  products 
(existencej  character,  and  evaluacive), 


c) 


receptivity,  etc*,  the  dissepination  function  can  only  be 
assessed  as  a  contributor  to  the  process.    This  niust  of 
necesslyty  be^a  qualitative  evaluation. 

d)    The  existence  of  a  well  developed  and  cooperative  network 
of  dissemination  mechianisms  giving  coverage  across  the 
national  and  to  the  variety  of  users  to  be  found* 

2,    Current  Status 

■       '  ■ 

education,  we  find  a  numb'ir  of  -problems  and  barriers  to  dissem- 
ination.    There  are  an  enormous  number  of  users  (some  17,000  school 
districts  —  plus  fieac^ers,  etc),  among  whom  the^re  is  wide  diversity 
and  variefy  as  to  philosophy,  interests,  perceived  needs, 
Innovations  make  demands  on  the  time  of  school  personnel  (^very 
practical^  matter  )  and  generally  require  "people  change*'  —  factors 
which  can  lead  to  resistance  to  innovation.    Additionally,  at  least  * 
two  major  factors  have'^tended  to  create  a  very  poor  climate  for 
disser\ination  .in  education;^  (1)  a  lack  of  implementation/utilization 
support  to  the  user;  and  (2)  the  perception  that  the  outputs  of  the 
(for  the  most  part)  new^y  created  R£(D  system  have  generally  been 
inferior  to  exi^iting  user-develope^i  products* 

In  eduCfition,  there  has  be^n  a  considerable  amount:  of  activity  that 
has  been  called  dissemination,  and  ^  large  number  and  variety  of 
organizations  are  involved  in  some  kind  of  dissemination  — ,but  niuch 
of  this^has  been  ft'agmented  and  scattered  Ce<g*>  "add-on"  to  development 
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projects;  successful  but  separate  and  discrete  disseTuination  systems 
for  specific  categorical  programs) r    As  yet,  however,  there  is 
relatively  little  coordination  of  federal,  state  and  local  resources 
nationwide^^and  no  systematic  way  6f  tapping  into  the  whole  nation7 
wide  resource  base.    Further^  there  "is  not  yet  a  well  developed 
personne*!  base  of  trained  dissemination  specialists.    Some  federally 
funded  programs  have  been  developed  in  recent  years  for  training 
dissemitiation  and  utilization  specialists,  but  dissemination  mechan- 
isms ai;e  expanding  far  more  rapidly  and  creating  a  far  greater 
demand  fo^  trained  personnel  than  these  urograms  could  even  hope 
to  keep  up  with* 

*3.  %ey  Needs       *  * 

f  From  an  overview  perspective,  th^,.  the  need  is  for: 

c 

a)  orchestration  of  educational  R/D^I'dissemifiation  from  a 
r       tot^l  system  perspective 

b)  in  the  short  term,  facilitating  the  work  o^f  existing 
dissemination  i:iech^isms  and  "'filling"  critical  "gaps*'; 

c)  in  th^  long  term,  providing  for  overall  system  building 
.  (tbis  Vails  for  policies  and  strategies  which  are  pxo- 

actirffe,  not  passive  or  reactive>  and  which  are  based  *on  a 
^  knowledge  of' what  does  and  .daes  not  in  fact  exist);  and 


r 

dj    balancing  short,  and  long  termjcjeeds. 


More  specifically,  policies  and  strategies  fedeiral  funding  agencies 
will  need  to  be  developed*  in  collaboration  with  the  states,  to  ?ocus 
upon;  J 
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a)    qua1,ity  control; 


b) 


mechanisms  that  can  optimize  product/dissetaination/user 
"fifs";        '        *  .  -  ,^     .  ^ 


provid*Lcig  users  with  altfernat^er-^-chancie 


5ls\f 


access  to 


available  resource  b2se  (a  **mixed  strategy"  approa'ch 


Keeping  iMi  mind  the  limited  level  and  rat^e  at  which  users  can 


absorb  hew  input  once  a  disseiait^ation  systeui-'is  .established  (a 
facutc  whitjh  is  ^of  critical  importance),  disseminatiorL  policy  will 
n^ed  either  to  expand  the  dissemination  technical  assistance  capabil- 
Ity  or  slow  th^  rate  o£  dissemination  syS^p  expansion.     To."  achieve 
a  balanced  and  appropriate  growth  rate,  ongoing  monitoring  or  the  * 
dissemination  function  will  be  ess'enti^al- 


t 


If 


er|c 


15  ..>.. 


961  ' 


FOOTNOTES 


*For  instance,  see:    Ric;hard  A  Bateman  ot  al*,  A  Pro.lected  Role 
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R£r:<  System;  ■  Concepts,"    Strategies^  P"Gtices-rjia  Oy^^i^riewj"  in 
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and  Recommendations,  (Raleigh;  North*  Carolina  State  Department  of  " 
Education,  1976);  and  Dissemination  Analysis  Gtoup,  Educational 
Dissemination  in  Relation  to  Public  Elementary  and  Secondary 
Schools:  Report  of  the  Dissemination  Analysis  Group  to  the  Dis- 
gemination  PoMcy  Council,' Preliminary  Final  Report^Washif|^-ton: 
Office  ofithe  Assistant  Secretary  for  Education,  .DHEW,  Septeniber 
30,  197(0.  .    '  ^ 

S*  ^  Disseraination  Analysis  Group,  Educational  dissemination  in  delation 
■  to  Public  Elementary  and  "Secondary  Schools,  op^ "cit . 

6*jIBIbi;  IPOD>  Report  and  Recommendations,  op\  cit. ;  Henry  Briclcell 
et  al..  Report  of  the  Di.'^spmination  Advisory  Committer  J:o  the  Nat- 
ional Center  for  EducationaV. Communication  (Washington:  National 
Renter  f ofsEduC^tional  Communication,  Office  of  Education,  1970)^ 
ERIC  ED  OAf  871;  Ronald  Hay-elock  et  al*,  Recominen6ations  for  the 
'Disbeminatai5n  Program  oi  the 'National  Institute  of  Education  Con- 
cerning >(1)  Needed  Research  on  the  Dissemination  Pro<iess,  and 
(2)  StTate^ies  ft>r-NIE's  Own  Dissemination  and  Utilization  Effort 
.      (Washington;  NIE,  1972),  ERIC  ED  0SS'*4l3;  also  see  D/Weiler, 
^  fi^he  Dissemination  of  Educational  R&D  Produces;  Research  and 
i  JKlicy  Issues  for  the  FeiJeral  Government  (SanTa  Monica :  Rand  > 
\   Corporation,  19-73).    ^  *  .  ■  *  ^ 

iscussions  of  this^  in  our  chapter^  on;^  the  historical  devel- 
c^of  . educational  R/D  5  I  (tj:ie  section  on  degree  of  system 
egregatlon  $s  an  indicator  of  its  present  state  of  development); 
the  outputs  of  educatioTial  'research  and  R/D  &  I;  and  the  implemen- 
tation'^nd  utlization  functions  In  educational  R/p  6  1* 

8*    William  J.  Paisleyet  al,,  RecoTnmendatioos\f or  thfe  Dissemination 
and  Utilization  Program^of  the  National  Institute  of  Education 
(Washington;  niE,  1972) 


9.  Ibid. 


am  ^01 


10,  Dissemination'AnaJ^sis  Group,  Educational  Dissemination  in  Relation 
to  Public  ElrfmefTtary  and  Secondary  Schools,  op.  cit.;    JPOD,  Report 

.  ,   and  Recommendatibps,  op.  c^t. 
■  '  »^ 

11.  Paisley  et  al^-,    RecpmriTendati'cms  for  the  Dissemination  and  Utiliza-r 
■  ■  *          *  tion  Program,  ^gj_clt^,  -  [ 

^12*    For  instance,  see;    Joha  M .  ..Coulson,  Toward  Establishing  an  Education 
Information  Diits^mlnatiori"  Center  (Washington;  KIE,  X972);  NIE,  Bulld- 

-     \"4rng  Capacity  "f  or  ^Reneway  and  Reforim,  op^. ,  c^t^    NIE,  Dissemlxrat ion 

^nd  Resources;  Group  Pro^ram^  Plan>  FY  lW.fi, ^op,  cit^         '  * 

13.     See  especially:    KIE;,  RFP  to  EstabljLsh  an  R  &  D  Dissemination  and 

Feed  forward  SystenPj  op.  cltTl    Klefn,  McC^^nn,  and  Sailey,  "The  R  &  D 
:     "-Exchanie:  An  Emerging  Effort,".,  op.  cit^;  'KIE,  A  Concept  Paper  for 
.  School^ractice  and  Serv'^ee  Division,  Qp>  cit. ,  tiational  Institute 

.       \         _   of  j=;ducatiQn^  FY  1976  Prof^^am  Budget^jjWashington :  NIE,  February  A f 

 _^  ^ :  :     1 .  .  L_ 


963 


1976);    and  National  Institute  of  Education,  Frelimi.n;fry  Prosram 
Flans,  FY  1978.     BKecut'ive  Sunanary  (Washington;.   KTE,  July  1976). 

•  r 

14»      Ward       Mason,  Carnot  E.  Nelson  and  William  M»  Somers,  Federal  Funding 
for  Education  Knowledge  P-roduction  and  Utilisation?    KPU  Function^  By 


ERIC 


Agency  (Washington;    R&D  System  Support  Division,  National  Institute 
of  Education,  1977),  p»  18,  Table  4»    For  a  discussion  of  the  NAS  data 
base  from  which  these  figures  have  been  derived,  and  how  this  compares  ^ 
to"  other  funding  ^ata  bases^  see  our  chapter  on  the  funding  of  educa- 
tional *R/D&I»    N*ote;    the  figures  shown  here  are  rounded  to  the  nearest 
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^  \  1(3*      National  Institute  of  Educatioa,  1976  Databookr    The  S#atus  of  Educa- 

tion Research  and  Development  in  the  United  States  (Washington;  NIE, 
1976).  .  '  .  . 

'     ;  ^      -    ■   '  •     ^         ft.  ' 

19*      For  instance,  se^"*the  NDN  program  description  in;    John  A*  Emi^it^Sp 
Susan  M»  Peterson,  and  Rekha  AgarWala-Roger^,  Evaluation  ag^^fKV 
National  Diffusion  Network,  Vol\  I:    Findings  and  Recgyiiendat ions. 
Final  4^port  (Jter^lo  Park:    Stanford  Research  trtgtitute^  1977).  ^ 

20.  *  For  inst^ce,- see  t^e-^RDx  deecription  in  Klein,  McCanrJ,  and  Sailey,  * 
*'Th5  R&D  Exchange:  ^  An  Emerging  Effort/'  op,  cit,  -'J  ^ 

t     ^ '*  Di^seminaWon  Analysis  Group,  Educational  Disseminag|fon  In^Re^ation  to  ' 

\  *  Public  Elementally  and  Secondary  Schools,  op>  c'jt.     1  .  . 


22...  ■  ;  <  and  BPOP,  Report  an<y  Recomfftendations,'  op.  ■  cit. 


/ 


p.  ^1^  Table' 

24.      DisseminatiojRjhaliya^^  Group,  Educfi^onal  Dissg^ainatlon  ia  Relation 
^  *to  Public  glemeritary  afid  Secondary  Scjpools,  o^L/.yit^t  ^  ' 


23 »    .  llason,  N^elson,  ^and  S(jTiers,  Fi^eral  FoMing  for  Education  Knowledge  \^ 
.  Production  and  Utilization:    WU.Fanct\p_^  By  Afiency,  op.  cit.. 
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25,  ,    NIE,  1976  Databook,  op.  ext. 

26»      Richard  E.  Schutz,  "A  Declaration  o£  Educational  Dissemination/' 

and  "statement  o£  Agreement  by  Professionals  in  the  Field  of  (Educa- 
tional Dissemination,"  Educational  Researcher,  Vof,  6,  No*  10,  November  ^ 
1977.      ,  ,  , 

27.      Disseniination  Analysis  droup.  Educational  Dissemination  in  Relation  to 
Public  Elementary  and  Secondary  Schools,^  op*  cit.,  pft*  13* 

28*      Michael  Radnor^  Harriet  Spivak,  Durward  HoEler,  and  Earl  C*  Young, 
Aaen^y/Fiel^Jtelationships  in  the  Educational  R/D&I  System:  A 
Policy  Analysis  £or  the  National  Institute  of  Education  (Evans ton: 
Center  for  the  Interdisciplinary  Study  of  Science  and  Technology,  , 
IJorthwestem  liniversity,  1976)  pp.*  145-146;    also  see  Radnor,  Rich  and       *  ^^ 
Hofler,  "The  KDx  System:    Concepts,Strategies,  Practices  —  An  ^ 
Overview,''  op*  citf  ' 

29.      For  instance,  see:    Ronald  G»  Havelock,  Dissemination  and  Translation  - 
.  Proles  in  Education  and  Other  Fields^  A  Comparative  Analysis  (Ann 
Arbor:    Institute  for  Social  Research,  University  o£  Michigan,  1967)^ 
ERIC  ED  015  535,  published  in  Kitowledse'Production  aftd  Utilization 
in  Educational  Administration,  T*  Eidell  and  J*       Kitchel^  eds*  ^ 
(Eugene,*  Oregon:    Center  for  the  Advanced  Study  9f  Educational 
Administration^  1968);    Ronald  Havel-KJt^^  A  Comparative'  Stf'udy  o£  the 
Literature  on  Dissenination  and  Utilization  of  Scientific  Knowle<ffee 
(Ann  Arfaot;    Center  for  Research  on  tlie  Utilization  of "^^fientific 
Knowledge,  'Institute  for  Social  Research^  "University  of  Michigan, 
1968),  ERIC  ED  029  171;    Ronajd  G*  Havelock^  A,  Guskin,  M*  Prohman,  • 
M*  Havelock, 'M*  HilT,  atid  J*  Huber^  Planning  for  Innovation  Through 
Dissemination  and  Utilisation  of  Knowledge  (Ann, Arbor:    *Center  for 
Research  on  the  Utilization  of  Scientific  Knowledge^  Institute  for  * 
Social  Research^  University  of  Michigan,  1969);    Mlqhigan  D^artment  ^ 
of  Education^  Research  Implications  for  Educational  Diffusion^  Majoi^-  * 
Papers  Presented  at  National  Conference  on  Diffusion  of  Educational 
Ideas  (East  Lansing:    Michigan  Department  df  Education,  196$X;    an4  ' 
Cresap,  McCormick,  and  Page't,  Inc*,  Oevelopinfe  a  Framework  for  the 
DissetPination  o£' Educational  RciD  Products,  Report_to  DHEW,  February 
1976,  '  There  are  also  at  least  three  classics  in  the  literature  that 
should  be  consulted:  'Everett       Rogers,  The  Diffusion  of  Innovations 
(flew  York;    Free  Pi;ess^  1962);    Everett  M*  Rogers  and  Floyd  F,  Shoe- 
maker   Communication  6t  Innovations;    A  Cross-Culteral  Approach 
/  TGSew  York;    Free. Press,  1971);    and  Elihu  Katz,  Martin  L/  Levin  and 
Herbert  ^laihilton,  "Traditions  of  Research  in  the  Diffusion  of 
^   .  "     ■  "  Innovations,"  American  Sociological  Review,  -Vol.  28,  Ko.  2^\FGfaruar5r^ 

^1963*  '  ..." 

30*      "For  instance  see  tfae  references  cited  in  footnote  17  in  our  , chapter  on 
■    ^     the  personnel  base  of  eaucationaL  K/D&I*    ^  * 

3r:      For  instance  see;    D,  L*  Stuff lebeam.  Proposal  for  Design  New  Patterns 
for  Training  Research,  DevelopmentV  Demonstration/Dissemination  and 


965 

Evaluation  £a^onnel  in  Education  (Washington:^   DHEW,  X970);  Colin 
Mick       alA'  Development  of  Training  Resources  for  Educational  Exten- 
sion Se^fces  ^Psrsonnel  (Stanford^  Institute  for  Communication  Research 
and  SSnta  Mohica;    System  Developmetit  Corporation,  1973)  j  ]7 
536^*^  and  Bela  H.  Banathy  The  Education  Information  Consultant: 

l,g^lls  j^n  Disseminating- Educatioji^l  Informatiorv  (Berkley:    Far  West 
laboratory  for  Educational^  Research' and  Development  >^J^72) ,        071  689^, 

Dissemination  Analysis  Group^  Educational  Dissemination  in  Relation  to 
Public  Elementary  and  Secondary  Schools >  op.  cit. ^  pp,^  7"8* 

Ibid.,  p*  9,  ;  ,  *  .  * 
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The  acquisition  function  provides  the  entry  point  through  which  exter*- 
.nallv  developed  R/D&I  Innovations,  or  ideas  or  Information  relevant  to 
internal  practice-based  developcient  of  other  Innovations  >  gain  access 
to' the  operating  system.    We  h^rve  come  Increasingly  to  thinlT^oi  ttie 
acquisition  function  in  terms^'^k^both  these  eicternal  and  Internal 
development  processes.  ' 

1.  For  exrernally  developed  innovations,  the  acquisition  fur-c- 
tion  represents  the  critical  KP-^KU  interface  betveen>  on 
the  one  hand>  the  dissemination/marketing/distribution  . 
outreach  activities  of  KP  organizations  (or  specialized 
linkage  organizations)  and>  on  the  other  hand >  schools 

or  school  districts  as  user  organizations/ 

2.  E\^n  if  one's  foc^s  is  on  internal  development    activities  > 
unless  one  subscribes  to  the  view  that  all  school  systems 
solve  their  probleias  or  carry  out  their-  functions  in  total 

<  isolation  ftoD  *jjhat  is  going  on  elsewhere,  ideas  or  infor- 

mation must  *enter  the  system  sociehow  —  either  a  stimuli 
for  the  internal  developmeij^t  work  or  as  information  inputs 
to  that  work.    Conceived  in  this  way>  'acquisition  re£ers 
^       to  the  key  information  flow  entry  points  for  inputs  to  the 
internal  development  process  from  sources  outside  the  par- 
ticular innovating  uni^  (whether  the  ideas  or  infotmatioil 
come  frQjm  a  specialized  R/D£(I  organi^z'ation  or  from  another 
schoolj  from  the  community  >  or  some  other  source). 

&onciptually>  the  acquisition  function  includes  acquisition  of 
information  (research -findings  >  "knowledge*' >  etc.)  as  well^s  , 
acquisition  of  package  innovations.    However,  we  hav^  already^  " 
discussed  information  flows  into  and  within  the  operating  system 


V 
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in  an  earlier  chapter.    Therefore,  we  will  concern  ourselves  here 
with  only  the  acquisition  function  as  it  pertains  to  acquisition 
of  externally  developed  (and  probably  also  ''packaged")  innovation. 
This  point  needs  to  be  underscored  in  order  to  avoid  misunder- 
standing*         are  not  saying  that  external  R&D  is  the  only  or  even 
the  most  important  source  of  innovation  in  schools,  or  that  the 
acquisition  function- should  be  ur^^erstood  only  iii  terms  of  ex- 
ternal R&D*    We  discuss  acquisition  here  in  tems  of  external 
RSD  only  because  the  material  relevant  ,to  acquisition  processes 

for  internal  d^elopiaent  was  presented  earlier  in  another  chapter 

♦ 

as  part  of  a  broader  consideration  of  information  flows*  And 
too,  our  tendency  to  discuss  what  is  to  be  acquired  in  terms  of 
packaged  products,  strategies,  etc.  is  due  in  part  to  this  some- 
what artif icial^boundftig  off  and  handling  of  the  cig^erial  in 
separare  parts  *of  this  volume.    Some  of  the- paints  we  make  about 
acc^uisition  of  packaged  innovations  are  also  relevant  to  the 
acquisi*ti0n  of  information  or  to  acquisition  activities  relevant 
to  internal  development  activities*    However,  we  believe  th^t  the 
key  points  can  be  made  with  greatest  clarity  if  we  limit  the 
presentation  here  to  the  acquisition  of  (more  or  ies^  packaged 
innovations*    Consequently,  we  have  chosen  to  present  the  material 
in  the^e  terms*  * 


We  include  in  our  definition  of  the  acquisition  functioir  all  activities 
of^Htating  system  personnel  (or  Cheir  agents)  related  to  the  following 
six  processes: 


1-    developing  an  awareness  of  what  information,  ideas. 


approaches,  or  packaged  strategies^  or  products  exist  to 
meet  a  predefined  need; 
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2.      searching  for  more  complete  information  about  each 
approach  or 'packaged  innovation  (e.g.,  sources, 
costs,  evaluative  data);  k  ^ 


3,^  securing  bids  from  potential  suppliers  (if  relevant); 

^  evaluating  alternative  approaches  or  products;  o 

5.  making  the  decision  to  adopt  or  adapt  a  particular  * 

.  inno^^tion;  and  '  ^ 

6.  (where  necessary)  purchasing  and  securing  the  innovation^ 


7 

lidkTf  first. 


In  this  chapter,  we  coqsi^r,  first,  the  available  literature  what 
it  does  and  does  not  cot^taln;  second,  how  the  acquisition  function  Is 
carried  out  in^education^  thirds  how  this  compares  to  a  more  idialized 
model  of  innovation  acquisition;    "fourth^  what  issues  th^s  sugge^pts'ln 
developing  policy  options  and  management  strategies  for  restructuring 
find  changing  the  manner  in  which  innovation  acquisition  occurs;  fifth, 
how  the  education  context  affects  the  desirability  and  feasibility  of 
certaip  options  andl  strategic^  *and  suggests  additional  'issues;  and 
finally,  what  more  we  need  to  knov^'before  we  can:  ^  (a)  determine  , 
where  the  most  viable  ^points  of  leverage  may_  be  for  policy  inter*  " 
v^entionj  and  (b)  design  worka'ble  pbllcies  and  strategies  for  improving 
the  effectiveness  of  the  acquisition  function  in  education. 


"  ml 
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-I.      THE  AVAILABLE  LITERATURE  '^^ 

t 

One  of  the  largest  blocks  of  material  in  the  literature  on  innovation 

in  ^neral,  and  educational  innovation  in  particular,  deals  with  two 

aspects  of  th^  acquisition-  function:     developing  auareaess  aod  Raking 

adoption  decisions*    This  material  is  generally  referenced  under  the 

^  *  -  ^  ' 

heading  "diffusion  of  innovations/'  .  But' clearly,  what  is  studied  in 

the  diffusion  resea^'ch  tradition  is  less  c(ften''the  dissemination^ 
^  function  (as  we  described  this  in  the  prerteus^-^ttapter)  than  environ- 
mental, organizational,  and  other  influences  on  tjje  awareness  process 
and  th^  making  of  adoption  decisioTis.    The  substantive  focus  of  tlie^e 

various  analyses  tends  to  be  on  such  matters  as:    stages  in  the  aware- 

1        '  \  ■        *  ■ 

ness- to-adoption  process;    differential  characterisCics  of  school 

systems,  their  leadership,  and  conrmunity  settings  tKat  explain  dif-^ 

ferences  in  adoption  rates;  real  and  imagined  barriers  to  the  adoj^icin 

of  a  given  innovation;  and  the  politics  of  the  adoption  decision     "  ^ 

4  '  / 

process.    Therefore,  the  literature  can  be  characterized  as  highly 

suggestiv^about  some  of  the  inflyences  on  the  acquisition  function, 

but  of  relatively  little  use  in  providing  insight  on  acquisition  pro- 

cesses    themselves       how  they  are  in  fact  carried  out,  and  how  they 

might  be  made  more  effective** 

Part  of  the  problem,  tio  doubt,  stems  from  the  reality  of  the  acqui- 
sition funcltion  as  it  exists       or  more  correctly^  does  not  e^ist 

I  in  the  education  sector*    The  purchasing  specialty  that  one  sees 
^in  Industry  is  either  totally  lacking  in  education  or,  where  ±t  does 
exist,  tends  to  be  highly  restricted  in  its  scope  of  activities* 
For  the  most  paT>t,  purchasing  personnel  i^n  education  d^  little  TOre 

'  than  handle  the  paper  work  of  purchase  orders  and  invoices.    Wheffev^  * 
search,  analysis  of  bids,  and  evaluation  act^ivities  %re  include^  in_ 
the  scope  6/^ui;cha3ing  or  acquisition  operations,  they  tend  to  be  . 
confined  to  purchase  of  conventional  supplies  and  equipment  e,g*, 
paper,  crajrons,  and  chalk,  not  textboc^ks,  new  curricula,  or 
instructional  systems*  ,  ■  ,  , 


.  .   •  ^976  ■       ■  .  '  -  » 

«'  ■  .  ■  .  .  ,  ' 

'*  %  ^he  inc^tt  useful  ^n^terial  we  have  geen  analyzing  weaknesses  in  " 
*        acquisition  processes ,  and  needed  support;&-^r^  those  proce^sses  - 
^  ..^     has  he^  produced  by  ^lE'-'^raft.      Much  of  this  material  has  been  *  , 

dfe^etoped  as  part  o£  the  conceptual  work  feha^.  predates,  and  ^tbe   ^  ^ 
planning  work\currently  going' on  for  a  possible  *R&D  Exchange 
.  .  ^/ program*-   We  w01*draw  heavily  on  this*  NIF  st^f  f  ^1^1^*  It^appea'rs 
^  from  this  material  thafr*NIE  persbnnel  subscribe  to^^a  broad  view  of 

the  acquisition  process  similar  , to  "our  own,  and  have  a^ri^ed  at  some 
^    o4  the  same  concli>slon6  we  have  about  the  kinds  of'R/D&I  policiesj 
pro^rams^  "and  strategies  needed  to^upport  the  acquisition  function.* 
^"X/^hoj^e*  that  opr  anal/sis  will  be  useful  to  the  Insl^^f^ite  iti  ext<indiri^ 
^   ,   ■    ^    these  .initiatives,         ■      j  *  ■  '  i*'^ 


"1 


The  descriptive  -matevial  we  present  in  this  ch^fter^fe  ba^d  orr^^ 

♦  ^ —  -      '    ^  f^' 

*  bits  and  pieces  in  the  literature,  and  oyr  own  obserf?%tions  and  ^ 

ft 

^    ^analysis^',  lAttXe  of  this"  has  a  strong^empirical  base.    Most  of 

what  ^l^in  tSe  literature  i's  commentary,  judgment,  opinion,  in^ 

^tuition  ^nd  the  like  rather  than  the  findings  q£  systematic^ 

.         *      ■  ■ 
'research,  **t4ich  of  the  same  is  true  pf  pur  own  6hservations\ 

'  Smp^iiica^J  woxk  is  sorely  needed ^o  verify  and  extend  th'<#material^ 

pres^ted  herfe>^and  to  proyide  the  beginnings  of  a  strong  litera- 

■    ture  an  the"  sutjiect  around  which  a#ne«ded  research  area  canj^e 

<Sevel<Jped        *  '     ■  ^ 

II.      EXISTING  ACQUISITION  PATTERi^  IH  EDUCATION  . 


^  1/     Lack  of  an  Institutionalized  Acquisition  Function^  ' 
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The  acquisition  function  is  v*^tiviV>y  none?fi?tent  in  education  as  a 
speci;altzed, "  institutionalized  acXivitj.    "At  pres'^nt,  the.  acquis  ition 
entiry  points  are  scattered  throtighout  the'' operating  system.  ^  fne        ^  ^' 
^  awareness,  interest",  i^nf&rmation  search,  etc,  that  Bring  a^ne^^^dea,* 


"approach^  or  packaged  strategy  or  pro<f5cjtlil^to  the  innovation    *  * 
*  decision  process  may  begin*vith  taachers,  principals^  curriculum 
^specialists,  the  Superintendent  or  membe^rs,  of  his^  or  jier  ^s'taff  ^  ' 
or  even*parents  or  cprmaunity  Fesideats. virtually  anyone  dn  *a    '  ^ 
*  ,         ,  , school  sys,tem  or  its  environment*    This  can  be  a  significantvSDurce  ^  ^    V      '  . 
^      o£  strength  for  the  acquisition  process;     the  lao^e  s'ources  of  ideas, 
^  su^gfes'tions  J,  inforraa^on,  etc,  the  vlder"the  range  of  possible 

'    '  r^ew  ideas  or  innovations  that  are  likely  to  be  considere'd  , 

System  declsionniakers ,  and  the  better  informed  the  decision  process^^\ 
is  likely  to  be.    ilwever^  a  significant  weakness  of  exi^Jfcg*  acqui- 
-  /     _  *       sitipn  patteVns  In  educatiga^i-s  that  it-  is  relatively*  rare  fcb'  find    .  ^ 
anyctpe -  responsible  for  initiating  and  carrying  out  information  or 
*   ^  innovation  acquisition  activities  as  a  ma^or  rather  than  an  inci- 

^  derji^l  part  of  bis  or  her  job^  Consequently,^  in  the,  absence, of  * 

'  specialized  resources  allocated  tQ  this  function^  acquisition  pro- 
^       ^  cesses  remaift  largely  epi-sodic,  haphazard,  and  randi?in^-  not  well  ' 

*  '  integrated  into  system  functioning'^  and  long-tenn^  planning* 

*  *  '^^  avoid  misunderstanding^  l^e^hould  disl»inguish  betveen  the  acqui-  , 

^Vtion  of .  conveYitaonal  supplies,  on  the  one  Ifend^^  and  innovative 
'      *     instructional,  orga?j^,2ational>  or ,  administrative  approaches  j  strategies 
or  products  on  the  other^  "  School  systems  generally  Have 

business  o|ffices  or  busitiess  managers  to'handle,  among  other  things, 
the  acquisi^tioq  of,  conventional  supplies  sucji  as  crayons,*  chalk,  \ 
^       paptfr^  e^c*  '  Tj^e  acquisition  process  for  «uch  conventional  supplies 

ap^ai?l*  to  be 'littl^  different  from 'purchasing  opgpations  in  industry/ 
,    There  are  established^  suppl^iers,  cata^Xoga^f  ^f f Gri^hgs',^^^*^^^^  etc,  , 
V   ^    .  ^E^ltiat^ons  about .  alternative  "^prodticts  can  be  mad^  largely  on  busindf.s 
.  grounds'  Cf*S-  >  cost  ,i  credit  terms  ,  'reliability  of  suppliers-iretc, )  %  V 

It  genera^y  matters  little^  to  thp  echool  personnel  who*  use  .tAese 
supplies  vhic^i  particular  maniffacturar's  prpducts  3re  purchased^ 


s 


.Out  analysis  is  not  .'concerned  vith  these  comventional  school  supplies, 
erg  mark6t.iag  an^  distributi^  channel^^are  reasonably  orderly  and 
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^here  .-(except  in  , the-  case  b£  unusually  small  distticts)  the'acqui- 
sltion  function  is  carried  out  by  administrative  support  personnel 
located  in  organizational  units  distinct  from  instruction  and 
building-level  administration*    Rather^  in  our  analysis  we  are  con- 
'cerned  with  the  acquisition  of  information,  Ideas,  and  various  forrtis 
ofpackaged  innovations  that  affect  instruction,  schooi  organization 
attd  administration       areas  where  technical,*  pt%fes?ional  criteria 
^Blierally  prevail  over  bu^iness^crHjeria  in  acquisition  functioning,  , 
In  industries  wiTh^j/^ii^eveloped  purchasing  specialties,  purchasing  * 
agents  have  the  requisite*  technic^l^  ^prof  esadonaT  b^ackgrounds  and" 
expertise        barge  chemipal  ^irms,  £or  Instancej  st'^ff  their  pup- ^ 
chasing  units  with'  chemical  engineers.    Analogous  ^staffing  in  the 
education  s6ctdr  V^tiW  ^tail  'recrai-^ng-edacatioa-proSeasaonals  VJLtil^^^ 

4 

R/D&I  backgrounds  for  key  positions  *ln- innov^t^on  acquisition  units 
an^  unlikely  prospect  given  the  sinall  ^supply  oT  ediication  personnel 
with  R/DitlT^backgrounds  i  not  th  intention  the  limited  likel^ihood"  of  ' 
more  than  a  sinall  tiumber  of  school  Systems  having  the  "resources  to 
support- specialized  acquisition  units.*""    ^,  ^  ^'"'^  ■ 

"     *        ■       f  '     *  -  .  '  \      — *         '  .  ' 

How,  then^  are  extern^ly  developed  inst^ctional^  organizatib'nal ,  . 

and  administrative  innovatioife  acquired  iq^  ^he  "eojUcatioa  sector?  ' 


The  literature  suggests  a  number  of  gener^izations  tltet  we  can  make 
about  innovation  acquisiCTion  f^rocesses.    We  assuriil  the  validity  of 
these  generalizations  applied  , to  specific  cAses^tll  vary  with  inno- 
vat'ion  ^5^pes,  differences  in  di^emination  s tratei^s#  u^ed  and  their^ 
^fectivenessj  differences  in  the  ki^ds  of  information  made  available 
to  school  systems,  and  dif f erencestataong  school  systems'^,  especially 
in  the  e^rtonu  to  which  specialized  personr.el  and/or  ^esTources  ,are 
available  t^suppoxt  'tl^e  acquisition  function.  «^         ^  ^  ' 

2.      Developing:  Awareness  of 'Information,  Ideas,  or  .Packaged  Inndvati6ns' 

One  significant  caase  of  weakness  of  acquisition  processes  in  '  ^ 


i 
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education  is  traceable  to  the  di££useness  of  tjie  dissemination      ^--i'*  * 
ajid  maiMcetins  functions' 'in  the  education  sector*  _  Tjie  dissetjin^- 
tiori  ancTN^rketirig  system  in  educaf4!on*is  so  inadequately  developed, 
so  diffuse  in 'structure,  arrd^  so  ufm^ordinated  in  channels  that  the 
educational  marketplace  is  chaotic  ^^i-n  natur?^nd  operating  system 
*person^l  face  gifeat^'^f  f  iculties  in  learning  about  or  .evaluating 
the  alternative  products-  on  the  mai^et  *or  exemplary  practip es  in 


other  school' systems  that  might  be  used  toW^et  a  giveft  need> 
A-      Written  Sources^  of  Inf  ogmation  ' 

Professional  periodicals  are  the  most  extensive  source 
inrorniation  about  innovations.    Empi;:ical^data  suggest  that 
as  mahy  as  300    different  urofessional  pub^lications  are 
read  by  edycational  practltionerdj  in  this  country*  Large 
number^s  "of  articles  .in  these  maga^nes  'describe  new  practices  ^ 
,in  operation  in  various  school  s^yspems,  or  new  products 
being  developed  ar  installed  oVi  an  experimental  basis*  *' 
ET^alu^tive  inf orniationt  testimonials,  data  on  ef f ectivet^ess , 
^Cc.  a"re  often  include<r^i^^{n  one  form  on  another.  .  ^ 

Theine  are,  however,  several  dif ficultl^'wlth  this  particular 


p 


awareness  cTia^inel*    The  most  serious  p»blem  is  that '-ftrritten    ^  ^ 
soupces  are^not:  the  professional  educator*s  preferred  source 

r  8  '^^         ^    .        .  .      .  ^ 

of  information,  and  there^ is  suggestive ^evidence  that  perusal, 
oV'professional  publications  i^  an  ect/^ty  'Carrie<f  out  *  ^ 


er|c 


v_  y.egularly  by  only  a  small  Ainor^tty  o^profesS^ional  educators.  ^ 

1  Th^re  are  other  problelR'  as  well.    T^e  pubHicat^n  channels 

^  of  professional  educators  are  hjlghly  nfistructurecl*    There  .  ; 

more  and*  less  prestigious  publication  outlejrs^in  different   '  '  ' 

specialt/ies,  but  there  its  Jiothing  resembling  t^e  "cor,e 
journal"  s^rudturc  fouoa  trt  many  sciei^tiftc  ti&Ld^^  Instead, 
in  the  education  practice  sector  there  are^enorfTRDUp  numbers  of  *     i       <Sf  ^ 
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,  .periodicals,  each  re^cf  by  a  relatively  smal^ number       sub-  ■ 
^^fi^ers'-    'ihi?  clearly    complicates  the  problem  of  developing 

widespread  awareness       bhth  frora  the  Triewpoitit  o£  the  infor- 
•   mation  diss^lnator  and  the  eduaation  practitioner, 


fcB-      Interpersonal '  Communicatian  -  * '  ^ 

Interpersonal  conmiMic4,tion  tends  to  be  the  preferr^  infor- 

^--Mk.'  f  11 

^tian-seeking^sfc^tegy  *^mong  education  practitioners.  'But 
an  ^7'en  smaller  isinprity  of  professional-  educators  appear  to  ' 
have  access  to^  -or  ^jfake  use  of,  the  various  informal  communis 
cation  channels  exis'ting  in  the  field.    Attendance  at  conven- 
tionSj  seminars,,  workshops,  etc.  is  the 'most  widely  used  of 
^    these  channels.    But  compared  to  the  large  number  of  school  * 
districts  and  professiona:!  educators  in  this  country,  •the 
numb*  of  ^ts^ricts. willing  to  allocate  funds  for  staff 
participation*  in  such 'ptofessional  activities^  atid  the  * 
numbi&rfi  of  educator^  .Vho  take  advantage  of  such  opportunitirefs^ 

'appear  to  be  quite  smalls  -  . 

Some  professional  educators  ^  especially  sclToo^  administrators, 
^-^At^  well  connected  to  small^  informal  communication  networks 
that  sprgad^n^ormation  about  new  develppments  by  word-of- 
mouth.    Often /these  networks  are  h'uil't  around  a  hub  of  Shared 
^e^tperlence        for  instance^  past  experience  as  students     ■  . 
togajjj^r  in  a  degree  program  for  school  ^ministrators^  Or  as 
ad^T^ini^^trators  togetherj^n  a*  !^ool^„aJ>4is<rict  from  which 
some  hay^  moved  on  to  other  positions;  ^  (^r  present  experience 
together  in  the  same  district  or  school  system/ or*  on  a  com- 
mittee o?  task  force  of  some  jrrofes^ional  association*  ^■ 
Occasionally>  su6h  networks  have  bee"  lllpe4iti£nall^H>uilt  by^ 

*  organizations  concerted,  with  yicreaaing  inCgrmation  flow  or 

12 

spread  of  innovations*    .  But  such  networks,  also  appear  to 
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ihvolve  only  an  infinitesiml  part  of  the  sector  as  a  whole, 
C-      The  Role  of^Colle^s  and  Universities 

'     '    '        ■    -7  . 

**Colleges  and  universities  play  an  Important  roX.e  In  developing 
a;^aren^ss  o£  Innovat  ive^  id^s ,  practices,  ^nd  psckagtid  products. 
How\rer,.  they  t^nd  for  the  niast  p^rt  to  affect  ths  pre-servlce 

rather  tharf  th?^hservl'ce  training  and  Inforraing  of  practl' 

'      "    13  ^  ^  ♦         +  *  *  ' 

tlonets.      And  there  is  suggestive  evidence  that  the  information 

passed  *6n  by  most  teacher-training^or  a'dministrator-tralning  , 

■programs  tends  to       about  conventional  practices,  approa^ches^ 

14  ' 

and* materials  /  rather  than  Innovations. 


D.      Marketing  Approaches  '  .  ^    -  ^ 

'  Salesmen  and  pr^potlonal  literature/ of ^c'ourse,  play  fe  very 
Inportant^  role  in  developl^i%  awareness  of  new  pT;oductSj  one 
that  should  not"  be  underestimated  given  their,  c^iverage  of 
school  districts  and  the  persuasiveness  of  ntany  Df^the 
strategics  and  sales  material  they  u^e*    However,  l/here  is 

'an  obvlmis  problem  of  self-interest  and  bias  here,  and  a 
sevfe^Z^^y  llmit&u  focifs  on  on^  or  onlj^^^handful  of  different 
Droducts ,    '  '  • 

^  ■         .       '      ".       .  ^  ' 

'  *  '  ^ 

Z.      Th&  ^ole  of  >ConSUltLnfi  and  Technical  Assistance 

 \  — ^    ^  ^  

^      Organ! zajjions  -    ^        '     *  ' 

Consulting  organizations  attd  technical  assistance  p^oups^r^  * 
becoming  increasingly  visible  in  the  education  sector.  -Where 
'Such  groups 'are  high^^y  knowledgeable  and  unbiased,  and  work  in 
ttie  interests  of  their  client, school  sysfeius  to  suggest  Innova- 
tions  that  might  solve  'sone  of  the  district ' prablems ,  they  can 

ba,  of  invaluable  assistance,,    Therer  is  relativei^Tlittle  in  the 

\    15        *  /  J  ' 
literatgr^  abooit  these  groups  as  Tet,   '  Howdvit^  it  woMld  seetJk 
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that  they  are  too  f^w  in  number  and  are  available  to  too 
few  districts  to  haVe  nuch  impact  an  awareness  processes 
to  date.  '  - 


F.    "  The  tSignif  icance  of  llinkages  to  External  Resource 

Systems  '        -  '  ■ 
  M  ■ 

\  ^  '  ^ 

ffh^re  is  su^estive  evidence  in"th&  literature  that  the 

w  ^  .  ,        '  ■  .  ►  , 

avaretiess  process  is  best  developed  in  those  districts 
that-are  th^'most  innovative,  and  that  these  districts 
tend  to  be  the  ones  b^st  linked  to  the, sfxternal^  resource 
system-    These  linkages  to  the  external  resource  system 
are  evidenced  in  the^^professlen^ism  of  their  te^I>ing 
and  administrative  staff  (as 'seen  in  high  levels  of 
readership"  of  professional  publ  ications attenSanoe  at 
professional  meetings^  e^rollm^nt  in  professional  courses^ 
etc-);  or  the  lleadership*  orieiltations  and  styles  of 
principals  or  tiae  Superintendent;  or  the  presence  of 
external  change  %gents  (e.g. ponsultants  or  technical 
assistance  persorniel')  ;  or  especially  the"  existence  of 

curriculum  specialists  Qr  coordinators  on  the  staff  who 

-  T  *        '  - 

deVote  T^ime  and  attention  t(>  d'etermiqing  what  materials  ' 

^  "  '* 

or,other*>ackage<i  prod^ugts  ar&  availarble  for  acquisition^  ■ 

.  -  ,     ■  ,  -<^'        '  -     )f .  ^ 

what  innovative  iddas,  strategics  or  (Tt^actlces"  mightWe 

adapted  an^J  irtfplemerited ,  or^wh^t^'n^^fearch  findings  or  other 

infqrraatto^t  exist.* th^i;  might -h^p,  solve  an  identified 

'^16        "        ^  ■  j  '  *^     '         '    •      I  ■ 

»t  problem,,  -  Thei;efore, ^tt  >jaulii  sepm;  initiatives  to  im-" 

provtr  the  tef f?54''^-^y        ^f^^9ti^^(fpS' 6f  i*he  acqMsition 

....  „  •  ■  r--^.-.n     ^\        f  • 


^  more 'spec 


■provide  this  ^^(kimor^ci^*}  'an^i-'^o^'cf  ^^^^^  the 
syste^,  v\  'V  ^  -  :Vf  ^ • 
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3.      Searching  for  In£ormat£on  about  Alternative  Approa 
Packa^ecf  ?roctMcts  ^  *  " 


dhes  or 


Information  sealrch  st?:ategies  t<j  support  the  acquisition  process  tend 

*  •  r 

to  "be  somewhat  random  and  diffuse  in  the  education  sector,  and  there*- 
fore  highly  inefficient.    Th^TT^s  attributable  in  large  part  to  the  -  ^ 
lack  of     w^t  developed  information  base  or  efficient  information 
search  •too^^^s  for  assembling  needed  data  on:    the  array  of  avaij^able  , 
research  findings  or  other  information,  strategies,  products,  n^riC- 
tions,  "etc,  to  meer  a  given  ne^;  po^^ejj^al  suppliers  of  specific 
kir,;?5  of  infomatlon  or  given  ijroducts  or  types  of  products* or  services;  * 
sites  identified  as  denonst ratting  exemplary  practices  to  meet  given 
_needs;  costs^  facilities,  equipment,  and  training  requirem^nts ;  other 
descripflve^data  on  given  innovations  Bnd  y^eir  implementation  require-  \ 
ments;  and  evaluative  data  on  eacTi  innovation's  effectiveness  on  sped* 
fied  diniensions,  its  side*efrects,  etc. 

There  is  no  systematic:  inechanisia  ^  the  education  sector  to  link 

potential  use$s  to  all  ^Tiailable  Suppliers,  or  ev&a  to  inform  the  ^ 

potential  user  about  who  these  suppKr^^s^are  or  what  programs  or  , 

products  they  have  to  offer.    There  are  soma,  catalogs  of  outputs 

from  Cpdividual  institutions  or  groups  •of  institutions,^^    But  what 

educators  have  needed  are  catalogs  that  list  the*  full  array  of 

products,  ejcemplary  practices,  etc.  available  B,t  a  given  time  ot 

under  development  to  meet  specific  needs,  provl^ng  uniform  infor- 

mat ior#^sugges ting  how  these  alternajs^ves  compare  on  relevant 

dimensions,    NIE  initiated  a  program  to  develop  patalogs- of  all 

available  products  and  exetiq)lary  practices  i^  specific  educational  ^ 
IS  f 

.^reas.       The  first  phase  of  catalog  development' was  concerned  with 
KIE-sppnsored  (and  before  that  OE-sponsored  H&D)  products  only;  this 
resulted  in  the-  197^  publication  of  the  Catalog  of  NIE  Education  Products, 
The  program  was  then  to  be  expanded  to  Include- both  products  developed 


un4ier_NIE  sponsorlj^ip  and  other  non-NIE  products  ^nd  exemplary 

■     19  .  '  ^ 

practices  as*tfell,  '  ^  :  * 


0 


Packaged  innovations  and  materials  present  J^&s^  ot  a  problem  for 
cataloguing  and  describing  uniformly  than  do  exenplary  practices 
that  have  not  been  developed  for  dissemination*    There  are  few 
systematlc^procedures ^ for  identifying  exemplary  practices^  and, 
until  quite  recently,  few  e'fforts  to  document,  analyze,  and  diffuse 
exemplary  practices  much  less  develop  inaterials ,  to  assist  school 
systems  in  adopting  or  adapting  these  practices.     But  here  too,  OE, 
KIE  and  some  SEAs  have  recently  begun  several  important  project^' 
along  these  lines*       The  NIE  projetit  as  planned  included  support 
not  only  for  the  identification,  documentation,  and  verification 
of  exenplary  local  practices,  but  also  for  researcV*-to  develop 
common'*'teminology,  procedure^  Snd  criteria  that  could  be  us^d  in 
the  iderttlf ication.  assessment  and  verification  of  locally-developed 
practice. y/      As  yet,  however,  the  research  component  has  not  been 
lutid\d« 

>  • 

If  HiEtsponsored  research  prajt;cts  ar^  at  some  point  successful  in 
developing  the  needed  procedures  and  terminology,  and  if  the  proposed 
expanded  catalogs  are  designed  effectively,  if  they  provide  compre- 
■hensive  coverage  and  are  distributed  widely  to  school  districts  across 
the  country,  th^n  significant  steps  will  have  been  taken  to  structure^ 
nad  ttfake  more  orderly  and  efficient  and  process  of  searching  for  in- 
formation   about  alternative  approaches  and  inateri^^als  to  meet  district 


needs*      However, ^until  these  goals  are  achieved,  intormatdon  search 

  ',1 

strategies  to  support  the  acquisition  process  are  likely  to  remain 
diffuse  and  ineff i<*iertt*    And  until  that  ti^ne,  it  seems  highly  unlikely 
that  school  districts  interested  in  acquiring  innovative  products  or 
strategies  to  ^et  sp^ific  needs  will  be  able  to  assemble  t:he  kind  of 
comprehensive  decision-oriented  iaformation  base  that  will  permit  them 
to  make  rational  choices  amon^  the  full  ai;ray  of  available  alternatives* 

/ 

Bids  from  gotentiaj.  Suppliers  '  ,     '  ^ 


the  bidding  process  appears  to  b6  more  re"levant  to  the  acquisition  of 
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conventional  supplies,  or  to  services  (e*g*,  evaluation  contracts),!^ 
than  to  the  adoption  of  innovative  products  or  strategies:    as  noted 
earlier,  innovations  are  selected  plima^ily  on  technical,  professional 
grounds  anion  criterial  of  distinctiveness,  rather  than  on  the  basis 
of  economic  and  other  business  considerations*    The  bidding  proc'ess , 
therefore,  is  noc  considered  ia  the  literature  we  reviewed  on  edu- 
cational innovation*    In  areas  of  school  functioning  where  the  bidding 
procass  is  operative,  our  obsenyations  have  uncovered  no  sector- 
specific  attributes* 

V 

5/      2valua^ir,g^  Altarcative  Afiproaches/Froducts  ^ 

^      4      \         '  ' 

This  -is  probably  the,DO^  critica^^tnt  of  weakness  in  innovation 
acquisition  in  educati%**   There- is  relatively  little  evalutative  in- 
forroatton  about  available  products  and  practices  to 'Serve  as  a  basis  * 
-^fpr,  determining*  whether  or  not  to  replace  existing  practices  or 
laatertals  with  new  produces  or  R£cD  outputs^'    Eyen  where  evaluate! 
inf Qtination  about  an^^pproach  or  a  product  15  tJiade  available  to  po- 
tential users,  -different  procedures  and  criteria  are  used  for  vallda" 
ting  different  products,  making  comparative,  assessments  difficult, 

and  products  validated  In  one  form  Qr  apPther  are  coiq)etlng  with  a 

23 

latige  volume  O'f  nonvalldated  products  and  practices*       Under  these 
circumstances,  it  is  difficult  if  not  impossible  ^or  potential  useics 
to  make  rational  choices  among  alternatives*    With  little  evaluative 
information  available  as  a  basis  for  rational  decisionmaking,  knd  few 
gatekeeping  <fualtty  control  raechajtlsms  to  screen  out  weak  Innovations, 
f^ddlsm  has  been. characteristic  of  school  system  adoption  of ««du^ 
cational^ innovations*       Adootlon  decisions  have  been  based  on  tmpres- 
sions  of  a  single  innovation^or  ^  limited  choice  among  alternatives, 
occasionally  suppprted  by  visits^  to  schools  wbere  upe  of  partficular 
produces,  practices,  or  progranis  couXd  b^  observed  and  where  school 
pecsonn^  Involved  in  the  implenentatlon  process  could  ue. questioned 
'about  ^roblems^  effects,  etc*.  .  ^ 


One  additional  problem  in  the  evaluation  process  should  ^e  noted* 

In  case?  where  evaluative  data  ar^  provided,  the  potential  user  is  * 

.often  faced  with  the  difficulty  of  interpreting  findings  phrased  in 

technical  statistical  j^gon  (and  often  the  added  difficulty  of 

dealing  with  his  own  healthy  skepticism  about  the  use  of  statistigg^-jj^^ 

for  persuasion  purposes)*    Rarely  does  the  potential  user  have  the 

expertise,  or  the  expert  respurces  available  to  him,  to  adequately 

analyze  statistical  statements,  interpret  their  meaning^  and  frame 

the  kinds  of  questions  that  naed  to  be  asked-  to  determine  exactly/ 

what  claims  can  or  cannot  be  mad^  for  an  ^^ovation  based  on  available 

data*    Clearly,  then,  this  cooiplicates  the  problem  of  evaluating 

alternative  offerings,  even  when  evaluative  data  are  availat>le*  As 

originally' conceived,  NIE's  Consumer  Infonuation  program  (now  part 

of  the  planned  R^lD  Exchange  Program)  was  to  provide, needed  supports 

for  th'^  acquisition  and  implementation  functions  including  activities 

designed  to  provide  uniform,  comparative  evaluative  information 

across  the  whole  range  of  products  and  practices  available  to  meet  ^ 
25  ' 

a  given  need*       However,  whef  this  will  look  like  in  the  futurfe  ^ 
R&D  Exchange  Program  is  not. entirely  clear  at  this  point*    Evetv  the 
probability  that  there  will  in  fact  be  a  future  R&D  Exchange  Progjtam 
is  far  from  certain*    Therefore  ,^  there  is  no  way  of  assessing  at 
this  j>oint  tt/e  extent  to  which  these  proposals"  are  likely  to  have 
any  future  "impact  on  acquisition  processes  in  e<Jucation,  either  by 
providing  some  order  to  the  educational  marketplace  or  needed  supports 
for  the  acqdlsition  function* 


6*      Mafcin:^  Acquisition  Decisions; 


The  acquisition  decision  process  is  affected  by  a  host  of  organ^ational , 
political,  and  economie  factors  that  we  will  consider  in  a  subsequent 
section  on  contextual  factors  that  influence  the  ac<^uisition  function* 
At  this^  point,  tec^hnical  decisitFfi  problems  concern  us,  not^T>ly  the 
iosuf ftciency*f  information  .to  permit  rational  choices  among  alteV- 
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natives-    The  decisionnaker  is  confronted  with  the  difficulty  .of 


deterrsinLng'whether  or  not  t^ replace  an  existing  practice,  pro- 
gram^^or  set  of  inaterials  with  an  alternative  (or  choice  among 
alternatives),  proposed  for  adoption.    And  he  must  inake  his  decision- 
in  the  absence  of  clear,  highly  usable  information  about:  what 
existing  theory* and  empirical  research  suggest  about  the  specific 
need  he  is  trying  to  meet;  how  this  relates  to  existing  .practices , 
etc,  in  his  school  or  district;  what  R&D  products  or  prograins,  or 
exstnblary  practices  used  in  other  schools  or  districts  are  available 
to  TTsest  this  need;  how  alternative  approaches,  products,  practices, 
etCt  compare  on  relevant  evaluative  criteria;  and  what  problems 
alternatives  are  likely  to  encounter  during  the  iaiplementation 
process  in  his  school  or  district* 


-HIE's  plans  for  a  Consumer  Information  Component  in  it^  R&D  Exchange 
Program  were  intended  to  overcome  some  of  these  problems*    In  part, 
tnis  was  to  be  done  by  providing  the  catalogs  and  comparative  evalua'^ 
tive  information  we  considered  earlier*    But  also,  the  program  as 
originally  corfceived  was  to  include  some  activities  designee^  speci- 
fically to  support  the  decision  process  and  Improve  the  quat^^y'of 
acquisition  decisions*    DesC^rtptions  of  these  activities  were  not 
very  specific,  and  concejJtualization   appears  still  to  be  in  only  a 
rudimentary  stage*    WIE  documents  described  the  strategy,  as  one^de-  ^ 
signed  to  transform  the  knowledge  base  in  specific  areas  (e*g*, 
readj^ng,  career  education,  etc*)  into  anaiytfcal  frameworks  for  use 
in  decisionmaking  situations  involAng  ad_option  or  adaptation  of 
innovations  to  nieet  specific  needs  ^    Expected  outputs  were  descj^bed 
as  **pre-daci3lonal  resources  and  procedures  needed  to  help  educators 

identify  proi)lems,  choose  solutions,  and  make  necessary  adoption?  or 

26  _ 
adaptations^**       The  strategy  assumed  that'  innovation  acquisition 

decisions  ^  the  future  are  likely  to  involve  **planned  adaptation** 

rather  than  adoption^  that  decisfonnakers  need  training  and/or 

*  f  ♦ 

technical  assistance  to  enable  them  to  *ffiake  adaptations,  effectiyely. 
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and  tha€  inaterials  of  this  kind  can  provide  needed  supports  for  the 

acquisition  and  iinplementation  functiojns  if  they  are  disseritalnate^ 

through  a  tratning-of -trainers  strategy  and  used  with  the  help  of 

27 

technical  assistance  personnel.       The  program  is  highly  ambitious. 


and  rather' complex.  We  have  no  way  of  estimating  how  effectively  ' 
-  '    ^  '  *  ^  28 

it  will  be  carried  out,  if  at  all,  o^  whs*  its  impact  will  be. 

But  clearly,  the  program  should  be  monitored^ .closely  for  what  we  can 

learn  about  strategies  i^^volving  use  of  macro  level  resources  to 

provide  support  materials  to  enhance  oicro  level  functioning* 

7,      Purchasing/Securing  Adopted  Innovations/Products 

Once  the  decision  has  been  made  to  adopt  a  particular  product  or 
innovation,  the  difficulties  confronted  by  operating  systems  in 
acquiring  the  innovation  tend  to  vary  *with. the  type  of  Innovation 
(especially  the  degree  to  which  it  has  J>een  '^packaged"  for  dis- 
semination) and  the  stat;e  of  <ievelopment  of  the  distribution  channels 
used.    Where  packaged  innovations  are  distributed  by  commercial  firms, 
especially  large  and  well  established  firms'such  as  the^major  text- 
book publishers,  school  systems  ar^  not  likely  to  encounter  sigfJif leant 
difficulties  or  delays  in  ^securing  yhat  they  oirdered.    Greater  dtffi- 
culty  tends  po  be  encountered  with  hon-cotnmercial  firms/ for, instance 
R&D  organizations  distributing  ex^rimental' materials  for  the  field 
test  of  an  innovative  pro-am  un«r  development,    Th^  itrpjlementation 
literature  attests  to  the  frequency  with  which  Implementation  diffi^-/ 
cutties  and  eventual  termination  of  experimental  progratms  could  be 
traced  to  problems  in  production  and  on-time  delivery  of  materials 
rather  than  to  inherent  weaknesses  of  the  innovation  or  unique  con- 
ditions in  the  implementation  setting:    thj^  developer*  s  failure  to  , 

deliver  needed  materi^ls*^n  schedule  made  it  impossible  for  teachers 

28 

to  adequately  meet  the  innovation's  implementation  requirements. 

Most  difficult  of  all  to  ^'acquir^  are  the  ''exemplary  practices" 
.and  "idea  innovations"  that  are  not  packaged  for  dissemination. 
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Instead,,  they  must  be  observed  or  read  about,  and  then  translated 
by  the  adopting  school  system  into  specif icatlons 'and  procedures 
that  permit  trial  ircolemeatation.    In  such  cases,-  the  process, of 
-acquiring  the  adopte<^  innovation  Irvc^olves  a  more  intensive  return 
to  the  information  search  stage,  an  active  adaf\tatlon/internal 
development  process  transforming  the  adopter' s  understanding  of  t^ie^ 
innovation  into  a  concrete  set  p*f  practices,  procedures,  etc*  to 
be  iuiplemented,  and  perhaps  too  an  interactive  exchange  of  ideas 
between  the^  internal  defvelopment  team  of  the  adopting  £^st^  and 
lti;plenentatl(5n* parsonnel  in  -other  syste;ns  that  have  used  the  - 
adopted  Innovation  'in  jone  form  or  another* 


8.      Suininary:      General  Weaknesses^in  Acquisition  Processes, in 
Education  -  -  ^ 


We  have^consldered  a  number  of  aspects  of  innovation  acquisition  in 
education       who  carries  out  acquisition  activities,  how  they  become 
awa^e  of  ideas,  information,  products  and  other  packaged  innovations," 
what  difficulties  they  face  in  searching  for  information^  afeout  alter- 
natives to  meet  a  given  need/naspeciallM  comparative  evaluative  dati, 
^*what  problems  they  encounter  in  tidying  to  m^fce  rational '^choices  among 
alternatives,  V^c,    Although  there  is  clearly  soio&^^riabil^^ty 
cquisKion  patter^is,  especially  between  school  dis^ric^s  that  do  and 
specialized  personn^  and  resources  to  Support  thf  acqui-^ 
sition  Wnction  (e *g* ,  curriculum  specialists),  some  general  comment^ 
would  Veem  to  be  X,^  order  about  the  typical  or  modal  acquisition 
proces^  iri  the  education  sector  and  its  inadequacies*    First,  the 
acquisition  function  is  not  institutionalized  as  a  specialized 
activity  ift  education**   The  awareness^  search,  evaluation,  etc,  ^ 
activities  that  make  Gp  the  acquisition  process  are  cartled  ou^in- 
cidentally  and  haphazardly  by  school  personnel  as  part  of  their  in- 
structilSnal  and  administrs^ive  jobs,    Btit,  it  is  relatively  unusual 
in  school  systems  to  find  atryone  responsible  for  initiating  ^nd 
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tarryiag  out  acquisition  activities*  x^JJJPtSequently,  acquisition  pro** 
cesses  remain  somehat  random  and  episodic,  not  well  integrated  into 
,  system  functioning  and  ^ong-range  planning* 

Whatever,  periodicity  is  presetyi'in  acquisition  processes  tends  to 
reflect  the  requirements  of  the  annual  budget  cycle  and  the  planning 
schedule  for  fall  and  spring  term  changes  in  school  organisation  and 

^administration.    Therefore,*  i_E  a  "particular'priucipal  decide^' that  a 
given  innovation  is  to  be  adopted,  he  wtst  itiak^  his  V^quests  to  the 
Superintendent  for  required  ^bi-dgat  allocatloris  atjd  organizational 
changes  in,  accord  with  this  budget  and  administrative  schedule,  or 
4?    else  wait  unt^ji  the  following  budget  year  or  term*    However,  the 
acquisition  function  has  no  inherent  periodicity  unde^  these  circum* 
stances       i.e.,  no  specific  set  of  activities  undertaken  cyclically 
to  set  the  awareness,  search,  etc.  processers  in  motion  on  a  periodic 

,  basis.  '  Consequently,  it  is  hi^ly  J^ifeely  that  th^re  will  be  flo  stimulus 
to  be^n  th/ acquisition  process,  ajid  no  new  approaches  or  packaged 
innovajiion^  will'^be  ^optied  o^  even  considered  for  possible  adopt^^on 
or  adaptatii^n^a^ii^^i^     school  functioning* 

Second,  ^he  vario^s  channels,  through  which  ^'chool  personnel  are  made 
awarte  of  ideas  or  innovations  available  to  meet  given  needs  tend  to 
be  inadequate  for  reaching  an  audience  as  large  and  as  widely  distri- 
buted 'as  t'he  more  than*1:wo  million  classroom  teachers  and  school, 
administrators  in  this,  country,  and  persuading  them  of  the  need*  to 
.    replace  existing  practices  and^^terlals  with  particular  innovations.. 


Third,  information  search  str^itegies  to  support  the  acquisition 
function  tend  to' be  highly  inefficient  in  the  education  sector  because 
of  the  absence  of  catalogs  lis^ting  and  provi<ycpg  comparative  iuforina-^  . 
tion  about  the  full  array  of  approaches,  prq^ucts,  exemplary  practices, 
relevant  itiformatiPn  etcr  available  to  mea^t^specifi^  needs.     *  ' 
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Pourth>  it  is  difficult  for  potential  users  to  make  rational  choices 
among  alternatives  because  j|^here  is  little  comparative  evaluative 
information  a^out;  alternatives  to  meet  given  needs;  and  even  where 
evaluative  information  is  available  on  %orae  offerings^  validated  pro- 
ducts ^compete  with  a  large  body  of  nonvalidated  practices  and 
products,  '  \ 

Fifths 'few  of 'those  engaged  in  the  search^  evaluations  and  acquisition 
decision  processe^s  h^ve  the  specialized  skills  or  expertise  needed  to 
search  efficiently  for  in-depth  i^ifomation  on  particular  offerings^, 
to  interptet  evaluative  information  about  alternative  innovations^  or 
to  analyze  decision  choices  in  terms'  ofe  the  existing  knowledg^'^base 
on  specific  needs  to  be  m€t  by  innovation  acqtiisitions.    And  few^ 
school  systems  have  access  to  cbnsultants ^  technical  assistance  person- 
nel>  or  other  acquisition  support  resources  that  could  provide "fhe 
i^eedkd  skills.*   Consequently^  Acquisition  decisions  are  generally  made 
on  tfhe  basis -of  limited  evaluative  information  and  without  much  con- 
sideration of  altei^tives  that, might  better  meet  the  system's  need^. 
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There  are  significant  exceptions  to  this  modal^pattern  in  certain 

categories  of  acqui^sitions,    Statexd-de  textbook  adoption  procedures 

in  nearly  half  the  states  in  the  nation  are  certainly  the  most^  notable 

of  these  exceptions.    We  discuss  this  more  fully  in  a  subsequent 

section  of  this  chapter.    Relatively  or3erly>  informed  marketplace 

  *  *  *  ^ 

conditions  also,  appear  to  exist  In  the  area  of  tests  and  uieasurem^ts^ 

Perhaps  this  is  true  because  the  large-scale  K-12  testing 'Tttidua^y  is 
dominated  by  a  few  major  firms-    ?ut  al'&o^  no  doubt>  an  impoi 
factor  h^re  is  the  existence  and  widespread  ua6  of  an  impo^ant  infor- 
mation search  togl^  Btiros'  Mental  Measurement sNfearbooks^    which  sig- 
nificantly  simplifies  the  processes  "bf , information  sjearch  and  evalua- 
tion  of  alternative  te^sting  instruments  to  m^et-spe^fic  needs,  . 

Educational  technology  Is  another  area  of  schoojf  acquisitions  where 
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nKHre  orderly  marketplace  condi'tions  exist.    In  part,  this  may  be  because 
hardware  marketing  and  distribution  channels,  even  for  school  applica- 
tionfi,  tend  to  have  closer  linkages  to  the  broader  industrial  sector 
than't<i  educational  .R/D5dl.    But  equally  important,  it  would'seem,  is 
the  access  school  p'erspnnel  have  to.consuner  testing  and  product  rating 
^tg^nizations  that  provide  comparative  evaluative  information  on  alter- 
native  products  competing  to  meet  the  same^  needs^    EPIE  (tjie  "Educa- 
tional Products  information  Exchange)"is  ah  important  new  organization 

30 

which  provides  this  kind  of  service  to  subscribers*  ^ 

Although  EPIE  has  also  fSublishfed  some  comparative  analyses  in  areas 
♦ 

of  cui;riculum  innovation  (e*g^,  a  recent  comparison  of  more  thaa  700 
products  for  career  education  programs),  for  the  most  part  there  is* 
-as-^yet  relatively  little  that  is  analogous  to'  the  hardware  analysis 
and  gating  in  areas  of  unconventional  achool  acquisitions.  School 
systems  trying  to  idet^tify  and  acquire  innovative  programs  and 
apf>roache3  for  itistruction,  school  organization  and  administration 
must  still^cope  with  all  the  yarious  problems  we  have  considered  in 
our  modal  description  of  itinovation  acquisition  in  education. 

Comparisosi^th  what  we  might  propose  as  a  more  ideal  model  of  the 
acqui^sition  function  should  underscore  the  key  weaknesses  of  acqul- 
sition  proceis&s  in  the\" education  sector  &nd  suggest  possible  points  ^ 
of  leverage  for  policy  intervention.    We  draw  our  model  in  papt  1 
from  noirmative  thinking,  and  in  par£  from        understanding  o$  the  / 
acquisition  function  as  it  operates  in  jtiore  mature- R/D&I  systems.  \ 

III.-     ID5ALIZEB  MODEL  OF  THE  ACQUISITION, PUNCtlON 

Several  requirements  would  seem  to  be  critical  to  a  more  ideal  model 
of  the  acquisition  function  in  user , systems .  First,  the  acquisition 
function  .would  have  to  be  institutionalized  carried  out  in  an  on^ 
going  routiniaed  mannar  by,  op  with  the  support  of,  specialized. 
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'personnel,  in  specialized  organizational  units  or  linkage  organiza- 
tions,  using  resources  specifically  allocated  for  acquisition  processes 

Second,  E^fcl^sition  personnel  would  have  to\be  linked  effectively  to 
decisionmakers  in'their  organiz^ion  who  determine  needs  and  decide 
which  innovations  will  be  adopted  and  tried*    This  requirement  a^stimes 
that  the  acjquisition  function  involves  operations  of  significant  scale 
and  conjplexity',  and  that  thferefoue  the  services  of  acquisition  special- 
ists  are*  considered       essential  pnrt  of  system  functioning  ^nd  are  in 
considerable  demand  by  systeni  de^isioomakers*. 

Third,  acquisition  personnel  would  have, to  be  linked  effectively  to 
dissemination,  mrketing,  and  distribution  channels  in  the  larger 
R/D^I  .system,  to  insure  that-  they  have  a  comprehensive  and  up-to- 
date  awareness  of  all  existing  approaches  a'nd^packaged  innovations 
available  to  meet  specific  needs;  who  the  potential  suppliers^  are 
for, different  kinds  of  packaged  innovations, ^and  the  reputations  of 
each  based  o^  past  performance  of  products  and  other  criteriajNwhat 
the  best  sources  of  information  are  on,  specif ic  kinds  ©f  data  to  be 
provided  to  ^the.  organization's  deci3i*onmaker3  for  different  kinds  of 
Acquisition  decisions,  especially  evaluative  information  on  alter- 
natives; what  other  organisations  have  experimented  with  particular- 
innovatiolv^^nd  might  provide  first-hanJ' insights  into  the  strengths 
and  weaknesses  of  various  alte]cnative3; .  etc* 

Fourth,  ag  a  cotolla^ry  to  the  preceding  requirement,  it  would  seem 
essential  that  a^well  developed  system  (or  systems)  ei^ist  for'dis*- 
semination/mayketing  and  distribution  ot  this  information  and  the 
packaged  innovations  themselves*    We  would  eJqject  Suqh  a  s^'stem 
(or  set  of  systems)  to  include:  ■  *  - 


-  widely  circulating  and  read  periodicals,  stimulating  awareness 
of  relevant  information  and  packaged  impvatljons  becoming  * 
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a^ailable^s^escribing  their  iinplgmentdtian  in  various 
1^  .  *  ^  * 

settings,  etc;^  '    ,  ^ 


informal  communilbatiQn  networks  anjong  personnel  "in"  opera- 
ting  system^,  technical  assistance  personnel^  and  others 
withj^specialized  expertise,  £01;  exchange  of  inlorma-tion  or 
for  directing.*  those  witti  specific  information  needs  about  . 
given  innovations  (or  inifbvation  types)  to  those  who  can 
best  answer  their  questions  or  provide  needed  data; 

catalogs  of  packaged  inr^p^ations ,  already  available  or 
under  development,  to  tneet  specific  ne4ds,'with  uniform 
inf ormat^id'h  on  inriova^tion  specifications^  ^costs,  per- 
sonnel and  organisational  requirements  foV  effective  im- 
plementation, training  needs,  evaluative  dat^,  etc; 

'  •         ■  ■>  i  ' 

catalogs  of  exemplary  practices'to  meet  specific  needs,  with 
uniform  information  about  where  they  can  he  seen  in  practice, 
who^an  be  contacted  for  additional  information  or  for  tech- 
nical assistance  in  adaptation  or  implementation,  evaluative 
data  validating  cij^ims  made  for  tjiese  practices,  etc; 

catalogs  of  potential  suppliers  of  (HffereqJt'  packaged  inno- 
vations ot  innovation  types,  with  background  information  on 
organizational^  capabilities,  past  track  recorS,'  present  scope 
of^ operations ,  e^« ; 

^  network  of  reputable  te^ti^rig  and  asaessme"nti  firms  or  goverri- 
ment  a^encies*to  'assemble  the  data,  publish  periodically,  ^nd 
"distribute  the  catalogs  -  described  aUove;  ajid 

efficient  distributioli  channels  trf  insure  that  information 

catalogs  and  packaged  innovations  ordered -by  user  systems 

* 

are  acquired  without  difficulty  or  deXay, 


Fifth,  adquisifeioti  p^sbnpel  should  be  linked  effectively  to  imple- 
mentation  personnel  to  aec^jre  from  them:     (1)  suggestions  on  possible 
je^jproaches,  innovatipns,  or  materials  they^would  like  to  try,  to  meet 
'perticulir  needs;  and  (2)  fee4back*on  the  possible  merits  and  weak- 
nesses of  particular'alteri^a^^ives  assembed  by  acquisition  personnel 
throygh  search  processes^    There  is  some  disagreement  im.  the  literature 
«about  ths  importance  of  inipl ^mentation  personnel  participating  in 
adoptioti  decisions       some  viewing  it  as  critical;  others  seeing  it 

as  ^overrated  andj  unnecessary  as  long  as  the  installation  and  trial 
*  '31 

phase  is  handled  adequately*        However,  even  if  implementation  per- 
sonnel  are  not  themselves  involved  in  the  decisfon  process,  informa- 
tion  on  their  reactions  would  sefem  to  be  important  data  for  decision- 
makers  to  have  in  assessing  alternative  choicfes* 

Finally,  where  the  acquisition  function  is  operating  on  an  optimal 
level,  we  would  expect  to  find  acquisition  personnel  linkad  effectively 
to  one  another,  so  as  tc  share  informatioti  and  advance  the  technology 
of  the  acquisition  function*    In  various  industries,  for  ^stance/ 
purchasing  specialists  have  their  own  professional  associations^hold 
annual  neetings,  communicate  through  regularized  channels,  etc.  Con- 
sequently,  acquisition  personnel  develop  a  professional  identify  of 
their*  own  and  increased  familiarity  with  the  infox^tional  and  tech- 
nological base  diE  their  function,  information  flows  more  efficiently, 
and  acquisition  processes  are  carried  out  more  effectively 

IV .  •    ISSUES  '  ^  ,  ~'  , 

I 

Comparison  of  existing  p^tt^rns  of  innovation  acquisition  in  ^ucation 
with  this  idealized  model  ^ggests  a  number  of  issues  that  need  to  be 
considered  in  developing  strategies  for  impriving  the  acquisition 
function  in  education. 
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transferred  from  other  sectors"?    What  kinds^ of  adaptations  are    •  -  \ 
needed?  _  ^        -  ,  ^ 

2^    Increasing  the  Efficiency  and  Effectiveness  of  Channels  for  ^ 
Developing  Awarenes's  of  Innovations  *  , 

How  can  existing  channels  be  used  more  effectively  to  increase  aware- 
ness of  innovative  products,  practices,  etc*  to  meet  specific -{feeds? 

Which  periodicals  reac^  tha^argest  audience  relevant  to  par- 
ticulsr  typas  of  innovations?    l^hat  kinds  of  articles  about 
innovations,  providing  what  ^kinds*  of  information,  in  what  sorts 
of  formats,  ^are  most  effective  in  stiraulatins  interest  in  dif- 
ferent audiences,  and  persuading  them  of  the  potential  utility 
of  a  .given  innovation  to  their  school  system? 

.  Wh^h  conventions  and  what  kinds  of  seminary,  workshops,  etc, 
are^attended  by  the  largest  audiences  relevant  to  particular 
types  of  innovations?    What  kinds  of  oral  presentations  and 
^upj>crrting  maC^rials  describing  innovations  are  most  effective 
in  stimulating  interest  in  different  segments  of  the  audience, 
and  persuading  them  of  the  potential  utility  of  a  given  innova- 
tion to  their  school  system?      *  ^  ^ 

What  kinds  of  informal  communication  networks  are  rao^t  eicten- 
sively  developed  fgv  increasing  information  flow  about  new 
developments?  '  ,How  umiy  school  districts  are  Jlinked  to  .the  ^ield' 
'  information  flow  system  througt^  such  networks,  and  how  effective 
is  the  inforraatlion  flow  about  innovations?    What  kinds  of  school 
districts  are  and  ^re  not  linked  to  such  networks,  and  why? 

I 

How  many  of  the  existing/ college*  and  university  training  programs 
for  school  professionalfe\  disseminate  significant  amounts'  of  up*to 


dat^  information  about  specific  kinds  of  educational  innovations? 

(Which  kinds  of  innovations?)    How  many  schools  tor  departments  of 
^         '  f   '  / 

education  provide  in-service  as  well,  as  pre-serx|ice  training  pto- 

*  grains^    On  canipus?  in  the  school  dis'trlcts  theiBselves? 

^        How  many  educational  innovat^Ais  are  marketed  through  extensive 
campaigns  using  sales  representatives  and  proniotiona^  literature? 
How  many  districts  are  reached  through  these  campaigns?    At  what 
costs? 

^ow  xn^ny  consultants^  consulting  organisations^  and  technical 
assistance  groups  actively  attempt  to  stimulate  client  awareness 
of  available  *inno vat ions?    (What  kinds  of  innovations?)  How 
manydistricts  n^ke  use  of  these  organisations?    How  extensively 
does  each  district  uS6  them^  for-^hat  purposes? 

What  ne^  channels  (if  any)  should  be  developed  to  increase  operating 
system  awareness  of  important  new  Innovations? 

Should  new  periodicals  or  newsletters  be  established  and  distrlbu 
,  ted  free'  of  charge  to  all  school  ^districts?    Can  widely  read 
existing  periodicals  or  ^ganlzatlons  with  ^newsletters  be  per/ 
suaded  to  ^add  a  feature  that  serves  the  same  function  as  estab- 
lishing a^new  periodical  or  newsletter?    How  can  this  strategy 

be  carried  out  most  effectively  and  efficiently?    What  resources 

J* 

would  be  needed?  '  - 

Should  new  Workshop' programs  be  developed?    Can  professional 
associations  be  pers-uaded  to  take  on  a  significant  role  in 
J     adding  such  workshops  to  convention  programs  and  association 
activities? 

♦  F  *  ' 

What  new  kinds  of  netwrks  might  be  developed^  or  what  existing 


networks  might  bd  linked  or  itxpanded,  *to  increase  information 
flow*about  innovations?    Mow  might 'the^^etworking  strategy  be 
achieved  most  effeciencly  and  effectively?  throughwhat  organi- 
zational arrangements?    What  resources  will  be  required? 

What  incentives  can  be  developed  to  stimulate  more  active  in-^ 
volvenient  of  schools  and  ^departments  of  edycation  in  dissemi-  > 
nating  information  about  educational  innovations?    as  part  of 
existing  t^raining  programs?    through .  undertaking  new  research 
and  service  programs?^ 

What  strategies  can  be  adapted  from  the  marketing  an5  promo- 
tional techniques  used  by  cotnmerical  firms  to  stimilate  inte- 
rest  in' their  products?  ^ 

What  new  roles  and  relations^hips  can  be  developed  for  private 
sector  firms  with  well  developed  marketing  capabilities,  to 
participate  in  broader  macro-level  programs  to  stimulate  school 
system  awareness  of  available  innovations?  . 

H6w  can  consultants,  consulting  organizations,  and  technical 
assistance  groups  be  linked  more  effectively  to  macro-level 
programs  to  stimulate  awareness  pf  available  Innovations  and 
*  to  provide  support  capabilities --fqr  evaluating  and  implementing 
Innovative  practices?  ^-^^ 

3^      Design  and  Use  of  an  Innovation*Acquisition  Infortnation  System 

t 

What  are  the  essential  design  requirements  for  an  information  system 
that  can  be  updated  fxequently  with  ease,  and  that  can  b'^  used  b}# 
school  system  personnel  without  outside  assistance,  to  locate  needed 
information  about: ^ 
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alterhative  strategies;*  exemplary  practices,  products,  etc* 
already  available  or  under  devalopment,  to  meet  specific  needs  J 
including  product/innovation  specifications,  costs,  manpower, 
training,  organizations!,  and  facilities/equipment  requirements 
for  implementation,  evaluative  data^  etc*; 


■1 


^  exemplary  .practices  to  roeet^specific  needs,  including  where  the 
pract;ice&  can  be  seen  in  operation,  who  can  be  contacted  for 
additional  information  o^  f or  technical  assistance  in  adaptation 
or  implementation,  evaluative  data  validating  claims  made  for 
th€^se  practices,  etc*;  - 

p6tential  suppliers  of  different  products  or  innovations,  dif- 
'  ferent  product  or  innovation  tjfpes,  or  jparious  technical 

Assistance  or  support  services,  including  organizational  capa* 

\  i  '  '  ^ 

'^illt;ies^  past  tract  record,  present  scope  of  operations,  etc? 


j  * 


What  are  the  most  efficient  and  effective  procedures  to  use  for  gathering 
and /updating  the- needed  information? 

What  is  the  most  efficient  and  effective  mix  of  printed  catalogs  and  ^ 
materials^  access  to  informal  liet^/orks  bf  knowledgeab^le  informants, 
and  access  to  technical  assistance  personnel  to  provide  acquisition 
supfjort  services  Sov^fi  innovation  acquisition  inf ormatior^system? 

4^      Design  of  Procedures  for  Providing  Uniform  Evaluative  Information 

Qi(i.  Altei^iative '  Strategies^  Practices,  Products,  etc*  to  Meet  * 
.       'Soecific  Needs  i 


What  are  the  essential  design  requirements  for  an  analytical  framework 
and  an  efficient,  effective  set  of  procedures  for  evaluating  the  full 
ar^ay  of  alternative  strategies,  practices,  pi^<}diiQts,  etc*  to  meet 
specific  needs?    What  essential  information  must  ha  provided  about  each 


J 


1001 


inno^J^jj^on?    What  are.  Che  inost  valid  and  ;:eliable.,  and  also  cqat- 
efficiejic,  procedures  for  gathering  anrf  analyzing  the  required 
data?  ' 

What  is  Che  most  effective  format  for  reportirig  this  evaluat^fe 
informatLon  on  alternative  Innovations  and  practices  to  meet  giveja 
needs?  :  -  .    -  . 

What  kinds  of  support  materials  and  ^technical  assistan'fce  services 
may  be  needed  to  help  school  personnel  a'ss^^s  this  evaluative  data 
base  in  relation  to  their  needs? 

> 

5.  Design  of  Needed  Supports  for  Acquisition  Decisionmaking 

What  suppcrrts  can  be  designed  to  help  decisionmakers  determine  the  \ 
relative  merits  of  alternative  products,  innovative  strategies,  and^  1 
exemplary  practices  to  iceet  a  given  need  compared  to  the  effects  of 
existing  practices,  products,  etc,  iho^e^n  his  school       i*e^,  to 
determi-ne  how  significant. a  gain,  if  any,  could  be  expected,  on  what 
ditdfnsions,  at  what  cV>st3?  ' 

6.  Integration  of  Acquisition  Operations  with  Need  Identification, 
Long-Range  Planning,  and  Top  Management  Decisloomaking 

If '  acquisition  activities  are  to  be  carried  out  by,  or  with  heavy 
reliance  on,  organizations  or  organizational  units  apart  from  core 
operations  (instruction,  administration)  and  top  management  decision- 
making,  whiit  arrangemsntfs  for  institutionalising  acquisiition  operations 
in  different  organizational  settings/are*  needed  to  insure  integration 
of  acquisition  operations  with  o4;^g^^omponents  of  system  functioning? 
What  factors  must  be  present  in  the  relationships  between  acquisition 
units  and  other  yser  system  components  to  provide  smooth  Integration 
of  acquisition  operations  with  need  identification  mechanisms  and  ' 
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data  bases,  vrlth  perceptions  and  5ensltli7lt:ies  <of  top  management: 
decisionmakers  ^nd  imple1:n4nt:at:lon  personnel,  and  with  long-ranga 
'planning  operations  <^concern^d  with  user  system  capabilities^  those 
alrea*dx  existing  aijd  others  under  development? 

.  'I 


I 


Wl\at  are  the  essential  design  requirements  for  an  infornation'syst(Vi* 

\ 

that;  Integrates  thfe  acquisition  data  base  'on  potential  suppliers  and 
available  products,  'prac^tices*   etc*  with  ^her  system  data  baaes  on 
needs,  capabilities,  operations,  outputs  and  .impact,  so  that  a  cotn- 
prehen3"rv;^e  information  base  is  available  to  anforntu  t^e  acquisition  ^ 
decision  process?         ^        "  -      *    *  ,  - 

V.      CONTEmJAL  FACTORS       .        '  ■ 

innovation  acquisition  in  the  edjitr^tion  sector*  is* affected  ^y  two  wholly 
different  sets  of  ^influences*.    Those  we  h^ve  considered  up  t:o^  thiS 
point  refleci:  technical  weaknesses  in  acquisition  operations  ,in  edu-  • 
cation       inadequately  developed  information  bases  attd  inforjnatl^ 
search  tools,  iaadequatelV  developed  organizational  arrangements  and 
linkages  to  external  resources  to  support  the  acquisition  process,, 
etc.    Our  analysis  h^s  suggested^ t^at  once  these,  technical. weaknesses  * 
are  overcome  and.th^  acquisition  function  is  "ratiqaali^ed;"^*  innova- 
tion  acquisitioTi^processes  will  become  more  effective  and  school  * 
systems  will  be  Vetter  able  to  make  Informed  choices  among  alterrtative 
innovations.    But  will  the .ratf  of  innovation  adoption  increase?  -Will 
greater  awa^reness  of  new  developments  and  exemplary  practices,  -^JM^ 
greater  ease  in  finding  needed  information  about  these  innafra^e^^'^^^^nd 
choosing  among  them,  necessarily  lead  to  greater  willingness  co  'aOTpt, 
adapt,  of  experiment  with  educational  innovations  in  one  forih  or 
another?     *  *  .         "  '  /,  ^ 

The  educational  literature  presents  confi'lcting  assessments  of  the  ^ 
innovativeness  of  American  schools,  juSging  the  schools  to  be  either 
ftighly  innovative  or  changing  at  a  stultifying,- glacial  pace,  depending 
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,  on  the  sources        the  data  and  the  critei^ia  used.        But  regardless^ 

of  th^  conclusions  reached^  the  literature JLa.'-^uite  consistent  in 

presenting  a  picture  of- enormous  ,  barriers  to  change  that  are  peculiar 

^ to  this  particular  context*    Uhless  some  strong  incentives  are 

developed  to  overcome  these  barriers,  there  seems  little  ppint  in 

considering  policy*  ♦interventions  to  rationalize  the  innovation  acqui^ 

sition  process:     many  of  these  obstacles  to  change  atie  so  significant 

that  there  is'littl^  to  speak  of  as  an  innovation  acquisition  pr^cef^s 

to  be  rationalised  in  most  school  districts  --^little  if  any  thought 

of  iTis-ti tilling  changes,  and  a  climate  gene^fally  unsupportive  of 

changes  suggested  by  others,  g^-  '  , '*  t 

At"  least  seven  sets  of  contextual  factors  need  to  be  consfSered  to 
■^understand  the  distinctive  setting  of  the  innovation  acquisition 
■function  in  the  education  sector:     (1)  the  monopolistic  nature  of 
public  Schools;  (2)  their  sociat  and  political  vulnerability  to 
environmental  influences,  reat  or  imagined;  (3kthe  nature Wf'^helr 
governance  structure;  (4) ' legal  constraints  on  innovation  acquisition; 
(5)  economic  constraints  on  innavstion  acquisition;  (6)  the  mature  of 
educational  innovstions-,theinselvj^s;  and  (7)  the  relative  absence  of 
change  agents  in  thfe  ediication  sector.    We  shall  consider  how  each  of 
these  factors  inhibits  t^he  adoption,  adaptation,  or*  even  consideration 
of  innovations  in  the  education  sector,  and  what*  additional  issues 
therefore  inust  be  considered  in  designing  workable  policy  optioys^  and 
-  strategies  t6  increa^s6  school  system  receptivity  to  innovation  acqui- 
sition* '  ,      V  ,  . 

1.  ■   Monopolistic  Watune 'of^Publtc  Schools  ^ 

Fot^mo5t4||^ants  ih  mOst  coitmtunities,  tl^e  local  pul^lic;  schod  has  a 
^virituQl^inft.nopoly  on  the  proarision  of  schooling  for  their  children.  ^ 
Kerttiv^ly/^w  cotmnunities  offer  ps'rents  an  opportunity  to  choose  JErOm 
among  th^^  schools  in  their  district.    And  the  other  types  of  alterna- 
tiv^s.--  sending  one's  children  to  parochiaV  schools  or  other  private 
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schools  or  moving  to  another  xommunlty^ with  better  schools  art 
open-to  only  a  small  minority  of  families, 'l«e« ,  Catholic  families 
living  in  conmtuniti^s  wifhHoc^l  pSrish  schools,"  or  families  witli 
sufficient  inciojue  to  permit  ^them  to  pay  for  private  schools  or  t.he 
move  to  a  community  wi tlfr^otajjly  good,  public  schools* 

One  observer  has  de  the  consequence  <^f  this  monopolistic 

position  of  the  scbools  as  turning*  them  into  "domesticated  organi* 

nations,'*  i*e*,  organizations  ''protected  and  cared  for  in  a  fashit)n 

'  33  1 

^milar  to  that  of  ^domesticated  animal*   .    Public^sc^iools  do  not 

nave. to  compete  for  clients  or  for  ba'sic  operating  funds*  Neither 
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their  survival  nor  thefe  budgets  are  tied  to  the  adequacy  of  their 
performance*    Schools  do  not  havfe  to  be  concerned  about  being  put 
out  of  business^!  even  if  their  performance  ig  viewed  by  their  clients 
as  unacceptable,  and  even  if  their  performance  declines  year^ after 
year^    The  number"  of  students .  enrolled  in  af  school 'is  unrelated  to 
F^arket  forces:     the  steady  stream  of  ''clients"  is  ^assured  by  com- 
pulsory school  attendance  laws  and  geographic  zoning  that  shifts 
school  boundary  lines  in  accord  with  demographic  changes  in  th^ 

neighborhood  population*    As  members  of  a  self-perpetuating  bureau- 

34  '  .  * 

cr^cy,      the  careers  of  educational  pet^spnnel  are  protected,  regard- 

*^ 

lass  of  job  performance*    Competence,  at  least  until  recentj^y,  has 
been  judged  entirely  by  certification  requirements  tied  to  training  , 
rather  than  performance*    Tenure  t(as  ^iven  somewhat  permanent  pro-- 
tection  t9  tho^e  education  prof essionaTs  "cerbified"  and  employed 
beyond  a  short  probationary  period*    Consequently,  there  is  little 


incentive  to  adopt  innovations  JJhat  might  improve  perfomiaRce. 

'  2.      Vulnerability  to^ Environmental  Influence  ,  , 

f  Whether  or  not  a  given  innovation  is  adopted  in  a  particular  coiranunity 
tends  to  be  determitie^^  as  much  by  community  atwibutes  as  characterise 
tics  of  the  innovation  itself*    In  our  earlier  chapter  on  environmental 
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constraints  in  the  education  sector,  we  fconsid-efed  at  great  length'  - 
how  vulnerable  school  systems  are  to  environmental  influences**  Tliis 


vulnerability  takes  on  pa^^cular  significance  Un  its  impact  on  the  . 
innovation  adoption  process, 

EiCternal  prfe^sures  ^an  be  a  major* impetus  to  stimulate  change  In 
school  ,systems.  .  Strongs  public  dissatisfaction  with  the  schools,  , 
for  instance,^  tnay  prompt  school  officials  to  seek  innovations  that 
will  allay  discontent*    Often  this, may  mean  onlj'  a  facade  ot  change 
vhile  nothing  of  fundauieatal  significance  is  altered.    But  qften, 
substantial  changes  may  in  fact  be  instituted* 

A  reputation  for  innovativeness  in  their  schools  may  be  an  attribute 
that  is  highly  favored  by  resi^^ents  ^of  some  communities,  st;imulating 
-school  professionals  to  remain'aware  of  n^w  developments  and  acquire* 
new  strategies,  approaches,  etc*  likely  to  maintain' that  reputation, 
and*  the  public's  support*  However,  environmental  pressures  are  ^ 
even  more  likely  to  impede  than  to  facilic^e  innovation*  Althoug^i^ 

,  there  are  a  significant  number  of  communitles^btjat  take  pr^cie  in  the^ 
innovativeness  of  their  schools,  a  far  greater  num^r,  perhaps  the 
overwhelming  majority,  tend  to  be  conservative  about  ftheir  schools^ 
dnd  Suspicious  of  fundamentally  different  appVoaches  to\hat  schools 

,  should  look  like  and  how  they -should  perform  their  basict^instruc- 
tional  functions*    There  has  b^en  a  strong  '*back-to-basics**^move- 
^  ment  ini,Jthis  country  in  recent  years,  emphasizing  traditional  ap- 
proaches and  ^he  "3R's,**  and  calling  for  elimination  of,  innovative 
**frills/^  .    ^  /  .  . 

School  personnel  are  highly  sensitive  to  negative  reactions  from  the 
.communities  in^which  they  ^work*    ^^ar  of  criticism  from  the  public 
appe^s  ofterTto  be  so  sf;rong  that  even  the  untested  perception  of 
school  personnel^t^iat  the  community  (or^some  small  vocal  portion  of 
,  it)  may  question  a  change  'from*  exis  ting  [fractic^  to  one  or  another 
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exciting  new  de^lopim^nt '±s  sufficient  to  blbck  change  or  even  the 
preliminary  stages  of^  seeking  information  about  innovations  that 
might  be  adopted  ta  ineet  district  needs.    There  ip  suggestive  evi- 
den9e  that  the  ^expectations  school  personnel  have  about  likely  nega-^ 
tive  community  reactions  tend  to  be  stronger  than  actual  cotnmunity 
reactions,  as  seen  in  cas^  whe^e  ^h^  district  decides  mo  go  ahead 
Vith  $n  ianovaiion  acquisition  despite  anticipated  public  reaction, 
'"br  where  without*  incident  administrators  in  a  district  institute  a 
;^hanK  that  Is  not  considered  in  a  comparablie  community  for  fear  of 
public  reacttoji,  ^  Clearly,  then,  th^^vulrcerabiXity  of  school  systems 

to  environmental  influence  can  be  as  much  an  inagltied  barrier  as  a 

I    *  '  35       '  -  - 

real  barrier  to  change.  >  ■  .  ' 
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In  the.  education  sector,  innovation  acquisition  decisions  are  organic 

/  .     '  ^   

^atio 


ions  influenced  by  diverse,  multiple  layers  of  a  systein*s 
Btrucicure  and  significant  environmental  constraints.    The  decision 
process  is  far  mt>re  complex, 'then,  -  than  it  would  be  in  a  sector  such 
as^griculture  where  an  Individual  farmer  is  relatively  free  to  choose 
on  nl5  own  whether  or  not  to  adopt  *a  g*iven. innovation. 

/  '  '       .  ^ 

School  systems  are  complex  bureaucratic, organisations,  governed  by 

lay  boards  of  education^  influenced  by  community  pressures,  and 
rpatricted  In  some  decision  areas  by  legal  constraints  imposed  by  ^ 
ftate  and,  to  a  lesser  extent,  federal  authorities.    We  considered 
:he  governance  structure  previously,  in  our  ch^ter  on  ^environmental 
/constraints  in  the  education  sector*    We  no^ed  there  particularly 
how  the  extreme  decentralization  of  the  governance  structure  contplicates 
the  process  of  trying  to  diffuse  an"  innovation  .to  the  17,000  or  so 
school  districts  in  this  country;  eSch  district  is  reasonably  auton- 
omous in  deeding  whe^ther  or  nftt  to  substitute  a  hew  strafegy  for 
existing  practices;  and  within  districts  there  is^  often  a  substantial 
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amount  of  autonomy,  down  to  the  school  building  level  or  even  some** 
times  tl\e  classroom  level,  i^d^e'temining  whether  or  not  to  adopt 
proposed  changes,    But  what  is  the  effect  of  this  governance  struc- 
ture  oh  innovation  acquisition  from  the  viewpoint  of  potential 
adopters  of  a  given  Innovation?    And  just  how  strongly  does  lay 
control  of  the  governance  process  affect  the  receptivity  of  schooL 
systems  ^  innovation  adoption? 

Clearly,,  the  governance  structure  makes  each  distritt  highly  aj>/on- 
omous  in  deciding  on  innovation  acqifisitions,^  Although  there  are  some 
state  regulations  that  constrain  district  decisionmaking^ ^they  tend 

to  be  relatively  minor  as  constraint^  on  innovatJiont    Generally,  they" 

I  ^  " 

are  designed  to  uphold  minimum  perfortaance  standards  and. tend  to  invol 
such ^yu^lly^unobtrusive  problems  as  teacher  certif icationt  Where 
truly  innoTOtive  approaches  are  involved,  these  regulations^may  pre- 
sent serious  obstacles  —  etgt,  in  the  case  of  an  innovation  that 

-t  ■ 

employs  personnel  who  are  not  professional  educators  (for  instance, 
,  professional  artists  or  musicians) «    But  often,  there  are  xjays  to 
get  around  these  difficulties  if  district  administrators  are-per^ 
sistent  and  resourceful  enought    There  are  -areas  of  regulation  in 
some  states  that  do  present  qtajor  difficulties  for  innovators,  e,g,, 
statewide  textbook  adoiJtion  procedures  that  we  will  consider  Shortly, 
And  acceptance  of  federal  funds  for  certain  innovative  programs  tends 
to  mean  acquiescing  to  federal  guidelines  restricting  not  only  how 
the  money  can  be  spent  but  also  a  number  of  aspects  of  school  system 
functioning,  (e*gf  ,\atters  relatjfe^'to  discrimination,  desegregation, 
affirmative. action,  era,)*    Rarely,  h^ever,  are  ^uch  regulations  of 

major  significance  in  affecting  innovation  acquisition  decisions. 

I  ■  ' 

9 

The  education^.)l  literature  conta'ins  conflicting  assessments  of  the 
impact  of  lay  control  on  innovation  adoption  decision^.    One  group 
of  wyiters/j^escribe  educational  systems  in  terms  of  organizational  , 
,  vulnerabil^l)ty  to  social  afW  political  influence:  the' outcomes  of 
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adoption  decisions  are  viewed  as  reflecting  the  pluralism  of 
American  society,  and  prof essionalsV  initiatives  are  seen  as  , 
significantly  constrained  by  locafl  values,  mores,  etc*  Others, 
Jiowever,  contend  that  lay  control  of  education  is  one  of  the  many 
^  myths  that  infuse  the  American  ec^ucational  system,  and-  that  in  fact 
"school  superintendents,  their  professional  staff,  and  influential 
professional  power  blocs  ^uch  as  the  ^teachers'  unions  tend  to  dotni"- 

nate  lay  boards  of  education  and  generally  resist  lay  encroachJi^ents  - 

'         '  37  ■ 

into  key  decisionmaking  areas  * 

i 

Jk- 

Both  pictures  are  partially  true*    Even  where  school  boards  attempt 
to  closely  monitor  ai^  control  school  system  operations,  they  are 
usually  dependent  on  the  Superintendent  and  his  staff  for  inf orma- * 
^  tion  and  er-cperbise,  and  generally *accede,  to  the  Superfntendent*s 
initiatives,  proposals,         requests.    And  even  where  ^chool  pro- 
fessionals are  most  dominant  and  school  boards  functioti^^rgely  as 
rubber  stamps,,  care  must  be  taken  to  avoid  stij;ring  up  u^^ue  com- 
,munity  hostility  to^a  program  or  proposal* 

The  absolute  amount  of  lay/professional  ^dominance  vs,  subordinatfon, 

then,  may  be  a  moot  point*    However,  there  would  seem  to  be  far  more 

b^yrier-s  to  change 'inher^ent  in  the  governance  structure  of  the  edu-* 

'cational  system  in  this  counti^y  than  other  sedtors  we  have  fconsidered 
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elsewhere  in  4ur  analysis* 

t 

4.  '  Legal  Constraint  on  Innovation  Acquisition  ^ 

Our  discussion  of  innovati'on  acquisition  in  this  chapter  ten!^  to  - 
assume  rhat  school  districts  are  reasonably,  free  to  choose  innova-  * 
tions  from  among  the  full  array  of  alternatives  available  to  meet' 
gilfjen  need-*   However,  there  are  significant  legal  coi^traints  on 
the  textbooks  and  oth^r  learning  materi^s  that  school  districts  caiT 
qui'l^e^^^i^  many  states  and  localities  apross  the  country* 


a 
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Nearly  half  the  states,  for  instance,  have  statewide  textbook  adoption 
procedyres.    The  procedures  vary  from  state  to  state*    In  some  states; 
a  single  textbook  is  adopted  per  subje^it  per  grade,  and  school  dis- 
tricts have  no  choice  at  all.    In  others,  a  number  of  acceptable 

alternatives  are  listed  by  state  authorities,  and  di^stfticts  may 
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choose  from  any  of  the  books  ^on  the  list.       However,  even  whers 
choice  is  possible,  the  choices  tend  to *be  relatively  narrow  com- 
pared to,  the  wider  array  of  all  available  alternatives  to  meet -^a 
given  need.    Even  in  states  without  such  statewide  textbook  adoption 
procedures,  the  effect  generally  tends  to  be  th^  same  in  large  urban 
areas  organized  as  single  city  school  districts  with  centralized 
selection  'and  purchase  of  textbooks  and  learning  materials. 

Most  of  th^se  regulations  are  concerned  only  with  textbooks*    But  in 

some  states  the  regulations  also  cover  ''consumables,**  i*e.,  materials 

'  40 
such  as  student  workbooks  that  cannot  be  used  more  than  once* 

Where  regulations -of  this  kind  are  in  effect,  school  systems  are  pre- 
vented from  adopting  imtnjct;ional  systems  (e.g.,  reading  or  ijsathe* 
matics  programs)  that  arfe  dependent  on  use  of  such  materials 
unless  they  try  to  get  aAund  theffe  regulations,  for  instance  by 
using  the  worlfbooks  ^ear  after  year,  having  students  ^copy  the  re- 
qulred^exercises  on  separate  paper,  etc*    But  even  if  this  kind  of 
stratagem  is  tried,  much  o%t|^he  efficiency  of  the  instructi^onal 
system,  as  designed,  is  lost 


The  very  existence  of  these  ki^ds  of  statewide  or  citywide  adoption 
procedures  acts  to  impede  change.*   Textbook  publishers,  for  instance, 
trying  to  produce 'books  and  materials  acceptable  to  as  large  a  , 
national  market  as  possible,  knowing  their  materials  will  be        ^  * 
screened  by  generally  consStvatlVe  hodi&s  of  officials  in  states 
with  i^dely  varying  sensitivities,  are  not  highly ^likely  to  prbduce 
materials  that  are  too  innovative,  or  even  too  ^'different"  looking. 


XOlO 


5*      Ecorv>mlc  ConsTiralnts  on  Innovation  Acquisition 

Qiven  the  financial  problems  of  school  systems  in  recent  years »  cost 
cofhid^rations  have  become  a  factor  of  major  iinportance  in  the  acqui- 
sition process.    If  a  new  product  or  approach  is  less  costly  than  the 
one  it/  replaces,  adoption  probability  is  enhanced-    But  innovations 
are  rarely  cost-reducing-    Often,  they  are  quite  costly,  and  the 
problems  are  compllcated^y  the  "soft  money"  funding  patterns  fre-* 

quently  used  to  encourage^he  diffusion  of  certain  types  of  Innova- 
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tlons-   *    Federal  money  niay  be  offered  as  an  incentive  to  school 
systems  to  adopt  and  utilize  a  complex  instructional  system  that  ^e- 
quiresr  major  restructuring  of  a  school^s  instructional  and  admlni- 
strative  processes-    The  federal  money  pays  for  all  costs  of  a  three- 
year  installation  and  trial  period*    However,  after  the  trial  phase, 
the  federal  money  flow  terminates  and  the  costs  must  be  absorbed  ^y 
the  IcTcal  school  district-    The  school  faces  a  serious  diler 
either  It  m»jst  take  the  added  costs  out  of, its  already  tlgm:  opera- 
ting  budget,  or,  after  having  restructured  the  3chOol's^nstructlonal 
and^administrative  processes  in  accord  with  the  innoiration's'  require- 
ments,' It^must^drop  the  program  and  perhaps  again  go  through  the.  i 
strains  of  restructuring,  this  tiine  to  return/co^  tha  old  pattern- 

Unhappy  experiences  ^f  this  kind  make  schools  districts  wary  of 

*  / 

adopting  Innovations  supported  by  "soft*'  funding^ 


Nature  of  Educational  Innovations 


We  have  considered  the  problems  pos&o  by  the  nature  of  educational 
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innovations  at  a  number  of  points  in  our  analysis-       As  we  have  noted 
elsewhere,       t\i^^x  very  nature  educational  innovations  present  signi- 
ficant barriers  to  ready,  acceptance  by  school  personnel-    They^tend  to 
involve  "people  change,*'  i.e-,  finlearping  of  old  patterns  (of  Instructi 
classroom  organization, . etc -)•  as  well  as  learning  of  new  behaviors, 
techniques,  etc-    Those  InnovatjLons  that  involve  truly  ^fundamental 


changes  are  likely  to  run  counter  to  strongly  \^eld  feelings  and 
sensitivities  about  the  roles  of  teachers,  *Tstudents,  parents  and  \ 
others,  the  relationships  among them,  etc*    They  are  likely  to 
involve  costly  and  time-consuming  retraining  of  teachers*.  And 
their  adoption  is  likely  to  require  substantial  commitments  to  be 
made  despite  considerable  uncertainty  about  what  the  outcomes  will 
be. 

It  is  this  uncertainty  that  is  probably  the  most  significant,  and 
certainly  the  most  reasonable,  source  of  resi;stance  to^adopltlng 
innovations-    By  their  ^sry  nature,  educational  innovations  tend 
to  be  harder  to'evaluate  th^n  innovations  in  other  sectors*  Their 
effects  ar6  less  visible, 'harder  to  measdre,  and  may  take  many 
years  to-as^sess*    There  is  greater  readtiveness  between  product 
(i*e*  ,  the  '*package^"  innovation)  and  users-(i*e*,  bo€h  educational 
personnel.as  intenaediate>.u3ers  and  stiudents  as  end  users)>  and  there 
fore  the  iriplemefttation  process  is  more  complex,  involving  a  far 
greater  number  of  variables;  it  is  harder  to  predict;  and'harder  to 
control*    ,  ^  . 

*  * 
We  noted  earlier  in  this  chapter  how  little  comparable  evaluative,  in- 

formation  is  availalile  about  alternative  products-,  innovations,  and 

* 

prac*tices  to  meet  a  given'need,  making  it  necessary  fdr  acquisition 
decisions  to  be  made  in  the  absence  of  data  of  Jthis  kind  or  0ata  com-* 
paring  e^cisting  practices,  etfiP*  in  a  school  system  with-  innovations 
proposed  for  adoption**   Conseqafently,  the  potential  \ifeer  is  likely  to 
be  Hesitant  about  risking  resources  on  so^uncertain  an  cAitcomel 

'     '      '  7 

7*      Relative  Absence  of  Change  Agents  • 

The  fiducation^sector  lacks  much  evidence  of  the  entrepreneurial  role 
that  has^  been  so  importajnt  In  the  historical  development  of  r/d&I  in 
other  sectors,  as  we  described  this  role  in  another  of  our  analyses* 
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.Education  lacks  a  significant  number  of  individuals  or  organizations 
Lllit^^  to  ''take  risks,  folerate  uncertainty,  and,  counteract  resiff- 

tatjce  ir.  order  to  introdu<:e  an  innovation'*  or  initiate ,  ne\?  activi-  ^ 

.  43  "^-^^  '  ' 

tiei^.       ^  .  .  >     ■  ^ 

There  ^re  relatively  few  innovators  in  education  establiTshing  their 
own  organizations,  or  devdting  their  energies  to  promoting  specific 
approacbas  or  innovations  that  will  be* adopted  only  if  school  per- 
sonnel can  be  persuaded  to  take  a  chance  on  something  new-  There 
are  few  tz^any  incentives  -  for  such  organizations  to  be  established, 
^'and  relat;ivaly  few  sources  of  funding  to  perrrlt  s^ich  organizations 
to  survive  during  a  seed  period  until  they  can  become  self-sustaining, 
supportiVg,, themselves  oh  what  little  income  can  be  derived  from  such 
enterprises  in^fhe  education  sector- 

There  are  few  ^ources  of  change  within  educational  jsysteios-  School 

principals,  for  instance,  tend  to  function  as  administrators  rather 

44  ,  ■ 

than  as  educational  leaders-       >fuch;the  same  caif  probably  be  said 

of  most  school  superintet^dents ,  or'^even  curriculum  cooi?dinatars  or 

Other  specialized  personnel  staffing  administrative  positions; 

Increasing  numbers  of  external,  change  agents  have  appeared y6n  t;he 

education  scene  in  recent  years,  supported  by  federal  funjis  or  by 

private  foundations.    And  there  is  some  evidence  that  external 

change  agents,  if  prestigious  or  well-connected,  and  i^' effective 

in  relating  to  school  personnel  in  a  non- threatening  manner,  can  be 

highly  influential  iif^fe'timulatlng  and  supporting  innovation- But 

"there  is  also  considerable  suspicion -of  external  change  agents,  who 
are  frequently  viewed  as  threafis  to  £he  .educator's  claim  of  ^per- ■ 
tise,      otj  (often  correctly)  as  naive  outsfiders  with  l,ittle  class- 

.room  expelrience  and  limited  un^ierstanding  of  the  constraints  on 

school  system  functioning/ 

■  *#■         *  I  ■ 

with  few  Incentl'^^es  in  the  education  *^ector  to  stimulate*  risk- taking 

-         \  / 
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behavior,  and  strong  bureaucratic  constraints  that  discourage  risk- 
taking,  educational  systems  tend  to  lack  the  major  forces  Hhat  are 
supportive  of  irmovation  in  other  sectors  where  strong  market  forces 
are  operative,  or  where  influential  change  agentV function  effectively* 


8,      ?ollcy  Considerations  Suggested  by  Educational  Contextual 
Factors 


These  various  contextual^  factors  dlstlncti?7e  to  the  education  sector' 
suggest  additional  issues  that  need  to  be  considered  if  policies  arc 
to  be  designed  to  ir.ake  school  systems  more  receptive  to'  innovations , 
and  therefore  more  supportive  of  InnQvation  acquisitions. 

What  incentives  can  be  designed  is^increafee  school  system  interest  in 
expertcentingVlth^  innovations  that  tnay  improve  their  perfonuance? 

What,  if  any,  market  forces  ur  other  competitive  models  might 
be  introduced  validly  Into  school  system  fjunctionxng? 


What,  if  any,  bureaucratic  incentive"^  can  be  developed  to  support 
Innovation?  .  * 


What  economic  incentive  can  be  developed  to  increase  the 
appeal  of  innovations'' to  financially  hard'-pressed  school 
districts? 

r 

i 

What  professional  forces  can  be  brought ^to  bear  on  school 
leadei:ship  and  instrucftional  personnel  to  Increase  their 
Interest  in  experimentation  with  innovations  to  laeet  specific 
school  system  needs? 

What  strategies  can  be  designed  to  overcome^  the  major  barriers  to 
adopting  innovations? 
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What* strategies  might  be  designed  to  make  community  influentials 
and  parents  more  receptive  to  validated  innoiratlons? 

iJhat  strategies  might  be  designed  to  overcome  school  profes- 
sionals^ hesitancy  about  particular  innovatit^ns^  based  on 
untested  assumptions  of  negative  community  reactions? 

'     What  strategies  can  be  designed  to  help" school  districts  secuce 
needed  leeway  for  innovation  acquisitions  in  stafres  or  cities 
with  textbook  adoption  procedulres  or  other  ^siich  regulations  that 

i 

conflict  with  the  requirements  of  particular  innovations? 

"  )      '    '  '  ' 

What  funaing  strategies  can  be  designed  to  overcome  the  problems 
for  innovation  acquisition  posed  by  ''soft  money*'  policies? 

Vfhat  strategies  can  be  designed  to  minimize  the  uncertainties 
inherent 'in  the  innovation  accj^sition  decision  process?  ^e,g,, 
strategies  considered  earlier  toNprovide  comparative  evaluative 
information  across  the  fujl  a^i^pay^of  alternatives  available  to 
meet  a  given  heed)  - 

What  strategies  can  be  designed  to  increase  the  visibility  and 
effectiveness  of  the  change  agent  role?    v^thin  the  school  ^ 
system  in  existing  leadership  positions?  in  specialized  change 
support  units  within  the  school  system  or  in  external  technical 
assistance  or  other  linkage^organizations?  in  exteifna],  organi- 
zations ^such  as  universities consulting  firms^  etc*? 

What  incentives  and  strategies  can  be  designed  to  develop  the  entre-* 
preneurial  role  in  the  education  sector,  entrepreneurial  organizations 
that  promote  innovation  dissemination  and  acquisition,  and  risk-taking 
behaviOT?  in  those  wh?*  make  innovation  acqulsitio^i^decisions? 

How  can  each  of  these  various  strategies  be  implemented  triost 
efficiently  and  effectively?     ^  ^  - 
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VI.  NEXT  STEPS  ■  ^ 

1.  Needed  Research  ^  .  ^  ,  ^ 

Before  wo  can  design  incentives  to  stimulate^ risk-taking>  entrepre- 
neurship,  aod  innovation  acquisitic^n  in  education  ^nd  p'olicies  and 
strategies  to  improve'innovation  acquisition'^operntions,  a  number  of 
questions  must  be  answered  systematically  through^ research , 

During  the  initial  phase  of  the  research  program,  it  would  seem  es- 
sential to  as5e:s3  the  relevance  of  the  vast  body  of  diffusion  research 
and  organizational  change  literature  for  application  to  the  educa-- 
tional  contex  ^Jhat  seems  to  be  called  for  is  the  development  of  a 

comprehensive  inventory  of  testable  propositions  bearing  on  barriers  t 
change  processes  and  how^  they  night  be  overcome>  incentives  that  might 
be  developed  to  stimulate  innovation  and  school  system  receptivity  to 
innovatiQas ,  and  policy  options  and  management  strategies  for  improv- 
ing acquisition  operations  in  the  education  sector*    This  is  essen- 
tially  a  literature  review  and  translation  ta5k'that  could  probably  be 
carried  out  in  a  short  period  of  time  with  little  or  no  difficulty  by 
one  of  the  reseatch  organizations  that  has  Ipng  been  reviewing,  anno^ 
tating,  synthesizing,  and  applying  this  literature  (e*g,,  the  Center 
for  Research  on  th^Utilization  of  Scientific  Knowledge,  or  Research 
for  Better  Schools)* 

In  the  second  phase  of.  the  research  program,  Empirical  research  needs 
'to  be  undertaken  to;  -  (a)  test  the  validity  of  some  of  the  more  impor- 
tant of  these  propositions*in  the  educational  context,, and  (b)  gather 
and  analyze  an  empirical  data  base  on  innovation  acquisition  iji  aduca-i 
tion.  At  the  very  least,  we  envision  a  survey  (or  Sftt  of  surveys)  of 
school  systems,  possibly  linked  to  a  planned  or  ongoing  survey  effort 
such  as  NIE's  survey  of  school  practices*  We  would  expect  such  a 
survey  effort  to  enable  us  to  determine  what  the  existing  patterns  of 
innovation  acquisition  look  like,  how  much  variability  there  Is  in 
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these  patterns^  hov  powerful  each  of  ^he  ^hajor^barriers  to  inn9vatit)n 
are  in  different  kinds  of  community  and  sohool  district  settings^  and 
Jio\^  personijel  in  different  kinds  of  settings  r(*act  to  various  hypo- 
thetical possibilities  pr^^enting  strategies  that  might  be  developed ^ 
and  implemented  to  enhance  innovation  acquisition  in  the  education* 
$6ctor.    More  specifically,  we  need  to  gather  data  .on;     ;       '      ^  ^ 


-  trhe  levels  and  types  of  innovation  acquisiti-ons  characterizing  ^ 
school  systeios  in  different' kinds  of  coirsnHinities ,  vith  differ- 
ent kinds  of  needs,  diffe^rent  kinds -and  levels  of  resource's 
ailocated  to  innovation  acquisition  operatri^ons,  different 
legal,  economic  and  other  constraints  on  Che  innovation  Acqui- 
sition process,  etc.;        "  ■  . 

at  ^ 

-  the  key  innovation  entry  points  in  eac^^sj^tem  (i.e.^  which 
personnel  in  the  school  system  or  its  environment  are  the  main 
sources  of  proposals  for  Innovation  ^^quisitions) ; 

-T  the  types  of  awareness  channels  uged  most  extensively  by  differ- 
ent kinds  of  personnel,  in  different  kinds  of  organizational  and 
community  settings^  in  relatiorfto  different  kinds  and  quantities 
of  innovations  adopted  or  even  seriously  considered  for  adop^tion; 

-  tlie  types  of  information  search  strategies  used  most  «ctensively 
to  get  more  information  about 'different  types  of  i^j^^ations;  the 
extent  o'f  u^e  of  available  .information  resources;  feedback  on  the 
degree  to  which  different  kinds  of  resources,  different  formats, 
etc.  vera  or  were  not'helpful,  vere  u^ed  with  great  ease  or 
difficulty;  perceptions  of  information  needs^  and  preferences 

f or  ^dif f erent  type^  of  information  and  support  "resources  that 
would  be  most  helpful;,  *       '  % 
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-    ^  '  j»r 

-  types  of  evaluative  information  sought         usod  in'noiiaklng  inno- 
vation Acquisition  decisions;  numbers  of  ^Iternative^roducts 

considered  in  relation  to  the  number  available  in  the  full  "array 
*  of  innovations,  "practices,  et^"  ^'ineet  sp^ific  needs;  appro^icll^ 
used ^i^  cy^aring  existing  practices,  products,  etc.  to*inno- 
vations  proposed       replacements;  types  of  evalua^^ve  infonaa- 
tion  desirjed;  types  of  evaluation  interpretation  and  support 
resources  *seen  as  neededj.^nd 

-  reasons  for  adopting"  or  rejecting  particular  innovations  con-- 
sid^red  "in^' recent  yaars^       ^  *  -  J 

A  secorEd-stag8Lanal)jsis  of  these  data  might  categorize  the  participate 
ing  districts  as  high,  moder'-ate,  or  low  on  innovati'on  acquisitions  of 
different  types, ^Sfcid  then  compare  the  three  sets  o^xlistricts  an  each 
block  of  items.    This  kind  of  analysis  JJiight  yield  hig^)ly  useful  insight 
into  the  structural  aria  process  differences  (as  well  as  the.  frequently  ^ 
repotted  community  dif f erences) ^that  distinguish  and  help  explain  differ 
e nee s  among  school  districts  in  innovation  ademption  rates.    We  would 

'  btf  particularly  interested  in  seeing  analyses  that  might  indicate  the 
.relative  importance  of  cbii^nunity  vs,  school  factors,  and  the  relative 
im[[<Jrtance  of  such  school  fa^cJiors  as  technical  barriers  to  acquisition  ^ 

<(e.g*>  weaknesses  in  awareness  channels,  in  infd^rmation  search  strate- 
gies, in  availaljle  .evaluativ^^nformation,  in' decision  processes,  etc) 
and  motilrational  "barriers  to  innovation  acquisition  (e.g.,  resistance 
to  change  as  unnecessary  or  too  demanding  of  staff  time,  fe^^  of  com-  ^ 
munity  reaction  to  a' proposed  change,  etc,)* 

jtapther'  research  possibility^  might  be  the  analysis  of  innovation  acqui- 
sition pr^^sse^  in  s.chool  districts  reputed  to  ^  highly  innovative* 
Eicemplary*  cises  might  be  identified  from  the  survey  data,  l.e,,,  they 

'might  be  selected  frgni  3mong  the  districts  categorized  as  high  in  inno- 
vation  acquisition.    TOr  .they  might  be  identified  in  "quick  and  dirty" 
fashion  using  knowl^^eable  informants  to  suggest  wh«dfe  some  of  these 
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exemplary^'cases  might  be  found.    Research  on  these  e)^A^-(ii:|tricts 


migTit*  provide:  Ca) /in-depth  documentation  of  individygSX^'e^^piafe,,  case 

Band  (b)  cross-case  ^alyses  of  acquisition  patterns,  ^Ifenn^l^  .u^^ ^ 

information  search  strategics,  evaluative  information  sougttt>"and  used, 

types  of ' innovatidns  sought,  accepted,  and  used,  reasons  for  adopting 

or  rejecting  particular  types  o^  innovations,  etc*  ^  We  are  particularly 
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impressed  by  the  possibilities  of  this  Vind  of  reslarch,      and  discuss 
it  elsewhere  in  this  volume. 


2.  Policy  Choices 


Based  on  the  findings  of  the  research  effort,  decisions  can  be  made''*' 
as,  to  whether  or  not  a  substantial  investment  in  the  acqdisition  function 
is  warranted  at  this  time,  and  if  so,  what  form  this  investment  £>hould 
take,  whether  it  should  focus  on  macro  level  resource  development  or 
tilcro  level  capability  building  (or  both),  what  kinds  of  districts  it  ' 
should  focus  on,  etc.  ^  ' 

3.'  DQSi^n  Work  * 
   ^ 

If  ihe  decision  is  made  to  support  the  strengthening  bf  the  acquisition^ 
functioifl  at  this  time,  several  kinds  of  design  work  would  seem  to  be 
needed*    Given  the  considerable  variability  among  school  districts  in 
existing  acquisition  patterns  and  preferences^  and  in  devisees  lof  organi- 
zational readiness  for  more  raatute  modes  of  institutionalized  acqwisi- 
tion  operations,  ^t  would  seem  essential  for  the  design  work  to  be 

0 

oriented  toward  constructing  alternative  Qtodels  to  achieve  each  of ■  a 
number  of  key  objectives:  (a)  to  develop  incentives  that  can  stimulate 
-innovation  Requisition  and'overcome  major  barriers  to*  innovation  acqui^*^ 
sition  indifferent  organizational  settings;  tbjBj)  institutionalize 
innova^lbo  acquisition  operations  in,  or  acquisition  support  serviqes 
for,*  different  organizational,  settings;  and  (c)  to  provide  capability  . 
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building  activities  r^equired  to  implenie^t  these  various  modej^s,  start- 
ing  from  existing  pat^terrns  and  progr^syfcing  toward  more  optimal  patterns 
x)f  acquisiJiion  functioning,,' 


Presu?jably">  the  design  work  would  be^arried  out  to  a  level  speci- 
ficity  s,ufficient  to  permit  schodl  systems  to  select  and  implement  any  one 
or  set  of  these  models  on  A  trial  basis.    It  wt)uld  seem  essential  to 
include  LEA  personnel  throughout  such  a  design  effort,  whether  in' a 
staff  or  an  advisory  cajfeclty  (pr  both)*    A  considerable. amount  of  this 
work'might  even  be  carried'  out  by  LEA^  witfi  or  possibly  even  without 
Che'  collaboration  of  outside  consultants  or  ^R/dJ^I  orgaitizations* 

The  aesign  work  mi^ht  be  focused  on  th^  possibility  of  institutidn^iz-^ 
ing  Innovation  acquisition  as  a  function  aV  tbe  school  district  level*  Or, 
it. may  be  taken  as  a  given  tha^  institutionalization  of  an  inn^atlon  ^ 
acquisition  function*  Is  highly  unlikely  in  most  school  cUstricts  for  ^ 
some  time  to  come,  and  that  what  is  needed  instead  is  t?he  developm€;^t 
of  centralized  informational 'rtsourceXthat  would  make  more  orderly, 
"inf ormation^bas^d  acquisition  operations  possible  even  in  the  Absence 
ori  an  Institutionalized  acquisition  function  on  the  local  level*  (The 
CoQsymer  l^nformation  Component  o4  NIE  s  R&JD  Exchange  Program     seems  to 


1  ,  .  \  » 

be  oriented  toward  this  latter  persuectlve*)    Or,  a  long-grange  design 

program  might  start  from  the  assilmption  that  institutionalize'd  acquisi**^. 

tion  operations  on  the  local  level  may  be  possible  in  the  long  rim  but 

are  less  likely  in  the  short  run  and  therefore  *  the  full  sequence  should 

"  be 'plannec{  for»    Whatever  decisions  are  nia<^  on  these  options  (based 
on  the  findings  of 'the  initial  research  ef fort) some  kind  of  designi 
work  can  be  carried  out  —  whether  designing 'for  local  acquisition 

'  specialists,  for  centralized  acquisition  resource  devel6pment,  or  for 
both*  ^  '  * 


ERIC 


9t 


102C 


4.  Trial  Inj^lementatlon  and  Implemeafatlon  ^search 


Whatever  models  wete  develortedTroald  have  to  be"  experimented  vith 


sociewhat  cautiously.    Several  trials  and  adaptations  would  likely  be  ^ 
required.    Given  how  relatively  little* we  know  about  innovation  acqui- 
sition  processes  in  education  or  aboyt  implementation  requirements^forxhe 
instiJtutionalizdtion  of  an  acquisition  function,  itTwould  seem  essen- 
tial to  include  within  the  trials  pr9Vlsion  for       extensive  ^ount  of 
third-^arty  docucsentation  and  analysis  of  processes*    Such  ImplementaA 
tion  resea^rch, could  be  expected  to,  provide  information  about  the  relative 
merits ^of  alternative  models  of  the  innovatiqn  acquisition  function^  their 
relative  effectiveness  in  tfYfferent  kinds  x>f  organizational  settings, 
adaptations  needed  in  the  models  for  uste  in  certain  kinds  erf  settings, 

K 

required  implementation  conditions  and  implementatiqn  supports,  and 
^perhaps  too  information  about  schools  and  school  districts  as  innovation 
systems .  '  ■  ■ 

5.  Development  of  Implementation  SuppcrEts 

Finally,  if  xhe  outputs  of  the  design  work  are  to  be  implemented  widely 
and  effectively,  it  would  seem  essential,  to  apply  the  findings  of  this 

'  Implementation  research  to  the  development  of  packaged  materials  and 

■  I  -  ■ 

interpersonal  technical  assistance  services  *to  support  the  implementa-  ' 
^tiorf  of  these  various  models,  in  ciifferent  kinds  of  organizational  settings, 
starting  from  different  degrees  of  organizational  readiness  for  more 
mature  patterns  of  acquisition  functioning*    Packaged  materials,  for 
instance,  migh-t  include  elaborately  documented  descriptions  of  the  alter- 
nativs  models,  with  detailed  how-to-do-it  guides;  checklists^ for  assess- 
ing existing  patterns*  resources,  capabilities,  information  needs,  etc; 
♦ 

analyses  of  needed  ^kill^s  and  fcapabilities,  with  resource  glides  provid- 
ing alternative  approachfes^^for  ^i?velopipg  them;  self'-evaluation  instru- 
ff  .  ments  *for  assessing  progress  made  toward  more,  optimal  levels  of  function- 

irig,  etc,  ■ 
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We  assume  such  development  work  would  benefit  considerably  irom  the 
iTlVol^^€tilent       SEA  and/or  LEA  personnel  \;ho  participated  in  ^ome  of 
the^  trial  implementatiorls  as  well  as  Some  other  SBAs  and/or  LEAs 
considering  future  implementation*  ^        ^  ' 

We  recognize  that  institutionalization  of  an  innovation  acquisition 
^  function  is  highly  unlikely  in  most  school  districts  for  some  time  to  come, 
However /  there  are  already  some  programs  in  planning  and  others  in  opera- 
tion  that  provide  acquisition  support  resources  and  services  fpr  school 
systems.    ^;iE's  development  of  an  education  producit  catalog  and  the 
planning  to'^ard  an  RSD  Exchange  Program  are  two  examples.    OE's  National 
Diffusion  N'etwork  is  another  case  in  point* 

'  Even  this  approach,  which  assumes  a  minimum  of  ^nstitutionali::ed 
acquisition  functioning,  requires  the  .development  of  implementation 
Supports  if  it  is  to  have  substantial  impact  on  the  local  level.  At 
the  vSry  leas^,  work  needs  to  be  done'  to  orient  LEA  personnel  toward  the 
use  of  th5*e  resources  and  to  make  them  knowledgeable  in  the  use  of 
these  resources^  to  provide  mechanisms  that  might  facilitate  linking 
local  personnel  to^these  centralized  resources,  and  perhaps  too  to 
develop  strategies  that  might  enable  technical  assiptance  groups  to 

^^help  local  districts  to  use  these  resources  most  effectively. 

VII.  CONCLUSIOHS 

The  acquisition  function  is  virtually  non-existent  io  education  as  a 
specialized,  institutiongJLized  activity,   -Acquisition  processes  are 
generally  episodic,  haphazard,  and  random.    They  are  rarely  well  inte-^ 
gratedinto  system  functioning  and  long-range  plj^ning,    The  informa- 
tion dissemination  sys^tera^in  education  is  diffuse,  making  it  difficult 
for  educational  personnel  to  become  auare^of  n^ew  products  or  program's^ 

or  to  locate  more  information  abot|t  a*  product  or  program  they  do  become 
*     '  *  * 

aware  of.    Information  searcj^  strategies  tend  to  be  inefficient  because* 


1 

needed  information  bases  are  not  adequately  organized  to  facilitate 
the  search  for  information  "on  new  programs  or  products, 


.  It  is  difficult  for  school  sy^iems  to  make  rational  acquisition  d6ci-^ 
sioQs, because  ther^  is  little  comparative  evaluative  information  abdut 
alternative  programs,  products,  or  practices  to  meet  a  given  need*  Edu- 
cational  acquisitions  are  subject  to  faddishness  due  to  th^relative 
absence  of  gatekeeping  quality  control  mechanisms  that  can  screen  out^ 
low  quality  innovations^.^.  -  -  ^  ^ 

Few  school  districts  have  pfersoiinel  (or  Hocess  to  out&ide  consultants) 
with  the  speciali^ed^expaftise  to  -efficiently  search  for  infonaation  abou 
alternatives  to  mefet  a  gaven  need,  to  interpret  evaluative  Infonaa-  * 
tion  about  available  alternatives,  or  tp,  assess  decision  choices  in  , 
relation  to  tlie  exigiting  knowledge  base' on  specific  needs  ttiat  night  be 
met  by  innovation  acquisitions.  -  _  ' 

Many  of  the  newer  initiatives  to  provide  supports  for  innovation 
acquisition  in  education  focus  on  overcoming  these  technical  weaknesses 
in  acquisition  processes  in  education.    Tl^y  focus  on.  increasing  the 
availability  ol  needed  information  on  innovations  that  might  be  acquired, 
or  upgrading  the  skills  needed  to  use  that  information  effectively* 

In^addition>  the  *li terature  suggests  that  innovation  acquisition  in 
education* may  be  significantly  affected  xby  motivationalbarriers  to 
Innovation.  ,  These  are  traceable  %o\  th©^  monopolistic  nature  of  public 
schools,  their  social  and  political  vulnerability  to  environmental 
inf licences  (real- or  imagined),  the  governance  structure  of  public 
education,  the  natur^  of  educational  innovations  themselves^  and 
economic  constraints;    Theargument-here  Is,  basically,  th3t  there  are 
few  incentives  in  education  to  stimulate  risk-*taklng  and  strong 
bureaucratic  constraints  that  discourage  it*    If  this  mcnrfcro^ional 
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factor  is  in  fact  as  important  as'  It  is  depicted  In  the  literatur^j 
then  strengthening  of  the  innovation  acquisition  function  in  educa-- 
tion  will  require  development  of  incentives  to  encourage  innovation  a^jd 
strategies  to  overcome  ^he  major  barriers  t(J  innovation*  ^ 

If  one  accepts  the  basic  premise  of  educational  improvement  stra- 

/r'^^y  tegies^  that  educational  practice  in  this  country  can  and  should  be 

improved  >  then  the  strengthening  of  the  acquisition  function  oust  be-  -^^ 

come  a  major  concern.     It  makes  no  difference  whether  one  favors  exter- 

nal  R£tD  or  .internal  renewal  strategies.    The  accuisition  function  need 

not  be  thought  of  only  in  terms  of  acquisition  of  externally  developed 

R&D  products  or  programs  or^exemplary  practices  from  other  school 

districts.    Unless  one  assumes  that  internal  renewal  approaches  are 

r;  (and  should  be)  devised  full-blown  by  drawing  on  internal  resources 

only>  with  little  if  any  informatioA  needed  from  outside  a  given  school 

or  school  district >  then  the  health  and  vitality  of  acquisition  and 

information  entry  points  are  likely  to  be  significant  in  separating 

highly  active^ effective  self-renewing  systems  from  relatively  statiq. 

systems^  that  give  only  lip  service  to  the  self-renewal  concept,  Clearly> 

the  acquisition  function  needs  to^  be  strengthened  in  the  education 

sector.    Just  how  this  can  be  accoi^plished  most  efficiently  and  effec- 

tively  remain  to  be  seen»    But  unless  we  begin  to  accumulate  the  needed 

data  base  on  existing  acquisition  operations^  and  begin  to  consider  a 

I  programN)f  support  for  some  design  options^  trial  implementation^  and 

,  * 
implementation  research^  the  substantial  gap  between  research^  R£tD>  and 
i  ■ 

e^empda^  practice^  on- the  one  hand»  and  standard  educational  practice^ 
on  the  other^  is  likely  to  reEtain. 


^      ^  FOOTNOTES 
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12*      For  instance.  Research  for  Better  Schools  has  a  network  of  schools 
which  were  involved  in  field  tests, of  th.eir  Individually  Pres^^ribed 
Instruction  progran.     Oirher  networks^inclucje  the  network  of  Innova- 
tive Schools  and  the  ES  *70  Schools*   '     ^  ^  * 

*- 

Id.      For  i^3t*ance,  see  Pellagrin,  Analysis  of  Sources  and  Processes'of 
EducaLion>  op^cit *  ^  , 

  ^  '  *  4 

15-      The  best  current  source  we  have  seen  on  this  is;    Center'^far  Hew 

Schools,  Assistance  Strategies  of  Six  GrouPs  that  Facilitate  Educa" 
tional  Change  at  tbe  School/Community  Level  (Chicago;    Center  for 
Hew  Schools,  1977). 

16.  For  instance, *see :    J.  Lindeman,  S .  K,  Bailey,  J,  S •  Berke ,  and 
L.  a.  Ham,  Some  Aspects  of  Educational  Research  and  Development 
in  the  United  States      Report  for  the  QECD  Review  (Syracuse:       ^  . 
Syracuse  University  Research  Corp.^  1968);  Baldridge  and  Burnham, 
The  Adoption  of  Innovations:    Jhe  Effect  of  Organizational  Size, 
Differentiation,  and  Environment,  op.  cit.;  J.  Victor  Baldridge, 
"Polititral  and , Structural  Protection  of  Educational  Innovations;" 
in  What  Do  Research  Findings  Say  About  Getting  Innovations  into 

^         Schools:    A  Symposiuin,  Sanford  Tenrkin  and  Mary  V,  Brown,  eds  • 

* (Philadelphia; Research  for  Better^  Schools ,  197A) ;  and  Rlttenhouse, 
Innovation  Problems  and  information  Needs  of  Educational  Practition- 
ers) pp.  cit>    '  ,  '  /  .  * 

17.  Virtually  every  research  organization  publishes  a  catalog  (or  listing 
,of  some  kind)  of  its  publications.    This  is  true  whether  one  is  look- 
ing.at  some  of  the  larger  organizations  Such  as  the  Rand' Corporation, 
Or  the  Institute  for  Social  F^search,  the  Bureau  of  Social  Science 
Research,  or  Stanford  Research  Institute,  or  the  regional  educational 
laboratories  or  R^D  centers,  or  even  soioe  of  the  smaller,  -newel:  or- 
ganizations such  as  the' Center  for  Hew  Schools,  As  an  e^mple  of  a 
catalog  of  outputs  from  a  group  of  institutions,  one  might  exatain^ 
the  CEDaR  catalog:.   Council  for  Educational,  Development  and  Researc^T, 
CEDaR  Catalog  of  Selected  Educational  Research  and  Development  Pro- 
grams and  Products  (Denver;     CfDaR,  1972). 
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18.  ^NIE,  Building  Capacity  jor  Renewal  and  Refom,  op.  ctt.  ;  NIK> 

Concept  Paper  tor  the  School  Practice  and  Service  Divi3tou>  op.  cit. 

19.  '  National  Inscitutc  of  Education,  Catalog  of  NI£  Education  Products 

(Washington:    HIE>  i976), 

20.  "    For  instance*  see;    .Office  o^f  Education,  Office  of  Program  Planning 

and  Evaluation,  Annual  Evaluation  Report  on  Education  Programs,  , 
-    FY  1971  (Washington:    OE,  1^72),  ERIC  ED  065  738;  National  Insti- 
tate  of  Education,  The  Status  of  Education  Research  and  Development 
in-  the  United  States:     1976  Databook  (Washington;    NIE,  1976); 
National  Institute  Qf  Education,  RegOestfor  Proposals  for  Evalu- 
acion  of  the  St^te  Capacity  Building  Pro^raro  in  Dissemination 
Washington:    NI£,  1976) >  especially  see  descriptions  of  vhat  each 
state  is  doing  along  chese  lln^s  included  in  the.RFp. 

21.  Do'^^Ias  Hall  and  Susan  Alford>  Evaluation  of  chtt  Naciofial  Diffusioa 
^^etvork:  .  Evolution  oE  the  Network  and  Overview  of  tlie  Research 
Literature  on  Diffusion  of  Educational  Ini:iovations  (Menlo  Park: 
Stanford  Research  Institute,  1976);  John  A,  Emrick,  with  Susan  ^ 
Peterson  and  Rekha  Agarwala-Rogers >  Evaluation  of  the  N^ational 
Diffusion  Network^  Vol^  1:    Findings  and  Recommendations  (Menlo 
Parki     Stanford  Research  Institute,  19  77), 

22.  NIE>  Concept  Paper  for  the  School  Practice  and  Service  Division. 
^  op,  cit, 

23^      Ronald  Lippit,  "The  Use  of  Social  Research  to  Improve  Social  Practice/' 
American  Journal  of  Orthopsychiatry >  Vol,  35,  July  1965,  reprinted  in 
The  Oregon  Studies^  Vol^  II,  op,  cit,;  Paul  D,  Hood,  "Dissemination> 
Distribution,  and^  Utilization  of  the  Laboratory  Products,"  in  Oregon 
Studies,  Vol.  II.v|)P.  cit, 

24,  For  instance,  see:    Lippit,  *'The  Use  of  Social  Research  to  Improve 
Social  Practice,**  op,  cit>,  Margaret  Nelson  and  Sam  D.  *Sieber,  Innova** 
tions  in  Ujban  Secondary  Schools  (New  York:    Bureau  of  Applied  Social 
Research,  Columbia  University,  1975).  ^ 

25,  For  instance,  see!    NIE,  Concept  Paper  for  the  School  Practice  and 
Service  Division,  op,  cit,  ;  NIE,  RFP  to  Establish  an  *'R&D  Dissemina- 
tion and  Feedforvfard  System"^  op^  cit,^ 

26,  NIE»  Concept  Pat?&r  for  the  School  Practice  anj  Service  Oivision,  op>  cit, 

27,  I&id.  ^ 

28,  For  instance^  s$e;'  Neal  Gross,  Joseph  B,  Giaequinta  and  Marilyn  Bern- 
stein, Implementing  Organizational  Innovations;    A  Sociological 
Analysis  of  Planned  Educational  Change  (New  York;    Basic  Boolts,  1971); 
and  L,  J1.  Smith  and  P.  M.  Keith,  Anatomy  of  Educational  Innovation 
(New  York; ,  Wiley,  1971), 
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This  interactir^e^^chaage  pi  idea?  i§  used  by  the  'IJational  Dif- 
fusion Network  as  described  in:  Emrick,  Pelferfeon  and  A'ganjala- 
Rogers,  Evaluation  of  the  National  Diffusion  Networks   op>  clt^ 

Educational  Products  Information  Exchange,  New  York  City. 

For  instance,  see  the  different  orientations  on  this  question  in  ' 
the  various  Items  in  the  annotated  bibliography  in  Chorness ,  Rit- 
tenhouse,  and  H^ald,  Use  of  Resource  Material  and  D^eci^ion  Processes 
Associated  with  Educational  Innovation:    A  Literature  Survey,  op^  cit> 
Also  ^ee  Henry       Brlckell,  Organisiiffc  New  York  State-  for  Educational 
Change  (Albany:    Kew  York  State  Department  of, Education,  l96l). 

J 

For  instance,  see:    Mort,  ^'Studies  in  Educational  Innovation  from  the 
Institute  of  Administrative  Research,"  op,  cit>:?  Miles,  ^'^Innovations 
in  Education:   -Some  Generalizations,'*  op>  cit>;  Pellagrin,  An  Analysis 
of  Sourceg  and  Processes  of  Innovation  in  Education,  ^p.  cit.;  Linde- 
man  et  al*  *  Some  Aspects  of  Educational  Research  and  Dev^elopment  i*ifi 
the  United  States^  op>  cit^;  Office  of  Education,  Educational  Research 
and  Development  in  the  United  States^  op^  cit.;  Ronald  Havelock  and 
Mary  Havelock,  Educational  Innovation  in  the  TJnit&d  States    (Ann  Arbor: 
Center  for  Research  on  the  Utilization  of  Scientific  Knowledge,  Insti- 
tute for  Social  Research,  University  of  Michigan,  19?'3);  and  Ronald  G* 
Havelock,  "Locals  Say  Innovatioji  Is  Local*    A  National  Survey  of  School 
Superintendents,"  in  What  Do  Research  Findings  Say  About  Getting  Innova- 
tion into  Schools:    A  Syraposium,  Sanford  Temkin  and  Mary  V-.Bi;own,  eds* 
(Philadelphia,  Research  for  Better  Schools,  1974)  *7 

Carlson;  Carriers  to  Change  in  Public  Schools,'*  op^  cit. 

For.  instance,  see;    Piraeus,  "Incentives  for  Inno^fetion  In  the  Public 
Schools,"  op>  clt.  \  *  ^  ' 

Sam  D»  Sieber,  'fSrganizational  Influenc^es  on  Innovative  Rules,'*  in 
Knowledge  Production  and  Utilization  in  Educational  Adininlstration,   .  ' 
T*  Eidell  and  J.  M*  Kitchel,  eds.  (Eugene;   Center  for  the  Advanced 
Study  of  Educational  Adm4nistration,\  University  of  Oregon,  1968)* 

For  instance,  see;    ibid*;  Robert  S*'Cahill  and  Stephen  P^  Hencley, 
The  Politics  of  Education  In  the  Local  iCoinmunity  (Danville,  Illinois: 
Interstate,  1964);  Ralph  B*  Kimbrough,  Political  P^wer  arid  Educational  f 
Decision-MakinR  (Chicago:    Rand  McN'ally,  1954)v^and  Frederick  M.  VPtrt-,^ 
and  Michal       Kirst,  The  Political  Web  of  American  Schools  (Boston: 
Little,  Brovn,  1972)* 

i  ' 

For  instance,  see;    Marilyn  Glttell,  Participants  and  Participation: 
A  Study  of  School  Policy  in  New  York  City  (Nw  York;    Praeger,  ,1967) ; 
Marilyn  Gittell,  "Urban  School  Politics:    Professionalism  vs*  Reform;*V 
Journal  of  Social  Issues.  Vol,  26,  Summer  1970;  David  Rogers,  HQ 
Livingston  Street:    Politics  and  Bureaucracy  in  the  New  York  City 
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School  System  (N'ew  York: U  Random  Kous6,.  1968)  ;  Marilya  Gittell, 
with  Maurice  Berube,  Boulton  IK.Demas,  Daniel  Flavinr,  Frances  Gott- 
,  fried,  Rhoda  Karpatkin,  Odarkov  Lawson,  Mark  Rosentraub,  Adele  Spier* 
and  David  Tatge,  School  Decentralisation  and  School  Policy  in  New 
York  City  (New  York:    Queens  College  Institute  for  Connnunity  Studies, 
1971). 

38.  Michael  Radnor,  Harriet  Spivak,  and  Durward  Hofler,  Research^  Develop- 
ment and  Innovation:    Contextual  Analysis  (Evanston:    Center  for  th^ 
Interdisciplinary  Study  of  Science  and  Technology,  Northwestern  Uni- 
versity, 1977)^,  especially  chapters  3--7. 

39.  For  instance,  see:    James  W.  Becker,  "Incorporating  the  Products  of 
Educational  Development  into  Practice,"  Journal  of  Research  atrd  De- 
velopment in  Education^  Vol.  3,  No*  2,  Winter  1970:    reprinted  in  The 
Oregon"  Studies,  Vol,  II,  op.  cLt.;  also  reprinted  in  John  Ifemphill 
arid  Fred  S.  Rosenau,  e9s*.  Educational  Bevelopment:    A  N^w  Discip],in6 
for  Self-Renewal  (Eugene:    Center  for  the  Advanced  Study  of  Educat^ion- 
al  Administratiba,  University  of  Oregon,  1973).    For  other  discussions 
of  the  effect*  of  statewide  textbook  adoption,  see  for  Instance:  NIE> 
Building  Capacity  for  Renewal  and  Reform,  op.  cit.^  and  Gene  V.  Glass 
and  Blaine  R.  Wofthen,  "Educational  Inquiry  and  the  Practice  of  Educa- 
tion," in  The  Oregon  Studies  in  Research,  Development,  Diffusion  and 
Evaluation  Vol^  III:    Conceptual  Frameworks,  .H.  Del  Schalock  and  G. 
Roger'Sell,  eds.   (Moiunouth,  Oregon:    Teaching  Research  division ,  Oregon 
Stat6  System  of  Higher  Education,  1972). 

40.  Becker,  "Incorporating  the  Products  of  Educational  Development  into 
Practice,"  op.  cit. 

41.  "    For  instance,  see:    Pincus,  "Incentives  for  Innovation  in  the  Public 

Schools,"  op.  cit^  ^ 

42*      For  instnace,  see  the  following  Chapters  in  this  volume:  "Environ- 
mental Influences  on  the  Educational  R/D&I  S;y3tem,"    "The  Develop- 
ment Function  in  Educational  R/D&I,",  "Dissemination  pf  Educational 
R/D&I  Outputs,"    "The  Implementation  and  Utilization  Functions  in  Edu- 
cational R/D£tl,"    f'The  Evaluation  Research  Function  in  Educational 
R/D&I,"  and  "Outputs  of  Educational  Research  and  r/d&I." 

43.  Rddnor,  Spivak,  and  Kofler,  Research,  Development  and  fnnovattLoni 
Contextual  Analysis,  op.  cit..  Chapter  9,  "Entrepreneurship :  An 
Issue  of  the  Historical  Development  Feature." 

44.  For  instance,  see:    Carlson,  "Barriers  to  Change  in  Public  Schools," 
op.  cit.;  Sarason,  The  Culture  of  the  School^  op.  cit. 

A5.      Ronald  C.  Corwin*  "Scracegies  for  Organizational  Innovation;  An 

Emprlcal  Comparison,"    American  SocioloRical  Review,  Vol,  37,  Augusjt 
19  72. 
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Sieb^r,  "Organizational  Influences  on  Ijinovat^Ve  Roles,"  op,  c^t,  ; 
and  Sarason,  The  Culture  of  ,the-School," -pp^  -<?i.ts.  ' 
'  ,  .      ^  ■  '  ,         ,  \ 

For  more  on  this,  especially  oi{r  reasons  for  questioning  the  ybill^ty^ 
of  much  of  the  diffusion  research  literature -for  application 'to  the 
educational  context,  see.  our  subsequent  chapter  in  this  ^lume  en- 
titled, "The  Implementation  and  Utilization  Functions  In  Educational 

R/D^i/''    ^  '      ,        /     '  :  .   

■  ■  •     ■     ■  ■-    •  ^ 

A  planned  NIE  survey  pf  school  practices^is  mentioned  in  National  ' 
Institute  of  Education,  Dissemination  and  Resources  Groap,  Dissemina~ 
tion  and  Resources  Group  Program  t^lan  FY  1978  (Washington;  NIE,, 
August  1976).  ■ 

Such  in-depth  documentation  with  cross-ca^e  analyses  might  follow  the 
pattern  used  by  The  Oregon  Studies  \>n  Research,  Development^,  Pi f fusion  * 
and  Evaluation,  op.  cit,  >  H*  Del  ^chalock.  Director,  *  S^ee  especially 
Vol*  4,  Parts  1-3,  Case  Profiles^  Hart^       Ammerman,  Darrell  Clukey, 
and  Gregory  P.  Thomas^  ed* ;  Vol,  5,  Kethodology,  Loring  M*  Carl,  Gregory 
P*  Thomas,  Clark  A*  Smith,  Kevin  R*  Morse*,  and  Darrell  Clukey,  eds*;  ,and 
Vol*,l,  Suiamarv  Report,  by  H,  Del  Scl^'alock,  feregory  p*  Thomas,  Kfevin 
Morse,  Clark  A*  Smith,  and  Harry  L*  Ainmerinan*    For  a  less  successful 
effort  at  the  same  kind  of  case  studies  with  cross-case  analyses,  see 
materials  produced  in  1978  in  the  Docufeentation  and  Technical  Assistance 
in  Urban  Schools  'Project,  sponsored  by-  NIE's  School  Capacity  for  Local 
Problem-Solving  Group*  ^      ^  ^ 

See  our'earlier  chapter  entitled  '*Neeil  Id^tif ication  in^ducation/* 

Oil  NIE's  Information  Component,  see;  'NIE,  A  Concept  Paper  for  the 
School  Practice  and  Service  *Divi8i<5n,  op^  cit^;  NIE,  RFP  to  Establish' 
an  R6(D  Dissemination  and  "Feedforward^'  System,  op^  cit.;  Susan  Klein, 
Richard  McCann,  and  Mary  Saily,  "The  R6.D  Exchange:  An  Emerging  Effort," 
in  Information  Dissemination  and  Exchange  for  Educational  Innovation?; 
Conceptual  and  ImPleTaentation  Issues  o£,aRej^lonally-Based  Nationwide 
System,  Michael  Radnor,  Durward  Hofler,  and  Robert  Rich,  eds*  (Evanston: 
Center  for  the  Interdisclpli^iary  Study  of  Science  and  Technology,  ^'ort^'- 
western  .Ur^versity,  1977)* 
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THE  t>lPLEMENTATION  A^^)  UTILIZATION  FUNCTIONS 

.  — »  Page 

1.  OVERVIEW  OF  THE  RELEVANT  LITERATURE  .  -   

1*          The  Literature  on  Planned  Organizational  Change'  .  .  .  10^2 

2»          The  Literature  on  Schools  a$  Organizations  »  \  *  1043 
3»          Analyses  Which  Pinpoint  Implementation/Utili- 
zation as  the  Stumbling  Block  in  Change 

Efforts  to  Date  T   ^^^^ 

4.         ,The  Literature  on  R&D  Utilization  and  School  , 

System  Renewal  Effort^   ;  »   .  •   .  1045 

II,,         UNDERSTANDING  AMD  APPLYIiJC  THE  LITERATURE 

TO  POLICY  DEVEL0PME15T  .   .    ^^^^ 

U  Analytical  Distinctions  \  \  ,  .  .  .  ,  1048- 

A*    Technological  Innovations  vs. 

,y*People  Change"  Innovations  ^^^^ 

V         B»    Individual  Adopters  vs»  Organizational 

Adoption  .  .  .  .  ;   .  .  /  \  1052 

C»    Adoption  ys»  Implenientatlon  ^»  ♦  *  ♦  ^J-'-'-'-' 

*D»    Adoption  vs»  Adaptation  ,t  ^  1058 

Implementation  vs»  Utillzation/lnsti- 

"    tutionalization-  "  .^^^^ 

F»    Summary;    The  Greater  Complexity  of 

Innovation  in  the  Educational  Context  1067 

2.  The  Educational  Setting   *  *  ^^^^ 

A*    Radical  vs*  Incremental  Change         ^  .......  .  ^^^^ 

B.    Sociological  Descriptions  of  Schools  vs» 

Faitors  that  Explain  Differences 
,  Between  Innovative  and  No n- Innovative  Schools  *  *  *   107  7 
a*    The  Educational  Setting;    Barriers  to  Change  *  ,1078 
i*     *  The  Market  Structure  of  PubXlc 
*        ^  Schools;    The  School  as  a  • 

Domesticated  Organization  '1079 

ii'v  .   The  Market  Structure  of  Public 
Schools:*  The  School  as  a 

^  Highly  Vulnerable  Organization   ^^^^ 

iii»    The^ureaucratic  Structure 

of  Public  Schools  .  .  \  .  .   :^  i084 

iv»    /Other  Barriers  to  Innovation 

in  Schools  V  ^^^^ 

b.    The  Educational  "Setting:    Change  Despite 

the  Barriers  to  Change  ^^^^ 

III*        FINDINGS  FROM  IMPLEMENTATION  RESEARCH  .  .   .:  ll(fc 

1»       ;    Gross,  Giacquinta,  and  Bernstein,  Ijjrtplementing  *  J  > 

Organizational  Innovatiojis  .  .  \  .  \  "^^  *'ir05 

2*  Sarason,  The  Culture  of  the  School  and  the 

Problem  of  Change  ,  .  \  IH^ 
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3.    .       The  Rand  Corporation  Change  Agent 

Study  J  FederaL  Programs  Supporting                   ^  .  * 

Educational  Change  *  *  *:  ^   1114 

4*  Iiaplicatipns  of  the  Findings  from 

Implementation  Research  *  "   1118 

iv:  RECENT  INITIATIVES  TO  STRENGTHEN  THE 

I>IPLEM5KTATI0N/UTILIZATI0N  FUNCTIONS  AHD  * 

LOCAL  SCHOOL  SYSTEM  CAPACITIES  FOR  SELF-RENEWAL  .   •  •   •  ^^^^ 

1.  ^^I^Tyoes  of  Progritas   ^^^^ 

A*    Teacher  tJenters                                                ,  /  .  .  ^^^^ 

b1-  Technical  Assistance  Programs,.,   ♦  •   ^^^^ 

C*     Broadcasting  for  Educators  and 

'              In-Service  Training    ^j^^ 

Consulting  Services    .... 

E.    State  and  Interstate  Networks  ,  ♦  .  .   r   1130 

2.  Models  and  Strategies  .    "-^^ 

A.    Models   .1136 

.    B.  ^Strategies                        ^  ♦  ...  ^   1135 

3.  Needed  Research  .  .  *.  .  1143  ' 

A.  Documentation  and  Process  Analysis  1143 
B*     Basio  Data  on  the  Inst'itutional'.and 

Personnel  Base  for.These  Functions   1144 

^    C*    Needed  Studies  .1145 

a.  Types,  of  Change  Forms  .....  .      .  .  ..  \  *  *  1146 

b.  Range  of  Operational  ^Settings   1147 

C.    Range  of  Organizational         *  ~- 

Arrangements  and  Supports  .  .  :  ^.  .  1151 

d.    Change  Roles  and  Training  Requirements  1151 

4.  Conclusions  •      •  1152 
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Of  all  Che  educational  r/D&I  *func'tions ,  inipl^m&nlation  is  the  most 
recent  to  ha^e  ])een  discovered  by^  fetieral  policymakersras  an  area 
in  need  of  support,.  Interest  In  Implementation  has  been  sparked  by 
fhe  repeated  finding  of  no  significant  effect  from  much  of  the  inno- 
vation that  has  beea  tried  in  the  past  decade  or  so>  and  by  the 
nagging  questions  that  have  been  raised  about  thl^  finding  means 

in  relation  to  what  has  in  fact*been  implemented:    Has  the  innovation 
been  tried  aud  failed>  or  was  xt  ^in  fact  never  tried  at  all,  and 
therefore  never  really  given  an  adequate  test?^  '  What  in  fact  is 
the  precise  nature  of  the  innbvati^n^  that  was  impl'enientedj  and  how 
closely  do^s  it  resemble  the  Inn^H^etioii  as  xts  developers  intended 
it  to  be  implemented?!  To  what^ extent    is  the  limited  effectiveness 
,  of  an  innovation  as  implemented  attributable  to  problems  encountered 
in  the  imp^mentation  process  and  to  needed  implementation  support 
that  was  not  provided?.   Under  what  impl^entation  conditions  is  a 
given  innovation  most  effective?    Under  what  conditions  is  it  least 
effective?    Federally  funded  evaluations  of  innovations^are  increasingly 
calling  for  data  on,  the  implementation  proc.ess  (i*e,,  documentation 
of  what  in  fact  wa^  impl^ented  and  how)  >  so  that  findings  on  program 
eff ectiveness^can  be  meaningfully  related  to  inJfrroation  about  what 

it  was  that  was  implemlsnted/ and  to  what  "treatment"  (to  use  the  re- 

2 

search  jargon)  the  effectiveness  data  are  relevant*^ 

.  ■  '  .  r 

'Fhls  new  federal  interest  in  the  implementation  process  seems  to 

have  eftnerged  at  about  the  same  time  as  another  interesting  shi|t>  this 

one  in  the ^thinking  of  the  educational  r7d&I  community  at  large^ 

Though  such  characterizations  are  risky  —  there  being  no  clearly       s  , 

defined  "R/D&I  community/'  much  less  any  consensus  on  what  represents 
current  educational  r/D&I  thinking  —  our  reading  of  the,  literature> 
prpfessional  discussions  and  debates>  etc,  over  the  past  if our  to  five 
years  suggests  that  the  focus  of  new  thinking  on  school  improvement 
}S  jphif te^'-f-ciom  external  R&D  to  internal  strategies* 


'    1038  ' 

Ir  *  ' 

One  early^tidicator  of  this  shift,  may  have  been  the  increasing  nuvber 
of  attac!*e  made  on  the' naivete  of  the  linear  R&D  mocTel.    This  model 
(at  least  as  it  has  been  characterized  In  the  literature)  assumed 
that  research  aW  development  work  could  be  'carriad  on  largely  in 
external  R£(D  organizations  >  which  would  develop  and  package  innovations> 
which  could  then  be  dissaminated  to  user  systems  >  adopted  by  thein> 
and  there  implemented  and  used  by  them  as^  developed  and  packaged  by 
these  R£(D  organizations  located  outSid||;the  operating  system.  Although 
fevj  now  appear  to' acknowledge  that  they  ever  subscribed  to  this  linear 
modelj  it  appears  that  federa^l  R&D  funding  was  allocated  in  a  manner 
that  assumed  this  model  as  th'e  basis\for  a  viable  innovatioa  strategy. 


^Recent  literature  suggest^  that  the  educational  R/D&X  community 
may  be^  evolving  a^nore  sophisticated  grasp  of  the  complexity  of  edu- 
cational innovation  processes >  and  especially  the  complexity  of  the 
operating  system>  the  large  number  of  variafbles  of  consequence' for 
the  Innovation  process >  the  considerable  variability  among  schools 
and  school  systemd>  and  the  substantial  Impact  of  the  operating  system 
and  its  variability  on  innovation  processes. 

The  newer  literature  calls  for  design  and  support  of  innovation 
strategies  that  focus  attention  on  the  operating  system;  The  key  em- 
phases in  that  literature  are  on;    "adaptation"  rather  than  '^adoptioft" 
of  externally  developed  Innovations;^    innovation  proc^ses  that 
on  wholly  inside  the  operating  system  (e*g*>  local  .problem-solving  . 


4 

approaches;  OD  and  various  other  self-^renewal  strategies);      the  need 
for  technical  assistance  to  support  implementation  and  utilization 
of  innovations >  whether  developed  within  the  operating  system  or  In 
external  ^i^O  organi^ations;^^   tlife  Reed  for  «  more  sophisticated 
understanding  of  the  practice  setting;      and  the  need  to  expand  the 
capacities  b£  practitionets  and  school  systems  to  carry  out'^^eir 
own  innovations  (i*e*,  the  need  %o  support  efforts  to  improve  educa- 
tional practice  as  a  craft  and  evolo^  structures  and  processes  in  the 

practice  setting  to-  facilitate*  innovation  and  its  institutionalization) 

> 
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Federal  education  policy  appears,  to  be  reflecting  (and  p^rh\ps  even 
fueling)  jchis  new  thinking  in  a  turnabout  in  en^hasis>  the  second^ 
d^rnabout  ifi  less  than  two  decades.    After  over  a  decade  of  federal 
investment  in  educational  R£(D,  with  large  sums  going  to  both  external 
R&B  (e.g*,  the  labs  and  centers  and  private  sector  R&D  organizations) 
and  internal  pi:;actice-based  development  (e.g,,  E.S.E.A.,  E.S.A.A.; 
and  categorical  funding  to  vocational  education  and  programs  for  the 
harldicappeci)  ,  federal  budget  allocations  in3rcate  a  mixed  investment 
in  both  internal  2nd  external  strategies.    >fany,of  the  never  program 
initiatives,  though,  are  directed  at  building  internal  school  system 
capabilities.    In  sum,  net;  policy  and  program  development  appeals  to 
have  returned  to  where  it  was  prior  to  the  mid-'60s  surge  of  faith  in 
external  RitD  as'  the  one  best  approach    for  achieving  rapid  improve- 
ment of  educational  practice.    The  focus  appears  to  have  returned  to 
the' operating  ^system,  and  to  the  difficult  and  likely  slow  Droce^s 
of  improvement  of  practice  from  inside  the  operating  system^  relying 
largely  on  practitioner  expertise' and  resources,  and  on  efforts  to 
strengthen  and  expand  those  resources  and  areas  of  expertise* 

Consequently,  for  our  analysis,  this  chapter  must  do  double  duty, 
presenting  both:     (a)  our  examination  of^ implementation/utilization 
processes  and  their  requirement^j  and  also  (b)  a  more  extensive 
analysis  of  th^  operating  system  than,  the  overview  presentation  inclu- 
ded in  our  earlier  chapter  on  the  environment  of  the  educational  r/d&I 
system-   .  ^ince  operating  system  .attributes  critically  affect  imple- 
mentation  and  utilization  processes,  it  seems  essential  t:o  Examine 
these  in  some  depth,  to  permit. us  to  arrive  at  some  judgments  about 
the  kinds  of  implementation/utilization  suppo?^  that  may  be  needed* 
Much  of  '^Ifat  w-e  will  discuss  in  this  chapter  in  our  analysis  of  the 
operating  system  is  relevant  not  only  to*  implementation  anS  utiliza- 
tit)n,  but  also  to  the  entire  innovation  process  as  it  takes  place 
within  operating  systems  (i^e* >  ne^d  identif ication>  research>  deye- 

iopmentj  dissemination,  and  evaluation  research  as^they  occur  within 

^    ^  9 

practice  settings,  as  well  as  implementation  ^nd  utilisation). 


Definitions:  For  purposes  of  this  analysis,'  we  are  considering  itnple- 
mentation  together  with  utilization  in  a  single  chapter.  Implementa- 
tion is  defined  as  all  processes  leading  to  installation  and  triai  oi 
an  innovation  in  the  user  operation.    The  processes  are  very  much  the 
s^me  regardless  of  whether  they  are  undertaken  at  the  initiative  of 
the  aser>  the  producer,  a  distributor,  6r  some  support  service.  These 
processes  incluc^e:    installation,  testing  and  debugging,  monitoring 
and  evaluation  daring  the  trial  run,  and  feedback  to  the  user  and 
producer.  ^ 

Utilization  is  defined  as  the  "processes  resulting  in  the  innovation 
being  accepted  by  the  user  organisation  on  a  continued,  sustained 
basis* "^^    These  processes  include;    routin^ation;  standardization; 
institutionalization;  monitoring,  evaluation,  modification  and  feed- 
back prior  to  accrptance;  acceptance;  maintenance;  and  possibly 
extension  snd  improvement* 

We  are  considering  these  analytically  separable  functions  i^pgether 
here  for  two  reasons.    First,  although*  each  has  distinct  components, 
the  two  share  several  processes  in  common.    Second,  in  reality  they 
seem  most  meaningful  when  considered  together*    Q&i&e  obviously,  the 

r 

Utilization  stage  cannot  be  reached  unless  the  implementation  stage 
has  been  completed  successfully,  and  many  of  the  factors  that  affect 
the  utilization  process  are  conditioned  by  the  experience  with  an 
innovation  during  the  implementation  stage-    Less  obvious,  but  of 
paramount  importance,  the  implementation  process  has  no  real  long-^  .  ' 
term  sigoificance  for  a  giv^n  operationg  system  unless  it  is  followed 
by  institutionalization  and  maintenehance  of  the  innovation  during 
the  utilization  stage*    The  observation  that  there  appears  to  be  a 
considerable  amount  of  experimentation  with  innovations  in  school 
systems. yet  very  little  real  change  may  simply  rej^lect  the  fact  that 
the  innovation  process  often  ends  at  the  lmpl5Tnentat;ion  stage  and 
rarely  coij^nues  info  successful  routinization,  institutionalization 
and  maintenance  of  the  change  in  the  day-to-day  operations  of  the 
school  system*    Therefore,  considering  both  implementJ^on  and  utili-- 
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zacion  together  may  underscore  the  needed  linkage  and^ long-cerm 
nacure  of  the  linplenientation/utilization  process. 


Chapter'  Overvieiy;  in  chis  chapter*  we  will  examine  the  literature  on 
implementation  a'nd  utilization  of  innovations  in  education*  and'also 


draw  on  some  of  ^ur  experience~T.n  the  education  sectof  and  our  under-* 
standing  of  impreaentation  and  utilization  processes  a^/^ey  operate 
other  sectors- 

We  will  present^  first*  a  brief  overview  of  potentially  relevant 
bodies  of  literature  and  the  kinds  of  useful  insights  each  might  be 
expected  to  provide  to  guide  policy  development.  ^ 

♦ 

Second*  we  will  pake  note  of  some  of  the  difficulties  we  encountered 
in  trying  to  understand  and  apply  this  literature  to  the  operational 
reality  of  schools  and  classrooms.  Some  of  the  difficulties  will  be 
traced  to  the  emergent 'nature. of  thinking  on  the  subject.  The 
cutting  edge  of  much  of  the  new  literature  disputes  the  adequacy  of  ' 
previous  research  for  application  to  the  educational  context*    The  , 
— leterature       a  Wh6le*  Clietr"appears  at  first  glance  to  be  contradic- 
tory and  confusing.    But  this  is  only  a  part  of  the  difficulty,  and 
probably  the  least  important  part*    More  troublesome  is  the*disquieting 
sense  we  have  that  much  of  what  is  emphasized  in  tl^^  literature  is 
misleading  for  understanding  vhat  strategies  are  litely  to  have  the 
greatest  effect  facilitating  school  improvement*    Our  assessment  of 
the  literature  ummarized  in  section  two*  then  (which  turns  out  to  be  ' 
the  bulk  of  the  potentially  relevant  literature)  is  that  it  may  very 
well  point  policy  thinkii^g  in  the  wrong  direct^&ns^ 

In  section  three*  we  focus  on  some  other  factors  suggested  in  a  hand- 
ful of  studies  which  we  believe  point  in  more  productive  directions. 
In  discussing  these  other  factors*  we  will  take  note  of  some  of  the 
unansweVed  questions  they  raise  and  suggest  what  sorts  of  questions 
we  believe  need  to  be  studied  before  we  will  be  in^^  position  to 
d^«4op  workable  policy  options  and  programs  to  strenthen  implementation 
it.,,.    .  '  ■   "  . 
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and  utilization  of  educational  innovations, 

Fipally>  we  will  examine  some  recent  initiatives  that  have  been 
taken  to  strengthen  implementation  and  utilization *o£  innovation^  in 
education,  and  take  note  o£  some  other  possibffelties  .that  may  warrant 
aconsideration.    We  will  consider,  too,  how  some  of  the  unanswered, 
questions  in  need  of  emphasis  and  research'  might  be  incorporated 
in  current  or  future  efforts  to  provide  implementation/utilization 
supports. 


T,  '  OV£RVI£:v^  OF  THE  RELZVAj;!  LITERAL?.; 

"  3^    


There  are^t  least  four  bodies  of  educational  literature  relevant 
to  ari  understanding  of  implementation  and  utilization  of  innovations* 
in  education:   '(1)  the  literature  on  planned  organizational  change 
as  described  for  an  education  au(Jience;   (2)  the  literature  on  schools 
asorganizations;  (3)  analyses  which  pinpoint  the  implementation 
and/or  utilization  stage  of  the  innovation  process  as  the  key  stunjbling 
bloct:  to  successful  change;  and  (4)  descriptons  of  R&D  utilization 
d  self-renewal  efforts  by  School  systems  (whether  carried  out  with 
cal  inte^al  resources  or  with  the  assistance  af  external  sources  of 
expertise).    We  will  consider  each  of  these  briefly  in  turn, 

K      The  Literature  on  Planned  Organizational  Change 

There  is  an  enormous  literature  on  planned  organizational  change, 
which  has  become*  a  substantial*  active,  and  grofWing  field  in  its  own 
right.    Most  of  this  literature  has  been  produced  over  the  past  two 
l^cades,  accompanying  the  proliferation  of  federally  funded  social 
_  reform  interventions  in  the  *60s  and  the  increasing  attention  given  - 
to  x>rganizational  behavior  and  organizational  change  bjt  the  field  of 
business  management.    Planned  change  has  been  the  focus  of  considerable 
actenc.|on  by  scholars  from  the  discipline^  of  psychology,  sociology, 
and  political  science,  as  well  as'applied  field^  such  as  education, 
Social  work,  business  management,  and  public  administrat?ion.    The  * 
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subject  has  received  intensive  treatment  by  those  who  focus  on 

organizational  behavior  and  social  psychology*  and  has  also  been 

-^pproac^ed  ^rom  5uch  diverse  viewpoints  as ^ the  human  relations  per- 

-^^pect:^^  on  the  one  hand  and  the  political  systetns  perspective  on 
12 

the  other*       "There  are  already  scores  of  classics  in  this  literature. 

Review  of  this  large  body  of  literature  is  beyond  the  scope  of 
this  analysis,   Jlowevar*  we  have  t^ken  note  of  a  number  of  secondary 
sources  that  have;  been  prepared  for  educators  in  an  attempt  to^ipake 
this  knowledge  ba^e  more  accessible  to  them.    This  body  of  secondary 
sources  inc ludes  :3Several  annotated  bibliographies,    and  some  useful 
review  ^rticle^  ^nd  knowledge  syntheses  .  "^^  i 

This  literature  provides  analytical  tools  for  determining  what  kinds 
of  change  strategies  night  be  most  useful  in  pfirticular  organizational 
contexts*  as  well  as  what  barriers  to  change  shou^td^^^ef^nticlpated* 
and  what  kinds  of  inplementation  supports  might  be  needed  for  the 
innovation  process. 

2.      The  LJ.terature  on  Schools  as  Organizations 

The  field  of  sociology  of  education  has  undergone  a  considerable 
expansion  over  the  last  two  decades,  and  with  it  has  grown  the  litera" 
ture  on  schools  as  organizations.    Sociologists  have  examined  the 
^  social  structure  of  schools*  the  nonns,  values*  and  attitudes,  that 
condition  .the  behavior  of  school  personhel*  the  relationships  between 
schools  and  their  environments,  etc*    All  of  these  tend  to  operate, 
mor^  often  than  not,  as  barriers  to  change,  l,e,,  as  sources  of  diffi-' 
culty  that  need  to  be  overcome  in  the  implementation  and  utilization 
phases  of  the  innovation  Brocess^ 

There  is  a  rich*  fascinating  literature  about  schools  as  organizations 
that  is  absolutely  **must*'  reading  for  those  who  are  serious  about  pro- 
^  ducing  planned  change  in  schoqls.    Clearly,  unless  organizational^ 
sources  of  resistance  to  ^innovation  arejtaken  ibto -a.qcount »  planned 
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change  will  not  succeed,  'regardless  of  whecher  the  strategy  taken 
involves  external  RSiD  or  iUcernal  development  or  renewal.    We  will 
concern  ourselves  in  chis  chapter  with  the  kinds  of  research,  policy, 
and  planning  issues  raised  by  this  literature,  and  the  unanswered 

questions  that  need  to  be  tackled. 

#  *  *■  ■ 

3.  Analyses  Which  Pinpoint  Iroplementation/Utilization  as  the  Stumbling 
Block  in  Chajipe  .Efforts  to  Date 

A  smaller,  but  very  informative  literature  has  analyzed  specific 

change  efforts  that  were  not  highly  successful,  and  located  the  key 

problems  in  the  implementation/utilization  process*    This  literature 

17 

includes:    case  studies  of  specific  change  efforts;"     analyses  of 

the  change  process  and  its  difficulties,  using  specific  change  efforts 

'  18 
asi  springboards  for  the  broader  discussion;      surveys  of  innovations 

*  19 

described/By  practitioners  as  "irapletnented** ;  ^    and  one  exceptipnally 
useful  review  of .  the  literature  on  implementation,  produced  as  part 
of  the  Rand  Corporation's  Change  Agent  Study  for  the  Office  of  Educa- 
tion. 


The  importance  of  this  literature  cannot  be  overstated*    Several  of 

thesV  pieces  are  cited  repeatedly  in  recent  discussions  of  educational" 

innovation,  as  support  for  the  need  to  focus  attention  on  implementa- 
21 

tion  processes.       Federal  policymakers  in  particular  seem  to  have 
been  impressed  by  the  argument.     Examinatiort  of  some  recent  RFPs  issued 
by  both  OE  and  NIE  show  clear  indicatipns  ot  the  impact  of  the  argu- 
ment:   Evaluation  reseatch  cor^tractSi,  appear  increasingly  to  be  inclu- 
ding requflrements  for  documentation  ind  analysis  of  implementation 
processes.     Iniplsnentation  data  is  coming  to  be  called  for  ftom  eva- 
luators  assessing  new  programs  implemented  by  school  systeMs.  And 
innovative  programs  of  various  kinds  are  now  being  designed  to  include 

grants  to  third-party  researchers  whose  responsibilities  focus  on 

I  * 

studying  program  processes.    -  ^ 

I 

We  will  examine  this  literature  in  so(ne  detail  in  a. subsequent  sectioh 


mi\. 


1045  .  . 

oE  this  chapter^  and  use  it  as  a  basis  for  much  of  our  analysis  of 
needed  research  and  useEul  directions  for  policy  thinking. 

A.      The  Literature  on  R£tD  Utilization  and  School  System  Renewal  Efforts 

la  the  last  few  years  since  federal  policy  has  taken  cognizance  of  the 
significance  oE  the  implementation  and  utilization  stages  of  the  inno- 
vaCjlon  process  >  various  kinds  of  implementation/utilization  supports 
haVe  either  appeared  or  increased  their  pro:ninence  on  the  education 
scene.    The  literature  is  still  relatively  sparse>  but  there  is  an 

accumulating  body  of  material  on  the  creation  and  functioning  of: 

22  23 
teachvr  CLntc>rs;^     training  and  tiichnical  aj^sistaac^f  groups;  ,    OD  and 

/  -      ^  "  24  ' 

renewal  teams  itV  special  units  vit^in  school  systems;      state  and 

interstate  networks  of  intermediate  school  service  agencies  (lEAs 
25 

and  ISAs);      and  networks  of  schools  and  districts  li-nked  to  one  another 
because  they  are  dealing  with  similar  problems  or  using  similar  inno- 
vations (e.g,>  the  RBSL  network  of  schools  usin^  their  Individually 

Prescribed  Instruction  Program^  the  Network  oE  Innovative  Schools > 

26  ' 

the  ES'70  Schools>  the  ^^a:tional  Diffusion  Network>  etc*     ).     "  ' 


The  implementation  support  'strategies  used  by  these  organizations 
appear  ^to  lean  more  havily  tov/ard  a  clinical  chai^  model  of  working 
with  clients. to  adapt  innovations  to  local  circumstances^  as  con- 
trasted with  the  R£tD  delivery  model  of  asrsisting  school  districts 
in  acquiring  standardized  products  developed  by  R£tD  organizations- 
However,  beyond  this  general  orientation  suggested  by  the  literature^ 
we  know  very  little  about  the  nature  or  scope  of  this  institutional 
base;  how  niany  organizations  there  are>  and  of  what  various  types; 
how  .they  are  distributed  geographically  and  by  services  provided;  how 
many  school  districts  they  serve;  what  strategies  they  use  and  with 
what  degrees  of  effectiveness;  S?hat  personnel  and  other  resourc 
bases  they  draw  on;  the  ^lature  6f  th£ir  linkages  with  KP  as  well#as  - 
KU>  or  with  oth^r  linkage  organizations;  etc. 


.lifhile  there  is  nothing  new  about  schools  or  districts  experimenting 
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wit^  one  or  another  particular  innovation>  what  is  new  about  these 
renewal,  efforts  of  the  past  few  years  is  the^r  emphasis  on  building 
school  system  capacities  for  ongoing>  self-initiated>  self-designed > 
and  self-managed  change.    As  a  by=product  of  this  einphasis>  there  is 
considerable  interest  in  developing- training-programs  for  change 

V 

agents  and  producing  various  guides  and  other  niaterials  to  support 

change  agents  ir^their  efforts.    Consequently >  there  has  been  a  pro- 

liferation  of  training  programs  and  guides  tPaking  their  appearance 

27  ■  ^  ^ 

in  this  literature. 

In  a  subsequent  section  of  this  chapterV       shall  have  more  to  say 
about  these  utifization  and  renewal  efforts*  and  how  thoy  may  be  used 
to  enable  us  to  leaifn  more  "about  implementation  and  utilization 
processes  and  requirements  in  education  and  policy  aptions  to  streng- 
then  implementation  and  utilization  of  innovations  in  education. 

II.     UNOERSTA-^DING  AND  AP?LYING  THE  LITERATUPvE  TO  POLICY  DEVELOP^^ENT 

Of  all  the  topics  we  have  analyzed  in  this  volume^  the  material 
covered  in  this  chapter  is  perhaps  the  most  dijPricult  to  come  to  grips 
witTi  in  a  policy  relevant  laanner.    There  are  at  least  three  reasons 
for  this. 


ERIC 


'^irst  of  all  >  although  there  is  a  sizeable  literature  that  is  pote^iy 
tially  relevant  to  the  subject>  there  is  relatively  little  literature 
that  specifically  describes  the  implementation  or  utilization  o£« 
innovations  in  education.    And  little  of  what  does  exist  in  the  litera- 
ture'is  highly  useful.    There" is  a  literature  which  points  ho  thi$ 

phase  of  the  innovation  process  as  a  key  stumbling  block>  and  we  will 
*  *■  '  . 

look  at  this  shortly.    But  even  so^  what  we  have  learned  from  this 
literature  is  on  a  highly  general  level  and  lacke  the  specificity 
required  to  guide  pS^cy^cyr  program  development.    This  literature 
simply  ratsos  more  quest  ions *than  it  answers. 

Secondj  the  literature  as  a  whole  is  difficult  to  apply  because  a  key 

1.0X3 


n 


themej-n  rouch  of  it  is  thfft  the  bulk  of  the  exisiting  material  on  thi 
subject  1^  itrrelevant  to  the  e4iicational*context>  and  probably  mls-^ 
leading  for  an  understanding  of  implementation/utilization  in  this 
.context.    \^at  we  find  in  the  newer  literature  is  an  effort  towai% 
reconCeptuallsat'i^n,  ^ime^  at  reorienting  thjftking  in -the  field  and 
building  new  theoretical  frameworks*    Xh^  sense  one  gets  from  tjii^^'' 
new  literature  is  not  only  the  inadequacy  of  old  fJLnditIgs  but  also 

the  i^rr^J^ance^  of  the  did  questions  tbart^fuelejJ  earlier  research. 

■A  ^  - 

Bas^^lly,  the  ^rgumerktifnade  ill' the  newer  literature  is  that  tl?e 
earlitr  work/carried  out  in  the  diffusion  research  tradition,  failed 
^^ake  a  nuaber  of  key  d;vstinc tions  ^iti<:al  to  understanding  imple- 
mentaifion/utlllzation  in  the  educational  contejrt,-.  Most- of  theftrork 
wa^carried  on  in  other  contexts  rather  dif&erent  in  important  way6 
from  tjie  field  of  education,    ti/hen ^pplied  tt?  edtjeation,  ctxen,  it 
ses  attention  on  the  wr^g  factors  and  bverlbo^s  the  key  forces 
ork"  in  implementation/utilisation  in 'educatj|^-    We  shall  explore 
these  distinctions  in  some  detall>  assess,  their,  policy*  signlf  icance^ 
and  then  lAke  alo6k  at  the  questions  they  raise  about  the  utility 
af^the  earlier  literature  and  about  new  kinds  of  research  and  analy- 
tical W^rk  that         be  needed. 

There  is  then'f  elatiyely .  lit  tie  litefaturt  on  the  subjec  t^N^jiid  the 
most  useful  of  what  Is  there  questions  >tne  relevance  of  the  rest  of 
the  .literature' for  application  ti  ^^educational  context/   As  impor- 
tant as  these  reasons'may  be  ^^^I^^^V^^         ItAis  so  difficult 
to  apply  the  existing  literatur|plHHli     de^^Blogrngpt^  thelr^slgni- 
f'icance  dims  in  comparison  to' the  tWird,  most  important  and^.mostt'uh- 
settling- 'Point- wetnust  come  t,o  terms /eitl^*    Tfie*  topic  of  impieme^ta-^j 
tlofr/utilization  processes  forces  up  more  closely  l)erhaps  tifan  any 
oth^l^subj#e^lA we  consider  in  this*vVlume  to  confront  the  school 
and  classroom  reality -and  to  ask  ourselves  about  the'validity  and 
relevance  ;'of  many  of 'th^  assumptions  about  .(and  description^  off-. 
Schools  and^classT^lpoms  found  in  njuch  of  tHe  literature.    The  mor% 
one , thinks  aboyt^the  schools  one  has  seen%and^he  people  one  has 
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known  worjcing  in  those -schoolSj  the  mbre  one  gets  iM  disqti^ting" 
f eeling'^that  real  schools  and  real  people  don't  quite  work  the  way 
tltey  are  described  in  the  l^^rnture,  chat  what  is  described  in  the 
iiteratut^e  Day  be  at  best  only  a  small  part  of  the  whole  (and  not 
necessarily  the  most  importartt*^pais*)  >  and  that  the  points  emphasized 
irt  the  literature  are  not  the  ones  most  helpful  for  understandirjg .  the 

real^  problems  that  need  to  be  ttie  focus  of  policy  development* 

if  *  ~ ' 

For  all  these  reasons,  the* literature  we  have  tried  to  synthesize 
seeriis  to  po^nt  to_  nfore  research  iasuess  than  to  clear  poliicy  optioas* 
it  may  simply  be  that  our  understanding  of  im^lementetion/util ization 
processes  Hn  education  is  too  immature  to  provide  much  guidance  for 
policy  d^ve^lopiiieht  and  that  this  nnst  sitoply  be  accepted  as  the-'b^se- 
line  forSa  longer-term  policy ■ research  program. 


An  examination  of  that  literature  and  some  of  the  questions  it  raises 

in  our  minds  may  indicate  some  of  the  complexity  that  needs  to  be 

'  if 

explored  and  some  of  the  issues  that  should  be  pursued.    /  ^ 
\*      AnalyticaT  Distinctions  _ 

A.    Technological  Innovationg* vs.  "People  Change"  Innovations 

\ 

j^osc  of  the  work  done  in  the  difCusioR  resea^h  tradition  Invol- 
*  ved  the  study  o^  technological  fnnovatiop^'"(e.g. :  "  a  new  high-  " 
yield  hybrid  breed  of  corn).    The  t^efinologlcal  type  of  innova- 

*  tlon  has  a  number  of  distinctive  attributes  that  make  it  quite 
different  fro^  the  kinds-^6f  ^innovations  typical  to  educational 

-   setting^.    The  JLmibvations  introduce^  are  generally  easily 

definable,  bo^^dable  entities,  with  feservable  (often  measurable) 

-  t 
effects  that  can  be  replicated  ^sily..  The  proce&s  of  persuading 
*    .  It 

a  pot*.^ntial  adopter  to  try  a  given  innovation  can  generally 
^miike  use  of  evidence  showing  the  innovation  as  clearly  better 
'(in  ot>serv£^ble  ways)  than  what  it  i.s  to  replace.    The  innovations 

V 

ar:-  likly  to  chnllcnKe  few  if  any  af  the  potenti^^l  adopter's  ^ 

•  vaJueK  or  a-ttitudes.     It  is  usually  not  partidularly_  difficult 


to  Lehrn  how  to  use  the  innovation.    There  is  litt^l^iF.  3,ny      ^  - 
reactiveness  between  the  innovation  and  the  user: 
tend  to  te  appro^^iznarteiy  the  same  regardless  of  wl^ere  ti-he  i^o- 
vatioh  is  implemented  and  by  whom  (so  long  as  the  preJ^peei- 
fied,  generally  ea$ily-produced,  implementation  i:oftditi^>ns:ar^> 
adhered  to)  *  ■        ,  '     , , .  '  '^ 

J- 1*    ■  ■  ■ 

*  - 1\ ' 

Although  somewhat  oversimplified,  one  might  imagine  the"  iiij^ie*- -  _  \ 

.  mentation  of  a  C^tsi^nologlcal  innovation  tin  terms  of  pi>shiag  a  '  " 
T   button  and  getting  thfi  prespecified  results  regardles%. of  who 

■  pushes  the  button  and  where  Che  innovation  is  Installed,-  ;^xid  - 
to"o>  through  again  oversimplifiedj  orre  ^might  anCicipriie^f Indiag^ 
the  innovation  installed  in  the  new  setting  preqis^ijias-'dev-e- 

^  loped  by  its  external  developers,  with  littleMn  th^  way  of  adap- 
tation required*    ^  *   ^     ^     \  *  y  \ 


The  ipT^.vations  typical  of  the  field  of  education  ate  a  rather 
different  sort.    One  anlyst  coined  the  term  *'pQ^le  change" 
innovations,  focusing  on  theifmost  significant  Vnd  most  ^  "\ 
troublesom^quality.    Innovations  like  the  ^new  math^*  or^tlie 
"open  classroonij"  for  instance^  require  "peoplfe  chartg^"  in  two 
wayS|    Ultimately,  they  are  intended  to  produ^^e  some  changes* 
i.e.,  measurable  effe<;ts,  on  children  —  in  the  case  of  the 
'*new  math,"  Increased  understanding  of  mathematical  concepts; 
in»the  case  of  the  "open  classroom,"  more  individualized  IrSfetruc-* 
't^'on,  increased  motivation,' and  higher  "levels  of  achievement- 
More  imnediately,  these  innovations  require  changes  in  Ehe  be- 
haviors  (and  often  the  attitudes  and  values)  of  the  practitioners 
who  are  an  integral  part  of  the  innovation's  delivery  systems 
A  teacher  or  school  ^dministrator»who  is^  accustomed  to  traditional 

r 

mathematics  instruction  or  the  t^ditional  s^^-<%ontained  class-* 
500m*  must  do  a  considerable  amount  of  self-^changing  before  he 
or  she  can  effectively  provide  instruction  in  the  "new  math"  or 
effectively  use  the  "open  classroom"  approach*    Thes'e  innovations 
require  practitioners  to  unlearn  old  ways  of  thinking  and  doing. 


relate, to  tlje$^"  "^^ttii$^.;£fi3tldren  iti  ^'s^an^r-crortt^iieil/^laasroom^^^  /  -  \ 
Ttits  kind  oi"  ^irirroVait ibu  is  nob"  eaaily^^^^  - 

or%€^sqjrabie,^ An"<j[  ;s'ince  "  tn^^r^cljei^        ^Jij^  particular  ;schbol 
,  ^v- ;     V    setit^yig^-and  jclima£&./^r^  iritegx^S.        ami  err  a^£ect  the  . 

'  .  :  "  ediicati'Orial  itinovatior^s  tha>t'Vr^  txiflj^  **^^a^e,i2-^Q^  "  There'  ■ 
■ '   ^  is  a  signi'ficatVt  "(iegreje^of  reactiv^pe?^--^€^^:v       tba- iny^p^tlon 

and  the  user  (both  tHe  chit^d  ^s'^cti^l^Bser",  and  tli^.^pract^Hcnelr  as 
the  more  iitunediat€j 'u5er^ »    Co^Ut^u^i^t'iy  ■y\x^s)xlt's^  sxe- n<:^  easily 
replicable.  ■  ■  ■  '  '         •  '         '  .  ■    ...    ■     -    *  ,  -  - 
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A  few  points  should  underscore  sonie.of'  clie  compl^exity  to  fee  con- 
fro^ited'xn  <iealing-with  innovations  of  the  "people  change"  variety- 

-  p  ^  ■  .  \  .  ■     *  *  ^ 

Firsts  unlike  *tlie  ^Fiybrid  corn  example>  £n  which  researcbers  knew 
a  great  de^l  about  tbe  seeds,>.  soil,  etc- >.  in 'education  researchers 
k'no^r-reiatively  little  about  the  variables  affecting  the  con^i- 
derable  amount  of  v^activeness  tb  fie  expected  between  the-. Innova-- 
tlbn  and  its  users*    Due  to  ^11  of  these- unknowns and  ^to  the  * 
immature  state  of  d^evelopment  of  evaluation  tne^ifr^ent  techno- 
^logy»  and  t3o  the  often  very  long-term  nature  of  educational  out- 
comesi  it^is  difficult  to  measure  results  and  to  produce  convin- 
cing evidei^cs^that  a- particulati  innovation  is  more  effective  than 
the,  existit^g  approach  it  is  Ho  reblace.    And  lox  the  same  reasans> 
it  is  als<>dilfficult  to  prov:^^  clear  feedback  on  intermediate  ► 
outcoTOs  to  ^uide  the  impletneintation  process. 


J 


Second>  becau^e^of  the  high"  degree  of.  reactiveness  between  the 
innovation  and  users,  one  is  likely  to  find  the  innovation 
implencnted' somewhat  differently  wherever -it  is  tried,  wi,th 
different  kinds  and  degrees^ of  ^adaptations.    This  not  only 
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increases  the  difficulty  of  replicating  expected  results.    It  also 
further  complicates  'the  problem  of  assessing  the  innovation's 
ef f eccivsness  since  Refining  the  *'treatment"'becomes  a  problem  in 
^self.    Where  the  innovation  to  be  evaluated  appeat;s  to  some- 
wh^t  different  in  each  setting  where  it  Is  tried,  it  is  difficult 
to  know  if  the  outcomes  in  a  given  setting  are  attributable  to  the 
original  innovation  as  developed  and  diffused  or  to  the  implement;a'' 
tioQ  conditions  and  adaptJl£lons  in  the  particular  setting*    It    *    '  ^ 
becomes"lti^iiiiul£-T-'^^  use  resul,ts  from' one  school  systan  in 

predictive  manner  in  another  sfchool  system.    Therefore,  outcome 
data  from  one  school  system  canno^  be  used,  without  considerable 
qualification,  to  try.to  persuade  aftocher  school  system  co  adopt  a 
given  innovatiop*    Nor  can  such  data  be  used  without  con^derable 
qualification  in, planning  for  implementation  in  a  new  setting* 

Finally!  another  key  point  about  "people  change"  innovations  is  that 
they  often  challenge  established  attitudes  and  values  and  therefore 
are  more  likely  than  technological  innovations  to  stimulate  resist- 
ance,, from  practitioners  and  of  tern  from  parents  and  cominunity  forces 
as  well*    Thfi  "open  classroom"  is  a  good  example  of  a  radical  innova- 
tion which  challenges  traditional  ssumptions  about  how  students  and 
teachers  should  relate  to  one  another,  what  classrooms  should  look  ' 
l±V;e  physically  and  where  children  should  be  found  in  them,  what 
shoiild  be  taught,  to  whom,  when,  .and  how,  etc*    This  further  compli- 
cates implementation  both  because  the  innovation  is  more  likely  to  be 
resisted  or  emasculated  into  /'laore  of  tKe  same,"  and  because  there  is 
greater  room  for  misunderstanding  and  failing  to  adequately  unlearn 
the  old  while 'also  learning  th^  new*    Consequently,  "people  change" 
innovations  tend  to  have  considerably  more  extensive  training  require- 
ments  than  technological  innovations,' and  are  far  more'like-ly  to  be 
distorted  or  implemented  only  symbolically  or  not  at  all'as  measured 
by  ch'anges  in  classrooju  practices* 


JOlb 
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Given  all  these ^differen9es  between  technological  and  "people  change" 
innovations,  one  taust  conclude  that  the  typical  educational  innova- 
tion present^  far  greater  coMleicity  than  is  entailed  in  the  tech- 
no5toglcal  innovations  ^studied  by  diffusion  researchers.    And  since 
the  most  influential  forces  at  work  in  the  implementation  of  "people 
change"  innovations  are  different  from  those^ examined  in  the  dif- 
fusion research  literature >  there  does  seem  to  be  good  reason  to 
question  fhe  utility  of  most  of  that  literature  for  srp^pllpatiob  to 
the  educational  cofiteict^  ^  { ^  ' 

B.    Individual  Adopters  vs.  Organizational  Adoption 
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The  *^ot>n<i^J  adopter  of  an  innovation  studied  in  the  diffusion, 
research  tradition  Is  typified  by  the  example  of  the  individual- 
farmer  deciding  whether  or  rtpt  to  adopt  a  new  breed  of  corn  or  the 

individual  doctor  deciding  whether  or. not  to  Adopt  a  new  medical 

> 

ractice 


In  each  of  these  cases,  the  innovatdon  adoption  process 
t  involved  only  one  individual  considering  whether  or  not  to  replace 


the  old  with  the  new.  In  -each  of  these  cases,  too,  the  individual 
making  the  decision  to  adopt^'an  innovation  was  the  same  individual 
who  would  be  implementing  it/ 

Ilierefore,  it  was  reasonably  lilcely  that  if  the  individual  could  be 
persuaded  to  adopt  tlTe  innovation,  one  would  find  that  innovation 
implen^nted  in  practice^'  at  least  on  a  trial  basis.    This  being  the 
case,  numbers  of  innovations  adofJted  could  be  considered  a  relatively 
good  indicator  of  "amount  of  innovation"  in  a  field.    Of  coutse, 
there  would  be  some  slippage^,  with  some  individuals  changing  their 
minds  or  dropping  out  iiuring  the  implementation  stage  or  never  even 
"trying  to  implement  it.    But  still>  as  ^  rough  indicator,  this  seemed 
perfectly  reasonable  since  the  motivation  for  adoption  and  implementa- 
tion were  likely  to  be  the  same  and  the  forces  affecting  the  one  were 
not  likely  to  be  very  different  fi"C)m  the  forces  affecting  the  other. 
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•The  individual  mighc  encounter^  technical  difficulties  during  iinple- 
mentacion,  buC  was  noC  as  likely  to  encounter  moCivaCiona'l  difff- 
cul^ties  as  would  be  Che  case  in  organizational  adoption.  '  £ 

One  additional  point  a^out  individual  adoption^decisions:-    In  the 
case  of ^adoption  decisions  made  by  individuals,  the  analysis  of 
social  interaction  seeins  reasonable  as     way  to  look  at  the  diffu- 
sion of  innovations.    Uho  is  influenced  by  wha^  or  whom,  the  role*  of  ' 
gatekeepers  *in  opinion  influence  >  ^tcf.  —  all  of  these  research  issues 
co-s  -9  be  fcf  paranount  importance  for  understanding  how  to  facilitat>e 
and  speed  the  diffusion  process.    In  the  case^of  organi^atio^ial  adop- 
tiox decisions,  however,  considerably  more  coiaplexity  is*  likely  to  be 
involved:  the  5cr<ilal  i,nteraction  model  may  have  no  relevance  at  all 
it  nay  at  best  explain  only  a  single  step  in  a  more  complicated  multi- 
,step  process  affected*  by  a  much  ^arger  number  of  forces. 

Adoption  decisions  made  by  school  systems  Cor,  other  large  formal^  ^ 

organi2at^o^s)  differ  from  adoption  decisions  ma^de  by  individuals 

*       .  +  ^       *^  ^ 

in  ac  least. two  important  respects.         ^    '  /  ■ 

First  ,  organizational'-decision,  making  is' generally  more  complex  than 
individual  decision  making.   'There  are  likely  to  be  many  more  steps  ^  ^ 
in  the  oi^ganizational  decision,  process,  and  generally  different 
people  ajre  involyeil  ^at,  each^sceEj>    And,  compared  to  adoption  decisions 
by  individuals,  the  decision  outcome  is  likely  to  be  more  affected  by 

'factors  other  Chan  the  taerits  of  the  innovation  itself  or  tihe  severity 
of  th^  ^^blem^it  might  remedy.    ParCicularly  important  as  a  deoidi^^j^ 
clears  one  and  then  another  point  in  the  decision  making  process- tiiay 
be  internal  organisational  requirements  or  organizational  poli^:ics 
—  e.g*,  the  needs  of  individual  units  in  the  "organi;Eatlpn,  ^relations 
among  levels  in  the  hieralchy^.an<f  units  in  the  organization^  and 
especially  who  in  the  organization  is  promoting  the  innovatiori  and 

,  whc*€  careers  ciight  be  positively  or  negatively  affected  by  its 
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Implemencatioa/^^nQther  faccor  of  some  ^consequence  may  be  che 
organizaclon 's  eVternal  boundary  relaclons,  i^e*,  community  pres- 
sures for  or  againsc  innovacioa  in  general  or  a  particirlar  cype  of 
innovation*  * 


In  addition  co  the  greater  complexity  of  the  decision  process  in 
arganl2ratlonal  settings,  there  is  a  second  Important  distinction 
beCveea  individual  and  organizational  adoption  decisions,  with 
signlClcanc  Implications  for  the  implementation  proces^^    In  the 
case  of  the  individual  farmer  or  doctor  studied  by  diffusion 
researjchersn  th^  individual  making  che  decision  to  adopt  an  Innova- 
tlon  was  tlie  same  individual  who  would  be  lmplement:;;tng  It,  . gover- 
ned by  the  same  forces  and  motivations*    In  the  organlziational 
.setting,  however,  it  is  mot  likely  tt\at  adoption  decisions  are  made 
b^  one  part  .of  the  organization  (its  key  decision  makers)  and 
-Implementation  responsibilities  are  carried  out  by  another  part  of 
the  organization  (the  operational  staff) •    Because  in  thfe  organiza- 
tional setting  those  who  make  the  adoptioh  decisions  are  not  the  same 
people  as  those  who  rauSt  implement  It,  and^ecause  the  decision  to 
adopt:  may  have  had  "relatively  little  to  do  with  the  attributes  of  the 
Innovation  itself  or  the  seriousness  of  che  problem  it- is^^expeoted 
to  remedy,  the  implementation  stage  of  the  Innovation  process  Is,  In 
'a  sense,  the  adoption  stage  all  over  again,  vlth^^^S^i^i^ual  Imple- 
meflters  determining  to  a  significant  degree  whether  or  not  to  use 
tbe  innovation,  and  if  so^  \iow  to  use  Itv  (i»e.  ,  In  what  form,  with 
'what  modifications,  additions,  or  deletions,  and  under  what  condi"  %^ 
tions),  '\  ' 

I 

Whereas  In  che  individual  at?o£ter  case  the  same  motivational  and  other 
forces  generally  affected  both  adoption  and  Implementation  decisions, 
in  the  ca^e  of  che  organizational  adopter,  totally  different  forces 
may  be  at  work  in  each  of  these  stages*^    In  edud^qion,  as  described 
by^  one  analyst,  adoption  decisions  arc  affected  py  the  market  forces 
(or  irore  correctly,  the  lack  of  market  pressures)^,  in  the  school  con- 
text; Impleirentatlon  decision,  however,  are  affecced  by  a  totally 
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different  set  of  forces  set  in  motion  by  the  bare^ucra,tic  ^tructure 

29 

of  schools  and  school  systems.    We  shall  elaborate  this  below  in 
subsequent  sections  of  this  chapter*    The  relevance  of  this  point 
here  is  to  take  note  of  the  fact  that  it  is  a  distinction  that  has 
iiaplicatioT^s  only  in  the  case  of  organizational'decision  making'  and 
not  in  the  case  of  adoption  and  implementation  decisions  made  by 
individuals  *  .  ' 

All  of  these  factors  make  the  process  of  innovation  adoption  and 
iirrplenenta,tion  considerably  more  complex  in  organizational  settings  > 
and  they  suggest  the  inadequacy^  of  trying  to  understand  or  facili- 
tate that  process  by  applying  diffusion  models  (such  as  the  social 
interaction  model)  from  simpler  individual-adopter  contexts* 

C,    Adoption  vs.  Implementation 

One  'of  the  most  serious  problems  resulting  from  application  ot  the 
diffusion  research  tradition  w^s  the  failure  of  research  in  this  mold 
to  distinguish  explicitly  between  the  adoption  of  innovations  by 
decision  makers  and  their  subsequent  implementation  by  operational 
personnel.    As  discussed  above*  diffusfon  researchers*  generally 
studied  the  individual-adopter  case'and  therefore  the  distinction 
had  no  significance*    However*  when  applied  to  organizational  contexts 
like  education*  where  organizational  factors  significantly  affect 
decisions  and  where  .decision  making  *is  generally  a  function  separate 
and  apart  froia  operations*  the  failure  to  take  this  distinction  into 
account  produced  results  that  were  often  misleading. 

For. instance*  taking  their  cue  from  diffusion  research  findings*  it 
seemed  reasonable  for  researchers  tf)  assume  that:  (a)  key  decision 
makers  in  school  sy^^ms  and  in  individual  schools  determined  how 
much  innovation' wouflr  take  place  in  their  classrooms*  ^nd  that  there- 
fore (b)  the  ^amount  of  innovation  in  schools  cpold  be  assessed  in^-^ 
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terms  of  the  numbers*  of  innovations  adopteS  by  school  system 
decision  Enakers.    On  the  basis  of -such  research  methods  as  surveys 

.of^school  superincendencs  or  principals,  producing  self-reports  of 

'  '      30  " 

the  innovations  adopted  by  their  schoolfe  for  use  in  classroon^,  one 

might  conclude  that  there  was  a  substantial  amount  of  innovation 

31 

going  on  in  school  s/stems  across  the  country^ 

However,  based  On  other  methods,  particularly  observation  of  class-  * 

rooms  where  ^^Kool  decision  .makers' reported  that  various  innovations 

were  being  used,  rather  different  «sults  were  obtained.    In  one 

particalariy  important  study  entitled  "Behind  the  Classroom  Boor," 

researchers  found  that  few  if  ariy  of  these  innovations  could  be       ,  j 

found  in  practice,  that  in  fact  during  implementation  the  "new"  became 

alnost  unrecognizable  from  the  "old,"  and  little  real  change  could 
32 

be  detected.       In  several  other  studies,  researchers  explored  why 

and  hov  innovations  were  emasculated  into  "more  of  the  same"  old  thing 

33 

teachers  had  been  doing  before* 

In  subsequent  sections  ^f  this  chapiter  we  shall  co|isider  this  litera-^- 
ture  in  some  detail,  and  especially  the  various  mo^rfvaSTfc<^ial  and  ' 
technical  factors  uncovered  in  these  studies  to  explain  vhy  attd  how 
adopted  innovations  are  so  often  nojt  implemented       any  meaningful  way* 
What  must  be  underscored  here  is  the  significance  of  the  previously 
overlooked  distinction  between  the  adoption  and  implementation  stages, 
a  distinction  which  is  currently  receiving  a  good  deal  of  attention, 
Only  when  this  distinction  is  recognized  can  one  make  sense  out  of 
what  otherwise  appears  to  bs  inconsistent  findings  from  research  point- 
ing to  both;  (a)  a  substantial  aniount  o£  innovation  as  measured  by; 
adoption  decisions,  and  (b)  relatively  little  innovation  as  measured  by 
implementation.    By  focusing  their  attention  on  the  adaptixj'n  stage, 

and  essentially  ending  their  analyses  at  the  point  of  adoption,  dif- 

■ 

fusion  researchers  developed  "paradigms  that  were  iViadequate  for  tak^-^S 

■i 


into  account  what^happened  to  innovations  during  implementation  in 
settings  like  schools*    The  earlier  analyses  failed  to  give  adequate 
weight  to  the  fact  that  adoption  and  implementation  were  ts^o  totally 
different  stages  of  the  innovation  pr6cess>  carried  put  by  different 
peopl,e>  driven  by  different  motivating  f  orces  >  facing  different, 
kinds  of  obstacles>  entailing  different  sorts  of  tasks  and  activities. 
And  most  important  of  all>  different  forces  affecte'd  the  outcomes 
of  each.    Clearly^  then>  the  di>s*tinction  is  an  important  one  for 
understanding  innovation  in  the  educational  context. 

D.    Adoption  vs.  Adapcation 

The  literature  on  the  R&D  mode  of  iniproving  education  gives  na^hiot 
^of  the  fjact  that  school  systems  mighrt  substantially  adapt,  and  change 

the  outputs  produced  by  specialised ^development  organizations  external 

to  school  systems**  The'  sense  one  gets  from  tais  literature  is  th^t 
'development  specialists  would  develop  packages  of  programs  and/or 

materials>  which  would  then  be  adopted  by  school  systems*  who  would 

i 

then  install  and  use  the  programs  and  materials  ^  developed*  Given 
the  emphaj&s  the  R&D  model  placed  on  obtaining  prespecif ied  >  replica- 
able  results>  this , constancy  of  the  developed  package  seemed  essential* 

fiowe.ver>  once  attention  came  to  be  focused  on  implementation  and 
utilization  withfin  school  systems  —  both  by  R&D  specialises  external 
to' school  systems  and  by  advocates  of  other>  int^emal  approaches  tb 
school  system  self-improvement  —  the  naivete  of  this  earlier  thinking 
became  apparent.    It  became  increasingly  clear  that:  (a)  there  were 
few  if  any  innovations  in  the  education,  context  that  could  ever^be 
truly  **teacher-proof      (b)  that  there  was  an  inevitable  degree  of 
reactiveness  between  Innovation*  and  user  (both  the  teacher  as  itnmediate 
user  and  the  student  as  end  user);  (c)  that  the  teacher  (and/or  admini- 
strator) was' an  integral  part  of  the' delivery  system  of  most  educa" 
tional  innovations;  (d)  that  no  matter  what  developers  tried  to  do  to 
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affect  the  implementation  process  a  certain  amount  of  local  adapta- 
^tion  was  inevitable*  and  (e)  that  a  certain  amount  of  mutual  adapta- 
tion between  ah  innovation  and  tjie  adopting  school  system  was  not 
only  inevitable  but  even  desirabUt  for  otherwise  it  was  not  likely 

35 

^hat  the  innovation  would  have  genuine  impact  on  the  school  system- 

* 

Once  the  distinction  between  adoption  and  adaptation  is  rfecognizedj 
along  with  the  virtual  in,evit^ility  of  adaptation  in  the  educational 
context  >  it  becomes  necessar^^o  consider  the  incredible  complexity 
applying  the  external  R&D  mo^e  under  these  conditions.    What  is  the 
nature  of  the  development  process  when  the^prograD  or  package  pro- 
duced is  going  to  be  adapted  and  used  in  unknown  ways?    What  is  the 
end  point  of  the  exteVnal  developer's  role  in  this  process?    Is  it 
earlier  than  in  the  extejn^l  R&D  mode  as  this  is  generally  conceived 
and  carried  out  ^o  date?/For  instance^  does- it  mean  a  short-circuit- 
ing of  much  of  the  revising^  testings  and  revising  in  "successive 
approximations"  to  prespecified  outcomes  which  is  the  essence  of  the 
R£cD  mode?    Or  does  it  mean  that  the  end  point  of  the  developer's  role 
must  comelate*r>  with  the  developer  integrally  involved  in  the  adapta- 
tion/iEtiplemeritation  process?    Or  might  there  be  some  combination  of 
both  short-circuiting  the  cyclical' pre-testing  and  yet.  also  getting 
heavily  involved  in  the  adaptation  process?    What  kinds  of  involve^ 
ment  might  developers  have'in  this  adaptation  process^  and  what  kinds 
of  staffing  and  organizational  arrangements  might  be  required?  What 
kinds  of  staffing^  organizational  arrangements >  anA'other  supports 
might  be  created  within  school  systems  to  facilijAte  this  adap^iation 
■process?    W^at  sorts  of  specialized  intermediary  origanizations. might 
assist  in  the  adaptation  process  and  how,  might  they  be  linked  to  > 
developers  and  to  users?  *^  . 

What  is  the  entry  point  of  the  teacher/user  in  this  process?    Is  it 
earlier  than  has  generally  been  the  case  in  the  external  R&D  mode^ 
perhaps  at  even  the  idea  conception  stage  or  at  least  throughout  the 
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design  process?       Or  does  the  practitioner  enter  the  process  when 
'a  package  developed  to  some  degree  or  other  is  available  £or  adapta- 
tion and  use?  *  ^ 


In  evaluating  the  outcomes  of  a  given  innovation  adapted  and  used  in 
a  large  variety  o£  ways,  how  do^s  one  define  and  measure  the  "treat- 
ment'*  in  a  way  that  is  ^neaningful  and  useful  across  sites?  'Is  that 
even  possible?    And  even  if  possible,  is  it  desirable?    And  under 
such  widely  varying  adaptation  and  implementation  conditions,  x^h^t 
research  approaches  will  be  reqt^ired  to  adequately  measure  "effects" 
This  becomes  a  matter  of  sorae  difficulty  wheci  adaptation  is  to  occur 
since  the  researcher  must  attempt ^to  assess  both  (a)  those  effects 
that  are  anticipated  by  the  innovation's  developers,  and  (b)  others 
that  are  unanticipated  and  theref^ore  unknown  yet  may  turn  but  to  be 
more  important  thao  those  the  original  developers  hoped  to  achieve. 


Th^se  questions  are  a  mere  sanpling,  of  the  array  of  questions  that 
arise  when  one  begins  to  think  about  the  needed  reconceptualization 
of  the  RSD  mode  once^  substantial  mutual  adaptation  is  taken  as  a 
^'given,"    We  now  seqm  to  be  at  the  point  of  having  tecognize^  some 
of  these  problems.    However,  we  are  not  yet  at  the  point  of  leaving 
arrived  at  satisfactory  answers. 


The  adaptation  concept^has  been  explored  most  fully  in  the  Rand 
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Change  Agent  Study.        The  Rand  team  analyzed  implementation  in 
terms  of  the  "interplay"  between  an  innovation  and  the -institution- 
al  setting  where  it  is  installed  and  used.    The  interplay,  where  it 
exists,  cotisists  of  adaptation  of  the  innovation  to  the  institution, 
or  the  institution  to  the  innovation,  or  both.    IJhere  there  is  no 
interplay,  the  Rand  team  suggests,  there^  is  no  ^^slX  implementation. 


As  shown  graphically  below,  the  Rand  team  described  four  implemen- 
ti^tion  patterns  uncovered^  in  their  research.    The  patterns  differ 


iO::r. 


In  the  degree  o£  institutional  adaptation  and  project  adaptation 
during  implementation,  '  * 

Institutional  Adaption  ^  *  ' 

High 


Technological  Mutual 
Project  Learning        *  Adaptation  P/pject 

Adaptation      ^  ^   ^  Adaptation 

Low  Non-  High 

Imolep^^ntatlon  Cooptation 

Institutional  Adaptation 
Low 

The  tern  "technological  learning"  is  used  to  describe  what  gener- 
ally happens  in  the  case  of  technological  innovations*  and  what 
was  expected  to  happen  when  the  external  R&D  mode  was  thought  of 
in  terms  o£  producing  "teacher  proof"  programs  arid  materials- 
Those  >rho  are  using  the  innovation  adapt  to  it>  but  the  innovation*, 
itself,  remains  standard,  *  Regardless  of  variations  in  ttke  settings 
where  it  is  implemented>  the  innoyation  remains  unchanged  frotn  what 
it  looked  like  when  it 'left  |^e  Mnds  of  the  designers  who  devel- 
oped and  tested  it,  . 

In  the  case  of  "rion-iinplementation^  ^'  there  is  little  if  any 
adaptation  di^9<rirnable  in  either  the  innovation  or  the  setting.. 
The  innovation  has  been  emasculated  inta  "more  of  the  same  old 
thing>"  implemented  only  symbolically*  with  little  oljservable 
difference  between  the  *'new''  and  the  "old*'  that  it  wa^  supposed  to 
replace,  "  .  - 


The  term  "cooptation'^  is  used  to  describe  the  one-sided  adaptation 
situation  where  the  project  is  fitted  and  adapted  to  the  setting. 
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wi^tljouc  any^hange  in  the  practices  or 'behaviors  of  those 
implenentirig  it* 


In  the  case  of  ^'mutual  adaptation,"  the^roject  and  «etting^ adapt 
to  each  <3^ei>;    Tke  advantages  of  ^^^^JfMjf^^  adafTtatioi^mode  are 
underscoifM  particularly  well  by  the  Ratilt-^^eam's  discussion  of 
Hhat  goes  wrong       thh  other  patterns^ 


( 


Central  planners  often  assjime  dia^  innovation  i^s 
'    characterized  by  the  fir5t*implelIle^^.^^at^o^l  ^atte^, 
technological  leai^ping,    Thay  assLLine  that  people  can* 
learn  feo^use  new  machinery*    But  this  analogy"  is 
'   deceptive.  ^Th^  typ^  of  individual  lear^iing  that  ' 
occur^  in  the  machine  situation^primarily  requires* 
the  mastery  of  ne?W  cognitive,  skltl^s  and  activities^ 
'taosf  importantly,  such-  learning"  is  a  routine  and 
^    legitimat^Sextension  of.  the,  job*    Tn  contrast> 
significant  educational  change  requires  new  rol^ 
relatiqnships  and  new  ways  of  seeing  oneself  in  ^ 
relationship  to  others  &nd  to  the  job-  Internal- 
izing these  new  relationships  is  not  simply,  a  routine 
extension  of  the  teaching  job*    Iflor'do  ^individual 
""'teachers  always  believe  that  these  required  changes 
,are  legitimate.     In  short>  they-need  t;0  be  "motivated^ 
to  change  their  traditional  behayiorl 

I  "  ■  .      '      '  • 

It  is  convenient  to  think  of  %hree  mot;ivAtions  or  |^ 
reasons  why  teachers  might  be  willing  to^'change- 
First,  ^they*mijght       complying* with  an  order*  V^r 
our«^anlaysiS  of- the  Change  Agent  innovat^^Jj^  suggests 
thatr  when  people"  simply  "comply,/'  they  generally  do  ^so 
in  a  pro  fojrm  or  symbolic  way-  ithat  resulj^  in  noil-**  " 
^   "implementation-,  ^     ,  ^  ^  ^ 

Se^:ond^  Jj^iachers  might  be  wiHiiig  to  change  their 

traditi^fl^l  behavior*  if  *€^^lch  beJiOTior"  is  in  trh^ii^ 

^tj^mi  serf-^interest,  narrowly  defined.    That  is,  they'  ■ 

'   ^^SSSi^hi  be  willing  to  follow  a  plan  -if  they  .received 

'    ^^^^cVtiLves  ftfr  doing  so.    Vet  oUr^analy^is  indicates 

' sUcii  ■  incentives  as  career  advancement  or  extra 

£^  '    p5y*  wejre  Either  itjpff  ectiva^or,  in  the  absence  of 

other  inocivations,  led  teachelfe'and  admj^nisttators 
  ,  ,  ^:  _ 

•  ■  •■  ■,.  
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to  coopt  the  proposed  change  to  fit  their  traditional 
*  I 

\  \  M 

Only  tJ^' third  type  of  motiYationJ  belief  in  the'-^value 
of.  th^ new  .pT^actice^  seetfted  to  be  *ef f eotive  in  enabling 
people  to  devote  themselves  to  thet  "usually  ^.painful 
process  of  change.    This  belief  in  the  value  of  the 
new  practice  often  required  that  project  people  develop 
a  sense  of . "ownership"  about  the  proposed  change  and  ■ 
that  they  participate  in  planning  and  Everyday  decisions 
about  implementation.      ..they  could  do  so  by  adapting 
.  the^original  project  plans  to  their  own  needs  as  they 
simjultaneously  adapted- their  behavior.  ^ 

In  sum,,  whether  or'not  mutual  adaptibn  was  an  "efficient" 
*        process,  it  was  characteristic  of  the  i^nplementation  o£ 

projects  that  did,  in  reality*  result  in  significai^t 
^       change  in  teacher,  behavloi>»    ^'  * 

This  ^'o^ershiptV  'through  mutual  adap^tion  may  be  the  needed 
ans^wer  to  the  3^fl-too-f amiliar  **not  Invented  here**  syndrome 
commonly  foundP^^n  educational  settings.    If  practitioners  are  able 
to  ad^pt  .externally  developed,  outputs  into  p^grams  or  produpts  that 
they*  accept 'as-- "their  own,'"'some  of  the  significant  barriers  ^>to  ^ 
■acceptance  of  Externally  developed  dut^ts  may  b&  overcome  along 
with  soi^e  of  the  technical  problems  encountered  in  trying  to  imple- 
i^nt  approaches,  developed  by  others  and  described  in  .th^r  own    ^.  . 
(rather  than  the  practitioner ^s  own)  terms-  -  '    v-  ' 


If  one  accepts*'^his  position,  then  it  open^  up  a  new  research. 

areaiJIAd  a  larfee  number  of  important  questions  oci  trhich  ther 

It  ^  *  *  - 

diffusion  research  tradition  sheds  little  if  any  light.    The  Raad 

stuciy  underscored  the  complexity  of  the  ipplefnentation  protess,  and 

suggested  hovr  little  is  known'  at  this  time  ab^^ut  the  ^interactions 

that  define  the  mutual  adaptation  pattern  —  Xi7hich  factors  and  x^hich 

interdictions  are  most  significant>  what  outcomes  are  most  likely,  ' 

and^how  this  mode  can  be  facilitated-  >  , 


.-^  *  ^    * 


/ 


r-        •  1064 


Of  particular  importirice,  the  Rand  study  and  the  adaptation 
entphasis  suggest  a  need  to  focus  a  considerable  amount  of  attention 
on  the  institutional  setting  (and  'facilitating  its  adaptiveness  .and 
receptivity  to  change)  and  impl^tnentatiorr  processes ,    Thro^ughout  ^ 
the  peri'od  of  large  scale  federal  involvement  in  educational  ^ 
improvement,  most  of  the  concern  has  been  focused  on  (and  most  of 
the  investment  has  been  nad^  in  the  innovations  tftet  were  expected  ^ 
to  radically  transform  the  schools*    Only  within  the  last  four  to 
five  years  has  federal  educational 'innovation  policy  seomed  to  give" 
cognizance  to  thi±  significance  ofes^e  institutional  setting  and  the 
,  implenentation  pr^ess"  in  determining  the  success  of  these  innova- 
tions-   One  key  finding  of  the  Rat\d  study  was  that  the  attributes 
of  the  innovations  theiAselves  *were  the  Least  important  factors  in 

^explaining  why  some  progracms  succeeded  and  others  failed.    Of  f^r 
*  -  .  \ 

gre^ep^;signif  icance  were  the  receptivity  of  ^  the  ins^tutional 
Tsettin^  JETid  the  impUenifentation  S4:^rat^egi^s  employed- 


E.     Implementation  ^s>  Utilization/ Institutionalization 


lemen£at 
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As  we  noted  earlier  in  this  chaptei^>  technically,  the  iraplenienta- 
^  tion  stage  af  the  ^innovation  process  is  defined  as  inclu*dlng  only  - 

*  the  initial  installation,  testing  and  debugging  of\^  innovation 

in  a  given  setting.    The  lon^er-t^rm  acceptance  and  use  of  the 
innovation  as  "routine'*  is  defined  as  the  utilizat^^on  phase  of  the 
innovation  process-  ^  '         '  , 

While  this  distinction  is  generally  ackncwledged  and  i^  nothing  h 
nev  in  the  innovation  litarat-jr^,' exalnin-^^tion  of  what  has  happened 
\  .  to  innovations  oyer  tfie  long  term  suggests  the  need  to  underscore 
the  distinction*  For  a  variety  Vf  reasons,  relatively  few  innova^ 
tib^  are  successfully  ^institutioaaXi^ed  and  maintained.  Clearly, 
a  part  vof  the?  explanattion  liesi^n  failures  during- the-'^lraplenienta- 
tion  stage-    But  even  if  we  restri<fted  our  attention  to  only  those 
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fca^t  were  consid^rad  successfully  implemented,  we  would  firfd  a 
surprisingly  small  number  continuing  in  operation  as  established 
practice    Thus,  relatively  few  of  the  innovacioas  in  which 
investment4  were  made  can  be  cbnsidered  to  have  haH  any  more  than 
fleeting  impatt  on  school  practice*    Consequently,  there  seems  to 
b^^od  reason  to  question  the  wisdom  of  the  initial  investraenc  in 
the  first  place* 


What  has  be^n  lacking,  in  part,  is  "downstream"  thinking  that  takes 
requirements  of  the  institucionalization  phase  into  accpufit  through- 
^iTf  the  process  of  innovation  design,  development,  packaging,  etc/ 
One  obvious,.  all-too-oSten  overlooked  factor  affecting  institution- 
alization and  continuation  in  this  age  of  tight  education  budgets  is 
money.     Innovations  in  education  tend  to  be  more  costly  than  the 
practices  they  replace,  and  most  school  systems  lack  the  ^unds. 
Federal  funding  policies  have  often  entailed  providing  "seed  money"  ^ 
for  an  "initial  three  to  five  year  period,  using  th^  availability  of 

funds  as  an  lacentive  for  schbol^sy stems  to*adopt  and  implement  a 

/  ■  . 

costly  innovation  they  would  otherwise  be  tinable  to  consider. 

However,  after  this  "soft  fun^^ing'*  ends,  the  school  system  is  left 
with  the  choice  of  either  eliminating  the  program  or  paying  for  its 
cbntinuation  out  of  its  pwn  gyneral  operating  budget,  O^eraf'ing 


budgets  these  days  have  tended,  to  be  cut  back  so  far  that  continy- 
ation  is  rnot  a  viable  <jjxtion.-  This  problem  is  an  especially  serious' 
one  for  .school  systems  that  have  adot>ted  radical  innovations  re*y 
quiring'a  tot|^  revanj^ing  of  school  structures,  adm'^n^^ttrati^fe' 


artangemenfs,  and  the  like.    The  scHool  systeirt  deciding  that  it 
lack*?  the*' internal  funds  to^^cohtlnue  supoprtlng  the  innov^tlpn 
must  now  bear  on  i,ts  own  the  heavy  costs  af  ■  i^eturning  to  old 
^practices,  approaches,  ^ or  arrangements  the  innovation^  prevyou'Siy 
repldce^f  *  Experience  -of  familiatitv^lth  such  ^'spft  funding" 
cata^ttrc^ffi^,  flteke;S  School  systems  even  more  wary  of  ■  radical  and 
co*>tly^  innovations  than  the^  might  ^Qtherwyse  be*  '^Downstream" 
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♦ 

Chinking  fro!r.  the  earliest  point  in  the  innovation's*design  and 
development  night  conceivably  have  scaled  ^own  or  restructured 
the  innovation  in  a  way  chat  might  have  avoided  or  at  least 
'  mininiized  this  problem-     Such  "downsCream" 'thinking,  howeveV>  ^ 
has  been  atypical  of  educa'tsional  R&D  and  innovation.    It  is  only 
within  the  last  -few  years  that,  serious  thought  has  been  given  to 
incorporating  the  requirements  of  the  implemetitation  phase-^in  an 
innovation's  packaging.    Consideration       the  requirements  of  the 
institutionalizat^jj^co'ntinuation  pj\ase  seeins  to  be  even  rarer. 

Mor.ey         be  one  of  the  most  serious  constraints  on' the  utilxza- 

tlon/continuatiop.  phase  that  one  beconies  aware  of  when  one  examines 

the  distinction  between  implementation  and  utilization.    But  clearly, 

it  is  not  the  only  such  factor.    The  two  stages  are.  affected  by 

rather  different  forces.     The  implementation  stage  of  innovation, 

for  instance,  is '^surrounded  by  an  aura  of  novelty  and  e;ccitetaent .    .  j 

It  generally  attracts  the  most  creative  and*  imaginative  teachers 

who  are  oriented  t^oward  new  possibilities  anH^excited  by  new  chal*- 

lenges.-     Impletaentation  efforts  generally  receiive  a  great  dearl^f 

administrative  and  external  .support,  not  just  in  the  form  of 

additional  funding,  but  also  additional  materials  and  an  abundance 

of  resource  people  to  help  fn  the  Implementation -process*  Also, 

innovations  that  are  beitig  experimented,  with  are  generally  ^.kept 

somewhat  apart  from  the  rest'of  jwhat .  cons titutes  educational  ' 

'    ^  ,  "I  ' 

^'practice"  in  a  given  classroom,  or  s'chool,  and  are/thereby  generally 
easier  to  cope  with  in  bounded.  Compartmentalized  fashion- 

*       *     *  ; 

*  Fev  if^a^y  of  these  conditions  hold  when  the  implementation  stage 
.  is  9ver  and  lt>ng-terra  institwtionalization  and  routinization  are 
*:all$d  for-    Th^  aura  of  novelty  is  gone.    The  excitement  disappears- 
^ The  approach "must , be  taught  to,  and  used  by,  a  broader  spectrum  of  - 
'£eachei?s  and  administrators.  Including  many  who  are  likely  to  be 
4es5  eiccited  by  the  challenge  of  new  approaches,  less  oriented  '        ~-  * 


r 


^oward  changing  wfTat  they  do>  and  probably  too  less  able  to*  change 

Effectively.  '  Corapircating  the  problem*  ajl  or  at' least  most  of'the 
\  '  A 

external  $japport  resources  are  likely  to  dlsappeai'  after  the 
imglemetitatit?n  phase  >  ajid  so  the  ?^arder  aad  more  demandiag^^jb^  of^' 
institutionalizing  ari  ^innovation  across  a  ^chool  or  school  district 
'-<if  that  "expansion"  kind  of  continuation  is  antici'parted)  >  and 
^pe^aps  too  affecfing  broad  practice  (and'not  just  a  compartmen- 
talized segment  of  practice)  >  mus^t  be  carried  out  with  fewer 
supports  for  the  process,  "       "  '  "    '  ' 

The  point,, need  not  be ^belabbred  further.    If  long- term  ' impact 
is  the  goal  (and  prtisumably  it  isK       must  learn  considerably 
more  than  we  know  now  about  what  affects  standardix^tionj  routi- 
ni-zati6n>  institutionalization>  and  continuation*    We  -  must  apply 
what  we  learn  to  planning  for  all  stages  of\the  innovation  process 
(including  design>  elaboration/  testing>  refij.ning>  and  packaging). 
And  >  most  significant  of*^ll>  ne^ed  utilization  supports  raust^'be. 
made  available  past  the  imple^nent^tion  .pha^e^j  for  as  long  as  re- 
quired to  insure  effective  routinization  and  institutionalization 
of  new  approaches*  J  ,  ^ 

■  ■     •  I  ■ '  ■  •  ^ 

F*    Summary:    The  Greater  Complexity  of  lnnovatlj)n  in  the  ' 

-  *■  ^ 

Educational  Conte-^t  .         ■  - 

Each  and  every  one  of  the  analytical  distinctions  thSt  we  have^ 
consi(tered  here  underscores  how  much^more  complex  the^ innovation 
process  is.  in  the  educational  confext  than  in  most  of  the  other 
c6ntextj  wh^jrs  innovarlc^fi  ha^s  b^*4n  studied.    Each  new  distinction 
weXfcave  note^i  has  introd|iced  greater  and  greater  cotaplexity*^and 
more  and  more  unknowns.    Much  of  the  diffusion  research  literatut;e 
then>  may  well  be  irrelevant,  and  e^en  misleading  for  application 
to  the  ed^ational  context. 
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Revieving  scze  of  this  material,  we  begin  vith  the  notion 
between ^technological  innovations  and  people  change  innovations. 

While  the  cass  of  technological  innovations  suggests  the  wisdom 

1     ^  -  __ 

ftH  _  T-  -      -      ,  _ 

of  focusing  On  the  ifinovation  itself  and  sstablishihg  its  effects, 
the  people  change  ^context  requires  -a  more  co^lex  approach, 
focusing  on  the  interaction  between  the  innovation  and  the 
institutional  setting  wljere  it  is  to  be  implemented  (especially 
the  peQple  who  are  to  implement  it  and  the  people  who  afe  to  be 
the  end-users  of  the  innovation,  generally  students).    We  need  to 
do  a  considerable  amount  'of  ^^"^^  research       learn  more  about  what 
factors  , in  the  Institutional  setting,  what  motivationSl  forces 
(i.e.,  willingness  to  Innovate),  and  what*  technical  factors  (i.e., 
ability  t,o  innovate)  are  most  significant  in  aff^ting  the  iiaple- 
mentatAOji  and  use  of  different  kinds  of^  innovations.  Policy 
'thinking  Tnusteitebased  on  an  understanding  of  not  siiaply  a  given 
innovation's  re^uireinents ,  but  also  the/requirements  for  effective 
ianovation-iMlenerttation  setting  interactions — a  considerably  more 
complex  body  of  understandings  that  needs  to  be  developed.  ^ 

The  individual  vs.  organizational  adc'J>tion  distinction  suggesbs  tjje 


need  to  think*  beyond  simple-»di^fusion  models  that  would^oVilnt  the 
policy  maker  toward  d^eloping  networks,  locating  gatekeepers,  and 
refining  persuasion  techniques  lilffely*to  influence  these  gate-- 
keepers.   An  understanding  of  the  .organizational  context  of 

/■ 

adoption 'decisions  in  sectors  such  as  education  requires  going 
T)eyond  this  approach  to  also  identifying  internal  and  external 
forces  that  make  organiza^-ons  more/or  less  rreceptive  to' various 
kinds  of  innovations.    This  introduces  .3  who"^  new  area  unknowns, 
and  ialls  ftjr  more  r&search  analyzitirg  'organizational  politics  and 
oirganizat ion-environment  relations.    We\will  need  to  know  consider-, 
ably  more  thai?  we  do,  now  about  these  organizational  factors  before 
we  ^ill -be  in^a-^position  to  develop  more  effective  strategics  for 
promoting  organi^zational  adoption  of  given^types.  of  innovations*^ 
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The  adoption- implementation  distinction  focuses  attention  on  all 
the  unknowns  that  enter  the  innovation  process  after  organiza- 
tional decls^on;na!cers  have  supposedly  ''adopted"  a  particular 

innovation.    U'hkt  sorts  of  changes  mu^t  occur  if  a  given  innova-- 

*.  ,  + 

tion  is  to  be  implemented  effectively?  sorts  of  motivational 

and  technical  barriers  will  have  to  be  overcome  if  these  changes 
are  to  be  made?    VJhat'  supports  are  needed  to  help  iuiplementation 
personnel  to  overcome  these  motivational  and  technical  barriers? 
While  the  "adoption**  perspective  focuses  attention  on  the  need  to 
increase  the  nunber  of  innovation  adoptions  by  decisonmakers  (and 
thc>reiore  the  need  Co  strengthen  diffusion  networks  and  j.niorT^.3- 
tion  flows  to  school  districts),  the  '*iiiiplementation'*  emphasis 
^ients  the  policy  maker  toward  implementation  supports  needed  to 
increase  Che*  likelihood  that  adopted  intimations  will  in  fact  be 
implemented,  and^will  be  implemented  effectively. 

The  ^(Kption-addipLaLiuTT  distinction  introduces  wha^'is  probably 
the  largest  area  of  unknowns.    What  sorts"  of  mutual  adaptations 
are  likely  for  ^  given  innovation?    What  sorts  of  development 
processes,  are  called  for  when  adaptation  i6  taken  as  a  given? 
What  is  the  end  point  of  the  developers'  ro^e?    What  is'the  entry 
point  of  the  teacher/pser  in  this  process?    In  what  ways  should  the 
developer  be  involved  in  the  adaptation?    \niat  supports  are  needed 
to;  strengthen  the  adaptation  process  in  the  operatonal  setting?  ■ 
Kow,  (if  at  all)  can  one  evaluate  the  effectiveness  of  an  innovation 
across  sites  if  it  is  adapted  differently  in  different  settings?'' 
Policy  thinking  from  an  '*adoption"  perspective  foiuses  attention 
^on  developing  innovation  packages  -in  a  way  that  is  most  likely  to 
encourage  and  facilitate  adoption.    The  **adaptation**  emphasis,  ^ 
however,  shifts  attention  to  changing  the  na-ture  of  *'packaging'* 
(to  ^ake  into  account  the  inevitability  of  adptation),  ti\ereby 
changing  the  nature  of  R^D;  and  allocating  needed„resources  to  the 
school  setting  where  the  adaptations  are^ going  to  be  made. 


\ 
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Finally,  the  inplementetion-utilization  distinction  focuses  ' 
attention  on  the  additional  unknoi^s"  that  enter  the  innovation 
process  after  the  implementation  phase.    IJhile  the  "implementa- 
tion'^ emphasis  suggests  that  policy  needs -to  be  developed  to 
provide  Supports  for  implementation  pr6cesses>  the  "utilization''  \^ 
orientation  underscores  the  additional  requirements  we  must  come 
to  understand  to  support  long-term  utilization.    That  will  require 
learning  how  to  overcome  the  financial>  organization>  and  other 
barriers  to  conttnuation  and  institutlonalizaton  of  innovations 
that  have  been  ir^plcmertted  successfully.    Before  we. will  be  in  a 
position  to  do  this>  we  will  need  to  develop  conside'rably  more 
ua'derstanding  than  we  have 'now  about  educational  practice  and  the 
practice  setting.    Orrly  when  we  have  accumulated  a  strong  know^ 
ledge  base  on  the  practice  setting  will  we  be  able  to  effectively  ' 
mininiee  the  problems  posed  by  Institurionalieation  of  innovations 
and  understand  .how  to  develop  and  implement  innovations  for 
ultimate  incorporation.  ^J)  ^ 

Tne  history  of  niuch  of  the  educational  innovation  attempted  In  the 
1960s  suggests  the  validity  of  soto^of  the  criticism  that  practi- 
tioners have  levelled  at  the  reformers  —  especially  that  Riany 
reformers  were  somewhat  ignorant  of ■ the  institution  and  the  ^ 
institutional  dulture  they  tried  to  chinge>  tha^  they  were  rela- 
tively naive  aboilt*  how  simply  change  could  be  brought  about,  and 
that  they  were  all  too  easily  stymied  and  overwhelmed  by  the 
complexities  of  the  system's  operational  ii'eal^ty  once,  they  made 
the  attempt  to  get  involvad  anB  to^  try  to.  implement  their  pet 
pr^oposaLs  for  fundasieatsl  system  reform,    Perhaps  with  ^  more  # 
complex  understanding  of  that  reality,*  and  greater  skill  in  design- 


ing and  implemehting'^policies  that  take  that  complexlt^^into  account, 
there  may  be  si 
in^the  future. 




there  may  be  stronger  chances  for.  educational  improvement  some  time 


i  0:w 
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2-    The  Educational  Setting  '  ^ 

Clearly>  given  the  key  role  of^the  instituCional  setting  and  its 

receptiveness  to  innovation  in  explaining  implementation  outcones>  it 

* 

is  critical  for  analysts  and  policymakers  concerned  with"  this  subject 
to  have  a  very,  good  understanidng  of  the  school  setting>  its  culture> 
the  barriers  to  innovation^  and  the  oppo^^nities  that  a^re  there  to, 
be  capitalized  on  to  facilitate  innovation*    ThiSj  then>  seems  to  be^ 
a  good  point  to  digress  and  take  a  detailed  look  at  that  setting. 

Btif ore  b^i^iir.r.ingj  hoyever>  we  should  point  out  that  we  bnve  had  sore 
problenis  trying  to  reconcile  oar  understanding  of  the  literature  with 
our  sense  of  the  operational  reality  of  classrooTns>  schoolSj  and  school 
systems*    Our  difficulties  revolve  around ^ two  orientations  "  perhaps > 
one  might  ev^n  say  >  **biases"  —  in  the  literature.  ' 

* 

* 

First >  there  is  the  orientation  in_  the  literature  toward  radical  rather 
than  Incremental  change  —  this>  despite  the  fact  that  the  overwhelming 
majority  of  instances  of  schools  adopting  something  new  to  bring  about 
one  or  another  kind;o,f  iinprovement  are  examples  of  incremental  change. 
The  focus  on  radical  change  may  he  too  simplistic  fori  the  educational 
codtextj  and  we  may  need  to  think  about  the  broadet^  range  of  change 
forms  in  designing  policies  to  facilitate  improvement  in  this  rather 
complex  context- 

Second  is  the  emphasis  in  the  literature  on  barriers  to  change> 
supported  b:*  sociological  analyses  of  schools  as  bureaucratic  structures 
relatively  free  of  market  forqes>  staffed  by  quasl-professionals  whose 
solution  to  conflicting  pressures  is  to  resist  innovation.  The  diffi- 
culty we  have  with  this  literature  is  not  that  we  suspect  its  validity 
as  descriptive  material, \  Rather>  we  Sense  that>  though  it  Is  fascina- 
Cing  material  that  needs  to  be  apsorb$d  an6  incorporarted  in  policy 
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thinking,  chc  points  have  been  too  well  made^  and  that  the  other  si^e 
of  the  coin  needs  to  be  equally  well  described  and  understood*    Host  oi 
the  forces  described  in* that  literature  affect  all  schools^  and  yet 
some  of  these  schools  are  highly  innovative  and  some^are  not*  Therefoi?e> 
we  suspect  that  as  a  guide  to  policy  development^  this  litera'ture  can 
be  misleading  —  suggesting  policy  investments  in  directions  we  be] 


to  be  relatively  unnecessary^  and  falt^jing  to  point  toward  the  directions 
we  believe  niore  critical  for  policy  development* 


Lec  us  explore  chese  two  iss^je^  Tnore  fully* 


A.     Radical  vs*  InCre:?j&ntal  Change 

The  Dost  basic  question  to  be  clarified  before  developing  policy 
on  educational  innovation  and  change  inust  be  how  we  are  defining 
"change-"    How  novel  or  in^vative  must  a  given  program  or  package 
(or  whatever)  ^e  to  the  given  school  system?    Must  it 'require  radi- 
cal restructuring?    Or  will  the  simply  addition  of  something  not 
used  before  in  that  school  o^  school  system  qualify  as  "change" 
under  the  definition  used?  ^ 

Most  of  the  literature  has  be^n  written  by  people  whose*  primary 
interest  and  focus  is  on  "change"  and  fnnovation-"  .Though  defined 
differently  implt^citly  or  explicitly  in  different  pieces^  the  sens^ 
one  gets  is  that  what  is  of  real  interest  is  radical  change>  t.e-> 
programs  or  policies  that  require  radical  rethinking  of  fundamental 
assumptions^  restructuring  of  fundamental  relationships  among 
teachers,  students^  ad:ninistrators >  the  community >  etc*>  and/or 
using  £undamentall}t^ew  approaches  to  instruction* 


Cle^irly,  if  one  were  to  iinalyze  all  the  prograirt3>  "appi?oaches^ 
materials  pack&$es^  etc.  that>  have  been  adoptied  and 
s/stci-ns  over  the'  years>  even  over  the  past  two  to  three  change- 


>pi?oaches^( 
used  by  schaeJr 
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oriented  decades>  the  overwhelming:  majority  would  clearly  fall 
into  the  increic^ntal  category- 

There  have>  of  course>  been  radical  changes  that  have  found  their 

way  into  large  numbers  of  school  systems.    Several  examples  come 

immediately  to  mind, —  the  "ungraded"  classroom>  "team  teaching>" 

the  "new  mathj"  the  "open  classroom>"  and  InAvidualized  instruc- 

^  * 
tiotial  systems  such  as  IPI  (Individually  Prescribed  Instruction)  or 

IGE  (Individually,  Guided  Education),    But  clearly  >  these  examples 

represent  a  small  Segment  of  the  total  universe  of  "school  improve- 

mentsi"  one  might  want  to  understand  as  a  basis  for  policy  develop- 

ment  for  facilitating  the  improvement  of  educational  practice. 

The  radical  change  cases  are  important  and  we  need  to  understand 
how  to  facilitate  this  kind  of  cha^nge  when  it  is  called  for,  v  gyt 
they  also  need  to  be  understood  as  atypical  —  atypical  in  that  they 
represent  so  few  of  all  fthe  changes  that  have  been  adopted>  and 
a,typical*irf  how  they  came  to  be  adopted*    The  ^implications  for 
the  implementation  process  are  significant,    Generally>  these  radical 
changes  came  into  being  either  because  they  were  imposed  from  outside 
or  in  "top^  down"  fashion>  or  more  often  because  the  school  lea^der- 
ship  in  a  given  area  were  excited  by  the  nev;  concepts  or  the  new 
possibilities  they  seemed  to  represents    V,'hat  is  importWt  is  that 
the  changes  were  not  necessarily  responses  to  needs  or  problems 
identified  by 'those  responsible  for  their, implementation* 


Much  more  typical  may  be  tBe  Aore  incremental  type  of  change  that 

J 

gets  t^be  adopted  as  a  result  o£  school  people  searching  Ground 
for  n^Hfcrograms  and/or  materi3ls>  *new^teachj,ng  aethQjcls>  etcc  to 
mefet  felt  needs  or  to  solve  identified  problems.    In  soma  cases, 
this  is  a  response  to  court  mandates  or  legislation  — for  'instfflfee> 
the  need  to  mainstream  handicapped  youngsters  into  regular  class-^ 
voo^Sy  or  to  establish  bilingual  programs  in  districts  vith  large 
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non-English-speaking  populatjlons.    But  in  many  other  cases,  it 
is  simply  the  educator  functioning  as  a  pfoEessional ,  searching 
for  additional  materials  to  use  or  better  ways  to  do  things. 
Most  of  the  new  materials  or  programs  they  find  and  adopt  are  of 
the  incremental  type*  "  They  tend  not  to*  require -radical  changes  . 
in  school  structure,  procedures,  or  practices.    They  are  accepted 
because  the  teacher  or  the  principal  or  the  superintendent  or  the ^ 
school  board  is  persuaded  that  they  ar^j  called  for,  to  meet  a  new 
need,  or  because  they  seem  to  be  better  than  what  is  already  in 
use  to  meet  an  old  need. 

♦ 

The  t\i7o  appraqches  to  change  —  the  radical  appraoch  assumed  in  K 
the  literature  and  the  ^incremental  type  more  typical  of  the  s.chool 
reality  —  reflect  different  assumptions^  about  wha't,  if  any^ing, 
is  wrong,  and  whad  kind  of  "new*'  something  may  be  needed  to  remedy" 
the  situation,         the  "innowa-Lion**  or  radical  change  focus,  the 
basic  assumptions  are  that:     (a)  the  problems  in  schools  are 
traceable  to  the  fact  that/things  are  being  done,  in  schools  in 
fundamentally  wrong  ways,/and  (b)  significant  improveinent  in  schools 
wi'iAjriherefore  reqJJire  a  radical  restructuring' of  l^ic  structures, 
^relationships ,  a'ssumptidrHs ,  approaches,  etc*  —  the  kind  of  ra^fical 
change  that  challenges  flindamentai  assumptions,  runs  coi^ter  ti>V 
established  practices,  and  entails  unlearning  old  techniques,  | 
tehavioiv^^nd  patterns  of  thinking  as  well  as  learning  the  new* 
What  is  required,  then>  is  a  tAtal ^revamping  — ,a  throwing  out  of 
"the  old"  and  a  starting  all  i:>ver  again  with  "the  new*"    \^rhil€  few 
explicitly  acknowledge  this,  there  is  a  strong  undercurrent  in  this 
literature*  th;jt  /'change"  means  "better;"  the- old  is  suspect  and  the 
.new  is  applauded  * 

.  ♦    ^  ^  .  t 

School  people' tend  to  approach  change  with  a  gr^eat  deal  more  caution 
even  skepticism.    This  attitude  is^  not  s^impfy  a  reflection  of 
sociological  factors  in  schools  thaj:  create  barriers  and  resistance 
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to  change.-  Ic  is,  to  a  substantial  de^ee,  a  reflection  of  the'^ 
historical  reality  of  change  in  the  educational  context*  Faddish- 
ness  has  been  common  in  education.    Educators  have  been  burned 
badl;^*  by  one  fad  after  another  that  has  Been  hailed  as  the  solu- 
tion to  one  or  another  problem*  only  to  fail*  and  often  *fail  in 
wor^e  ond  rnore  costly  wa^^  than  the  program  or  practice  it  replaced 

This  cautiouSj  coijse^ivative  approach  to  ch^ge  is  also  in  part 
trac^eable  to  the  fact  "that  school  people  geoQrally^nalyze  what  ^ 
is  wrongj  and  what  needs  to  be  done  to  remedy  it>  in  ways  rather 
different  from  those  oriented  toward  radical  change-    ^Jhat  many 
school  professionals  would  say  is  probably  something  ^ike  the 
following*  The  programs-^  methods,  and  materials  they -are  using 
now  are  working  only  partially*  gor  working  only  for  some  students 
and  not  for  others,    U^nat  they  are  looking  for  are  ways  to  expand-** 
their  repertoire  to  find  approaches  or  programs  or  materials  that 
might  enable  them. to  achieve  success  uith  those  student?  who  are  ' 
currently  having  difficulty  and  who  don't  seen  to  be  helped  ade- 
qiiately  by  what  the  schools '^re  now  providing  for  them-  However* 
given  the  unfulfilled  prpmises  of^'past  fads,  they  wane  to  see 
convincing  evidence  before  the^  adopt  something  new.    They  want  to 
have  a  reasonable  degree "of  confidence  that  they  try  will  have 

some  success  with  the  failing  students*  while  also  not  having  neg- 
ative effects  on  stadents  who  are  having  success  with  what  is    '  * 
currently  in  use.    Or*  it  they  are  contemplating  using  one  approach 
_,with  one  set  of  'yoipgs^ters  and*3n0ther  approach  with  another- sett^  ^ 
(so  as  to  match  each  method  with  the  scudehts^to  whom  if^is  best 
suited)    then  they  want  ^o::.^  a3surance  that  they  'v^ill  be  given  the 
resources  required  to  make  ithat  possible  (e,g,j  mofe-'ajdes  or 
afesistancs)^  ^  %  ^ 


%  Conttcisjr  to  tSie  radical  change' p-ropbnents  who  trace  the  problems 


to 


iat,th#  school  and  school  professionals  are  dolng>"  school 

people  don't  generally  s^e,^emselve3'<e^g,\  th^lV  at titudes)- ot 

'    *  *■  \  .  -  ■  "I 

*their^instituticJnal  setting  as  the  problem*  ^'Piey  define  the  probata 

in  neither  motivational  nor  sqciological  terms ,  /Rather,  thejTsee 

'it  as  a  JLechnical  ^problem  —  i.e*>  how-to  find  the  ri^ht'^^qm'binatioh 

^of 'methods  and'  material^  to  react  students  with  scy^  dlfE'icultles, 

And  it  has  bedn  our  e^Jferience  that;  even  those -educator^  who 

,    essentially  bl'ame  ^tbos^ieind  of  ^students^*  for  their  diffioulti^sV  ' 

or  who  soHRd  as  th^'ough  'they  have  wj^tten "  them  of  f 'aa|  hop&Iess,  when 

N '       *  *  •  * 

^t>ffered^a:  pro^rani  or  appraoch  that  "sttggests  the  poss^feefclicy.of 
•   ^    %       -    ^  .  \       '  , 

^   Success  with  ^hofee  students  they  will^generally.-be  willihg^'  to  give  \ 

It  a  try,  .    *^  *     '     ,  t  *  ■      /    \  " 

When  the  probieni  is  defined  in  these  technical' t^rms  >  the 
5dopJrft>n  pf_^new  program  or  approach  (jan  be  viewed  as  the  solution 
"to  ^  partituTpr  pro"l)leTnj  and  trying"  the  new  becomes  acceptable  with-  , 
^out  be^g  seen  as  a  confirmation  of  the  incompetencex)f  the'  profes- 
.    'slonal  or  the  "inadeguacy  of  the  school  system  that  was  using  the  old, 
^  ■  Thu^J  defining  the  problem  in  te^ihnical^tferms.  is  compat^le  with 
iqcreinen^l  rather  than  radical  change- ^  ^ 

.  •  ■  .     ■    .  ■■■■ 

Jftat  ^1  of  |i^3  ^ggest^  is  that       may  nee<|,  to  develop  more*   '  ■ 
,    complex'ways  of  i^hinltihg^  aboug  chan'ge^f  we  are  to  d^^gn  pcJlicy  ^ 
options  tha?^  will  woVk  ii?  real  schoC^ls,    It  may  be  thac  we  will  need 


^  one  k^nd  "of  policy  thlnkir^g  when  radical-  changes  are  at  issue  (per- 
haps  here  the  'Wtual  ^^daptat ion"  notion  is^useful),  and  a  Somewhat 
\  aif^rent  kind*  of 'thtfikittg  vh^n  the  morp  Cypicalj  increm^tal  sortsv 
■"of  changes  ^are  uncier  consider^ion  T'absorp-tioh  *and  use'I  may  be 
mWc  -afSpropriate,  than  "mut^l  adap Jlition**  when  irvcrementai  ^change 
is  invS^W),     .         ^     ■         *         *      /'  ^  ^' 
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^nd  perhapSj  we  maj'  ne^d  to  think*  Uppj-^ri  terms  of  a  third> 
,      *  *  intermediate  case,  involving  changes  o^  a  generally  iacrernental-  * 

sor.t  that  mey^lso  challenge  some  .assumptions  held       school  people 
but  less  fundamental  ones  than  thos&  inherent  in  Che  "o'peru  class- 
^  room"  concept  (e.-g.;  t*he  offering  of  bilingual  education  programs 

^'  — or  mains treaming  handicapped  students  into  regular  clas&rqoms) T 

•      ■  .  •  t,  • 

.     <  .    .It  m^y  be  that  we  havedfeotten  ourselves  into  a  definitional  b.ox- 

ByM^ifining  innovation  in  the  radical  sense>  "innovaftion"  orie,ated  ■ 

If    '  , 

^  ■  .        analysts  are  able  to  conclude  that  there  'fs  relatively  little 

innovation  in  schools  >  or  tha^t  change  occurs  at  a  ^'glaciaj^^^l^e 
t  ^      *  li/hen  innovation  is  defined  fET^he  incremental  sense>  a  rather  dif- 

feisent  conclusion  becomes  possible.    Does  the  focus  on-  radical        ^  ^ 
'  gjiange>  oat  ^f  an  interest  in  one  or  another  chang^^  theory>  function 

as  a  set*^o£  .blinders  that  prevefltas  us  from  ade<luately  understanding 
J  the  operational  reality  of  the  e4ucational  contex't>  and  therefore 

*  from -thinking,  in  terms  that  are  useful  for  guiding  , us  ^tdUard  viable 


^policy  options  tha^  will  work  in  reaj.  "schools? 


Y  Although  there  ate  some  dif  fi^uities  with  ^he -"problem-solving*" 

¥  39  ^     v        ■  ' 

J  concept  when  applied  to  s,chools>      this  orientation  nay  ptovide  a  ' 

better  conce'lptual  focus  than  the^*'innovation"^  notion . "  The  advantage  * 
^  ^is  that  if  focuses  on  the  %eking  behavior  of^  the  professionals 
^rather  than  otf  the  attributes  of  the  solution>  and  therefore  elim- 
inates  concern  aVout  how  ratfically  dif ferent 'or  'neW**  the  adopted*^  *  ^ 
*  i    change  ^ay  b^r-<.  .  -  ,  ^         *  '  * 

'B*    Sociojpaical  Dgiscripti-ogg  ,of  Schooj^  Vs*  Factors  that^Bxplain 

piffejrences  BiaE>eer^  Innovative  and  t?on-Innovative  Schools  ^i^; 

There  is  a  large^  literature  that  d^scrihes  how  the  soci^  stracture> 
norms >  vaiueSj  etc.  of.  pablic  schaols  make  these  institutions  some- 
what  resistant 'tQ  ina<:>vation.    One  gets  the  sense  from-the  literature 
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that  tfie 'barriers  are  so  great  Ehat  they  tan-be  o^vercome  only  by 
^means'Oi  che  strT>ngpst  of  leaders^hi?  (a  quality  that  seems  from 
tfe^  literature  to  be  in  short  supply  among  educational^adrainistra^ 
tors) .  ,  ■  "  •  ^ 

'  Yec>  clearlyi  thei/^  aue  many  innovative  sch(?tls  and  school  districts 
across  the  country  >  and  surel/  there  must  b^*ore  to  the  explanation 
tlian  simply  the  qualities  of  their  principals  and/or  superintendents^^ 
*e  do  Jiot  mean  Xo  minimise  the  importance  of  this*  leadership  factor  > 
for  ve  kte  totaXly^^g/rsuaded  that  it  nay  in  fact*  be  the  single  most 
i7i:iort:,iat  factor./   Still,  ua  believe  the  piccut^  ^  is ,  more,  cumpltix^  S 
thiin^that,  and"  that  the  barriers  to  innovation  _d§sccibed  tn  the 
literature,  are  nowhere  near  aiS  powerful  as  fhe  literature  suggests^ 

Our  assessment  of  the  literatur^is  that  it  xs  ;aaduly  biased  toward 

th^  barriers  to  change.   -It  fails  to  ^ive  adequate  attentrioa  to 

^  ^  *  . 

other  factory  chat  oper>  MP  possibilities  for  school  improvement  that 

night  not  become  apparent  if  poli^  thinkihg  is  focused  only  on 

motivational  obstacles  to  be  overcome../         .     -  ^ 

*  ■    ■     r  "         J. '      ; .  "  _  (- 

Let  us  now  consider  thak  literatuce  and  fcKe  ways  scliools'  are  *  "^^ 

'described.    Then  we  can  return^%D  such  qu^s^/ons^as:  Tfliat  factors  , 

are  most"*^itflportant  in  distinguishing  innovative  "fr^  lion- innovative 

schoolsj  whether  the  literature  may  be  unduly  Jsiased,- what  possibil- 

ities  and  opportunities  policymakers  wight  capitaiij^  £)n  to, 

facilitate  school  impjrovement*  - 

^  1  ^ 

a-,    the  Educational  Set'ting;  Barriers  to  Chan^    u  * 

■      *     "  .     '       t    '  ,  , 

>*>  ^  .        -  *  *  .      *  ^ 

One  parcidkilarly  useful  revi^u  article  distingui'shes  between 


rc^i^larly  useful  revi^u^ar 
:s  oT  factors' in  ther  cducat 


two  sets  oT  factors' in  ther  cducatio^ial  setting*  one  sec 
aff<*cting  the^odoption  of  ^innovations  and  a  second  entirely 
different  set  of  factors  affecting  their  implementation. 




c 

We  s/hal-1  use  ttiis -'scheme  to  sutnmari^a  much  of  the  literature  '    '  - 

wep*ive»been  '$xanttning  qp  the  subjectj  conaid-ering  first  the  ^'-t' 

tt  structure  of  -tHe  sqhoal  and  the  \jay  it, affects  innova- 
tiori^aie^optioij  decisions  >  then^^^rning  to  the  burfeaucratic 
structure  of  the  school'  and  it»teffect  on  implenent:atloh  pro- 
<^ess_es-  '   -  _       •  ^    ^  ' 

i.    The  Maj^l^t  Structure  of  ?ul>lia.  Schools:  'Qie  School 

"    as  a  DoTnestica.ted  Or^anizatioS^ ^  * 

— "^^TT:  —  ;/  .  ^  -  ^  — 

^  '  ,  »  *  *  ~" 

of  the  distinctive  attribute?;  erf  public  schools  is    "  ' 
^  the.  fact'  that  they  are'not  laarketH^^iented .    Th^'are  ^  v 

protected  ot*ganizations  v^th^  a  virtual  mondpoiy  in  ^ 
^  given  locality  oh  wha.t  as  gieAeraZly  s^en  ^  providft^     ^         '  ' 
^         an  essential  service,   iThfe  degree  o£^iHifaiic  prptectioa^  '  - 

*  they  r^jeive  is  sugges  ted *^by  ^heii* 'characterization -qs      ^  - 
/'domesticated'*  orginizatidnsT^  As,  describefd  in  the    ^     /  '*  .  " 
lifar^ture,  a  domer^ij:ated- org^S4^aton  is  one  which  xs 
guaranteed  clients  ^nd  resources  regardless  of  Its:'  '       ^  " 
■     ^      'pier'formance^^    Vithf few  deceptions  Ce*g-,  ,childi;ea'Who    '*         '  *  . 
^    ^  ,    attend  private  ot  pS^gchial  s  chop  Is*  or  who  ^re  penuid^fd  -  ' '-r 

^  *    to  transfer  to  o^;her  pbblic  schools  in^  the  a^^)^  all  ' 
''students  living  within  a  partitulaij^et  qi^school '       ^       *    \  , 
district  boundaries  rau^t/^attend  th^^o^^  public ''"school*     *  ^ 
'The  student''client^' *o6  such  arU<^fg^i2atibn  is  not  frfife 
^   to  accept  or  reject  j:he,  5cfiool  *s*^ewices  and 'neither 
^        (except  in '"rare  cases)  is  'the/sfchcJpl  free  fo^accofjt  or" 
'■'^   reject*  the  student. 


er|c*  ' 
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^  The  label  of  donesticated  organization  is  used  to  - 

-  indicate  thatr  this  class  of  organization  is  ^ 
protected/ahd  cared  for  in  a  fashion  similar  to 

-'^that  of  a  dtonesticated  animal.    They  are  not 
compelled  to  atjt>nd  tt)  all  of  the  ordinary-*and- 
usual  needs  of  an  "organization.    For  exaTiipl€> 

_,):ha^-Mo  not  compete  wifih  other  organizations  for 
clients;  in  factj^a  steady  flow  of  clients  is     ^  ." 
assured.    There  is  no  struggle  for  survival  fou-, 
thiS  'tyfte  of  organization  -  existence  is  ^uara^eed. 
Though  this  type  of  ^organization  does  comp^J>e  in  a 
restricted  area  for  funds>.  funds  are  not  c]  ^ 
tie<?  to  quaii(^'  of  perfomance.    These  orgar 

^tions  arfli^TOses^icated  in  £ha  sense  that  ^they  are 
pTocect£'d\by  tiie.  society  tHe/  ^serve.    Tha  society 
si^es  Che  protection  of  these  dofhestica-ced  organic 
zac  ions  as /necessary  to  the  maintenance  of  the 
social"  systen  and  creates  laws  over  and  above  those 
applying  to'organized  action  in"general  to  care  for 
tshese  organizations.^^  *  - 


Thi^  domestication' generally  acts  against  the  innovation 
pljfrcess*    Th*re  is  no  need  to  improve  performance  (i,e*> 
to  find  ***better"  ways  of "  doing  things)  >  so  a&  to  be  able 
to  attract  either sclients  or  resources^  Consequently> 
'there  is  little  felt  need  for  change:    Instead^  one  finds 
an  oriemfation  toward  corttinuing  in  the  faEiuliaT>  ^ 
comTortSble  patterns  that  have'  characteffzed  the  or^ani'- 
nation's  functioning  in  undisturbed  harmony  with 
olji^t  environmental  forces. , 


benevo 


■     ■  ■  .  ;  * 

ii.    The  Market  Structure  of  Public  Sch6ols:  The  School 
^   .  J  

as  a  Highly  Vulnerable  Organization 

'O*         ....  .  '  ^ 


A's^  incongruous  as  it  mnv'seem  kiven  the  i^aot  that- the 
school's  existencie  and  continued  operation  ate  guaranteed 
by*thfcs  protected  s1fctus>^  th^e  school  is  also  a  highly^' 
vulnerably  organtzation>'  more"^opufi  lyp-^Xghd  subject  to) 
^dcial  and  poXiticaL  influence  than  virtually  any  othej 
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type  of  insti'tutioo  or  organization  in  our  ^society." 

For  a  variety  of  reasons,  we  have  considered  elsewhere, 
the  school       subjected  to  a  considei:aJBle  krcouhc  of  public 
scrutiny.    It  is- a  publi<f  sen«^^  organisation  supported 
by  public  funds  and^  adiiiinistered  and  regulated  by  public 
agencies.    The  school  ^f f ects  virtuall^^  all  subgroups  oi 

\the^  populatioflj  whether  as  patents,  as  citizens  and  tax- 
payers,"  or^^^usiness  people  who  require  a  lafbor  pool 

^sufficiently  educate'J  tfo  carry  out' required  tjasks.  Since 
th=  proportion  o:  -losal  lunds  s^^T^nt  on  public  educatlof^ 
tends  to  be  quit'e  high,  schools  tend  to' 'be  particularly  . 
"salient  to  taxpayers.    For  those  taxpayefs  ^vho  a^re  also 
parents  of  school-age  children >  the  level  of  concern, 
about  school  functiohing  tends  to  be  even  higher^  for 
American  soci>fey  has  been  characterized  by  tremendously 
high  expectations  for  schooling. 

The  schooi's"  vulnerabiMty  is  enhanced  by  the  diffuse- 

nessVof  educational  goa^s  and  the  difficulties  6£  measur- 

ing  educational  outcomes.       There  "is .relatively  little 
/  * 

consensus" on  the^ultimate  objectives  of  schooling*  There 

a  mulciplicicy  of  goal -^emphas^^;^o  choose  from  .and 
'conslderajjle  d^sag^ement  in  our  societS^'ab'out  which-   '  "  ' 
object'i,ves  should  be  loqpt  emphasized.    Educational  goals 
are>  -by  t^sj^  *n^t«re,  diff-use  and  highly  open  to  value- 
laden  judgrrents,  misinterpretation,  and  controversy^ 
Given  the  la-rge  number  of  often  differing  constitUencj%s 
a  given  school  district  may  serve,  .virCually  anvvsignifi- 
cant -decision  can  trigger  conflict  and  attack  by  one.  or 
anochfiF  jegment  of^the  populace.    And,  too,'  compared  to 
other  fields,  ed^ioetional  g6als  are  gotierally  harder  to 
-specify,  less  neasurable*  and^arder'to  use  as  perfornance 


j 


standairds  aga^Lnst  which  to  judge  system,  performance. 

Consecuenclv,  it  is  difficult  for  school  authorities 

CO  nake  a  strong  cai>e  for  the  effects  program  x  might 

"have^on  students  of  types       b^,  and  £■    And  since"  schools 

provjlde  only  soye  ^of  thfe  ^^ational  influences  on  p£>ople*s 

lives  (and  ciuch  research  suggests  that  noft-school  factors 

are  far  more  significaTit  ttfen  school  factors  in  affec- 

46 

ting  one's  learning  and  life-chances      it  is  difficult 


\  •  * 

^       to  assys  the  effects  of  sjwhooling  and' say  with  any 

certainty  v,"hat  the  ultimate  importance  of  any  program  or 
^   polic/^deci^ior/niight  be.  ^  * 

J' 

-'-  .  ■  ■    '  ■  . 

There  are  other  factors  that  contribute  to  tKe  organiza-^ 

^  ,   .  ,    -rlooal  :5/ulriarabliity  ,of^  schools  as  well."    Since  the  ' 

knowledge -and  tiectinology.  base  of  thefield  is  weak>  it  is 
*  often, difficult  to  provide  strong  eyidencs  that  one 

program  or  nethod  i^  tnore  effective*  than  another-  ,  Another 
iiTTportant  point  is  that-schools  are  highly  variable  in 
<iual:lty,  5Miking  deficiencies  (imagined  or  real)  all  the 
,  more  apparent  and  subject  to  public  debate. 

^  Contributing  to  Ae  vulnerability  of  th^  schoo  is  the 

f  "educator^s  legitimacy  problems  in  claiming  specialized  ^ 

expfiptise^^irud  professional  status  fa  point  <re  shall  , 

returti  to  later)    "tompared  tS'^^^i^^^tists,  engij(fers>  ■ 
,  ■      .  *  .    .  ,  ,    \  i 

"ifdoctors  o^r  Iaw^ct^t  the-speiiialtzed  training 'needed  to 
■  JiTqGjtion  as-  a"  teacher      ^s^honol  fa^tninistrator  does  riot  - 
/  '  Iseera  pa^cicula^lJfc,  awespme;.  ■  -^pd^  too,  the'pubCic  is  mo^ 

^  '  famiU?r  >rit>fV^3M^th^*'^U€ati#3p^<!^  parti-- 

^  ^  ^      '       ^    oulaiX?  fc>r,  tl}^A^?"ti:er  et^utfat-^df  ^>ar<^^  f^r  less^  ^ 

i>f .ga^VJij  t<;rev'3tit.>'xp^?kisi;^Btwqten"  tfie  general  publi 
*>nd  edun^oVs -t^n'^et^^  Drof"-  ' 


ERLC 


*',and  edun^oVs  ■t^n'^etwelt^i'^^  ^ofessionals  in 

fields  uGh  st^£t>g'5fifi6wiedge«^a'ri(3.  techhojil^g>^' bases. 
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!r,  *  Clearly, 
ilnerableUfcb 


We  need  not  belabor  the  point:  further,  *  Cleajrly,  a  host 
of|  factors  make  the  school  highly  vul 
ex^ternal  pressures. 

/ 

In  sociological  parlance,  organizatonal  vulnerability 
is  defined  as  ''tffe^^obsbl^ity  of  being  subjected  to 
pr^issures  that  are  incompatible  with  one's  goals  without 

the  capacity  to  resist.         Where  ^n -organization  is  in 

\  *  * 

'|>erf'ect  harmony  with  its  environment,  any  pressures, 

corrting  f jrom  *the  envi-ronra^^t^^jj^e  compaci^^le  with  the 

.organization's  goals         deflna*d-by  izs  professionals) 
+ 

and  Che  organizatiort  has  the  resources  needed  tc>  atttein 
'these  go^ls.    In  the  case  of  a  vulnerable  organization,  ^ 
^e~find' instead  that:   (a)  the  organization  is  subjugated 
to  its  environment  (tn  school  systems,  for  instance, 
legal  control  is  i-n  the  hands  of  lay*  boards);   (b)  there^ 
Is  often  a  significant  discrepancy 'between  the  oi*fearii- 
zation '  5 -goals  and  the  ij^oiands  scemming  from  its  environ- 
ment  (thus,  a  school's  ^taff  might  be  pressured  to*  adopt 
a*prograo  for  political  reasons  they  believe  orr  profes- 
,sional  gro^ands^to  be 'worthless) ;  and  (c)  the  organizaton' s 
resources,  are  inadequate  for  it  to  achieve  its  goals 
Ke.g.j  the  schools  are  expected  to  produce  academic 
success  for  a' wide  range  of  students  with  differing  needs 
hut  are  not  provided  with  resources  adequate'to  meeting 
all  those' needs), 

,The*school's  vulnerability  has  two  ^cinds  af  effects,  on 
JTts  adoption  oehavior.    On  the  one  hapd^  school  people 
are  likely* to  be  cautious  about  adopting  programs  or 
policies  that  are  likely  to  disturK  any  significant 
interest  group  in  their  environment*  *.The  are^  even  lik^y 
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CO  anticipace  trouble  and  reject  prpgrraHfs  they  think 
just  r;ight  disturb  some  segment  of  the  TOinnunity,  even 
in  advance  of  any  evidence  of  a  negative  public- reaction. 
Tft  effect,- then  organizational  vulnerability  creates^ 
resistance  to  change.    On  the  other  handj  'organizational 
vulnerability  increases  the  propensity ^toward  faddishness 
in  education*    If  a  given  innovation  has  been  highly 
publicized  and  received^trong  community  interest  and 
eV^n.  enthusiasm,  school  personnel  are  likely  to  be 
inclined  toward  adopting  it-,  even  in  thti  absence  of 
evaluation  djta  supporting  its-  effectiveness  (or  perh^ips 
even  despite  evaluation  data  suggesting  little  is  to  be 
ained  by  replacing  an_  established  program  with  this  new 

The  Bureaucratic^  Structure  of  Public  Schools 

Sooie  of  the'inost  fascinating  naterial  that  has  been 
written  about  schools  applies  what  is  understood  about 
the  str^ns;  inherent  in  all  'complex  organisations, 
analyzes  how  these  strains  are  manifested  in  the 
education  context  in  particular,  and  describes  what  ' 
effects  these  have  on  the-functionihg  of^  ^pchOols  and 
school  professionals-       Of  parcicalar^relevance  here 
aPe  analyses  that  focus  on  the  burcraucratic  structure 
of  the  schools',  the  tension  t^iis  creates  betwtfert  teachers' 
sfelf  images  of  being  "professionals"  and  the .  bureaucr^t- 
ic  reality  vhich  restricts  their  professional  autonomy, 

and  the  negative  efLect  this  has  in  creating  resistance 

,  -       ,  .     i50  '  ,  ,  ^ 

to . innovation .  -  . 


.      108^  ^  , 

*  -  .  t  - 

A  profession  is  characterised  by  at  least -thre^ 

i 

attributes:*  '(1)  its  members  perform  s  service  thai^'^ 

is  viewed  by  society  as  es^fential ; * (2)  the  taslos  carried 

out  t»y  professionals  are  assumed  to  coquire  a  high  ilevel 

of  technical  co^tipetence;  ani  (3)  professionals  are 

^   ■  / 

therefore  generally  given  a  substr&rvtlal  ajnount  of 

autonomy  in  performing  their  functions. 

Only  the  first  of  theses  is^'clfearly  true  of  the  teaching 
profession.    Their,  function  is^  viewed  by  society  as 
e,^sent:iil.    HDwever,  the  conipec^iiicb.  of  pcofesa^onnl 
educators  is  fre^uentrly  called  into  question,  for  all  * 
the  rsasoiis  noted  earliet4-r  ^Jecause  to  the  observing  , 
public,  the,  ^tnf;^nt  of 'specialised  expertise  required  by 
^eachiflg  seems  considerably  less  than  that  required  by  ^ 
other  professions;  and  because  education  is  a  value- 
'laden  area  ^ith  diffuse  goals>  uncleaV  technology,  and  ^ 
signific!ant  measurement  problems  .in  assessing  achieve- 
tnent  of  the  ultimate  goals  educational  institutions 
are  expected  to  atta'&i, 

y 

Even- more  to  the  point  in  weakening  the  professional 
status  of  teaching,  the  autonomy  and  professional 
discretion  of  the  classroom  j:eacher  is^  severely,  linited. 
What  subjects  will  be  taught,  in  what  ways,  using  what 
textbooks  and  instructional  materials,'  in  what  sequence, 
and  ev^  at  what  times  of  the  day  —  all  such  matters 
arc  generality  doternined  by  oth-^tSj  -by  lay  boards  of 
education  or  by  authoriclres  at  higher -levels  in  the 
bureaucratic  hierarchy.        '  ' 
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Beyond  that,  the  te§cber*s  professional  behavior  in 
relating  to  students  is  somewhat  limited  and  cas't  into 
highly  structured  patterns  by  rales  and  regulations 
elaborated  by  administrators  wlth^  a  view  towar-  efficient 
organizational  functioning  rather  than  a  concern  about 
the  quality  of  the  teachei^-student  relationship.  ^ 

At  least  part  of  the  problem  is  traceable  to  th£  nature 
of  the  school  as  a  service  organization  and,  beyond  that, 
as  a  particular  type  af  service  organization  that  has  been 
giv^n  dor33ti.:at:ed  statvs,    Sotb^nreate  condifLons  uhich  ^ 
run  counter  to  the  teacher's  exercising  broad  profession- 
al  autononiy  *  "  ♦  ,  ,  - 

First,  let  us  exaiaine  the  implications  pf  the  school 
bei[jg  a  seirvice  organization.    A  service  organization 
is  defined  as  being  one  established  to  benefit  the  client 
group,  whieh  In  this  case  would  be  the  student^,  their 
parents,  atid  the  broader  community  which  provides' the  , 
schools  with' their-support.    The  ^rior  definitiorj  of  the 
organization's  goals  iQ  this  way  tends  to  limit  the 
professional's  autonomy  and  authority-    In  any  seirvice 
organization,  professionals  are  in  a  difficult  position  ' 
legltiniating  their  authority  because  their  function  Is  . 
defined  in  terns  of  serving  the  inteifests  of  the  client  ' 
groiip,.   ^They  must  try  to  serve  those  interests  while  at 
the  sane  ^ tine  retaining  their  authority  ^nd  not^  be<^o:ning 
subservient  to  the  demands  of  the  client  group*    In  ^'  ^ 
ed^atlon,  the  situation  1^  further  complicated  by  the 
low  pres-tige  accorded  teachers  'and  school" administrators 
and  the  fact  that  their  professional  competence  is  so 
readily;i^alled  Into  question  by  laymen*    Vfiiils  ia  other 
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service  fields  such  as  medicine  the  doctor  is  assumed 
to  have  some  specialized  expertise  that  gives  him^ 
authority  to  determine  what  to  do  to  best  serve  his 
client^s,  interests,  in  education  professionals  have  to 
struggle  for  their  autonomy  to  carry  on  their  profession 
in  ways  they  believe  to  be  called  for  by  their  training 
and  expertise. 


Second,  there  ^re  the  further  implications  of  the  school 
being  a  domesticated  organization.    Because  there  is  no 
choice  in  the  r-atter  of -attending  school,  'the  student 
client  of  the  insti<;itiorr  may  no^t^be  \here  voluntarily. 
Yet  he  is  there,  very  To^ch  a  part  of  the  <irganizatiQTi  and 
its  functioning  and  very' much  able  to  disrupt  it  from 
c^irrying  out  its  taiks  *    Consequently,  student  control 
becomes  a  key'orgarrizational  concern*,    At  the^^ame  time," 
vhat  can  be  considered  acceptable  procedure^  and  mechan- 
isms for  coTiCrolling  students  is  limited  by- the  implica- 
tions, of  the  school*  being  a  service  organization  estab- 
lished to  serve  the  interests  of  the  student  and ^his 
parents, 'and  is  limited^ further  by  the  requirement  ^ox 
aocouBtability  to  parents. 

The  bureaucratic  response  to  the  tension  between  the^  t 
requirements  for  both  control  and  accountability  is  tfie 
elaboration  of  rules  and  regulations, and  the  keeping  of 
detailed  records  abouti  infractions'  of  these  rules  and, 
regulatix)ns .    The  organization  thus  protects  itself  * 
tro^  environmental  pressures  by/providlng  justification' 
for  actions  taken  and  decisions  made.  ^  J 
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However,\  the,  pric'e  paxfi  is^  farther  coippromi^iag  of  / 

the  ideal  of  prof essxonalisnj.  "  U'hereas  in  other  fields 

technical  expertise  is^ the  basis  af  the  professional's 

authority,  the  teacher  is  expected  to  use  formal  sanctions 

to  control  students;  the  basis  ^  the  teacher's  authority 

'      the  potential  for  resort-to  these  sanctions;  and  the 

focus  on  such  sanct^ions  mast  inevifcably^redace  the  service 

or;ientacion  of^eachers  (i*e.>  teachers  are  less  likely 

to  view  their  stydents  as  clients  who  they  are  there  to^ 

serve).    *^      ,  * 

«  ■ 

\  r 
*Farther:iiore>  in  other  professions  colleagial  patterns  of 

authority  prevail  —  doctors  or  lawyers,  f or 'instance>-  . 

are  accountable  foi"  their  actions  to  eaph  other  and 

*particLilarly  to  their  professional"  associations>  the 

AMA  and  the  Bar.    In  edLication>  however>  ■  teachers  are 

accountable'  to  administrators  and  to  lay  "authorities  for 

their  use  of  disciplinary,  procedures,  as  well  as  for  the 

competerice  with  which  they  p^erform  their  functions  in  ^ 

general.     Thus>  the  bureaucratic  nature  of  the  schpol  ..^ 

as  an^  organization,  and  th^  elaborate 'procedures  developed 

*to.  prot^it  the  organization  from  environmental  pressures, 

have  the  effect  of  undercutting  the  professionalism  with 

which  the  teaching  role^can  be  performed* 

The  low  prestige  of  education  is, a  matter  we  allude  to 
frequently  throughout  the  analyses  in  this  yoluiae.  ♦For 
purposes  or"  .this  discussion,  we  majf^  corisidel:  this  low 
prestige  both  a'  cause  and' a  conseqijenc^e  of "  these  factors 
we  have  been  noting.    Where  the. prestige  of  a  particular 
group  is  low,  it  becomes  easier  to  question  their^  c^ompe- ■    '  ^ 
tence  ana  to  linri^  their^utonomy  in  carrying 'out  their 


roley.    ^^nd >  Iconttnuing-  cne  vicious  circle,  when  th^^ 
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technic'^al  competence  o*f  m&hbers  of  ^  grdup  is  frequently 
called  inca  question  and  ti^eir  profes'ional  discretion 
aad*  autonomy  are  repeatedly  limited  .by  decisions  and 
actions  fcalcen  by  others*  ^he  eff-ect  is  a  furtHjer  erosdon  ^ 
o£  the  level  of-presti^e  accorded  them.'  - 


\ 


to  th^*"  ^ 
teachers' 


There  are  .various  other*  factors  th^t  .contribute 
low- prestige  of - the  teaching  profession ^and  to 
consciousness  of  tiTfeir 'position  at;*  the"  bot ton  rbng  of  the 
professional  prestige  ladder.     It  Is  a  field  whic^> 
earpeCY^3l37  in  early  childhood  and  elementary  eyducation> 
Is  cor?priked  mostly  of  women^  ;nany  of  wham  have  Limited 
professional  comnitmeut  to'tfie  f'i-eld^  ^tering  and  leaving 
at  as  this  fits  their  other,  often  more  primary^  commit-- 
ments  to  starting  and  i:aising_  their  fanttl^s^    ^ost  are* 
recruited' fron  the  middle+and  lower  middle  classes. 
Compared  to  other  professions,  teacher  recruits  are  more 
likelX"  to  c6ir>e'from  the  low^end  of  the  academic  ability 
range.    And^*mo$t  intensely -felt  of  stlly  salary  iscales  for 
teachers  have  tended  to  be  substantially  below  t[h^  of 
other  occupations  that  require  Vs' much  tralningf 

As  a*' c^^nsequence' of  all  these  factors,  tea^hing^  is  ^ 
categoNL2;ed  as  ^  ''quasi-profession/*    Thfere  i^  clearly 
a  gap  (in  fac^t  an  ^'institiutionallsred  gap"^^etween  the"  ^ 
lity  ol  teaching  i^^Mst  school  systems  in  this 
auntry-artd  the  professional  aspirations:  of  teachers.- 
The  ^most 'S^ignlficanc  ".effect  of  the  quasl^-profassionalism, 
sjs  ,<it$cribt;d  i-n  t-^^  If  L terature ,  -  is  ^status  insecure 
vk4^h  can  ^h^ve  ■  it?.portant  effects  on  organizational  climatG 
and  ir^ov^tlon.     If  this  Status  insefcjurity  is  as^impdrt^t 
a"  factor  as  s^ems  ,to  he  sbggested  by  the  literature,  ;hen 
the  foU'owing  ate  some  of  the..Vays^ -in  w!^ich  it  can  create 
resifJtance;  to  Innovation. 
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Tirstj  there  is  likely  to  be  some  resistance  to  ^ 
programs  and  policies  de'signed  to  improve  teacher 
performance.     Such  prog-rams  come  to  be  viewed  as* 
incursions  into  the,ir  professional  doTnain>  limiting 
their  auto;iomy>  and  >  even  worse>  as  proof  positive 
that  thefr  professional^  competence  is  judged  to  be 
inadequate  an  in  need  of  upgrading. 
-     V  ^ 

Secondj  there  is  likely  ^to  be  re£>tstance  to  the  use 
o-f  external  consultants>  for  bringing  in  outside 
''experts",  is"  seen  as  a  further  sdgri  what  their  own 
expertise  is  viewed  as  inadequate. 

Third  >  for  much  the  sam^  reason;  and  because  of 
sensitivity  to  the  school's  organizational  vulijfer-  ^ 
ability,  innovations  coming  from  laymen  are  likely  to 
be  fought  against  with  particular  vehemence, 

fourth,  status  insecurity  produces  excessive  "ri tiialism" 
in  teachers'  behaviors:     there  is  an  overcompliance  with 

;means,  even.at'the  risk  of  doing  serious  damage  to  the 

achievement'of -ultimate  ends.    The  education  or  well 

being  of  a  particular  child  might  be  better  served  by. 

deviating  frotft  a  particular  rule  or  norm,  but,  according 

*/  * 
DO  ttii6  analysis,  the  teacher  is  too  insecure  to  risk  it, 

Fifth,  where  s*tatus  insecurity  1^  a  significant  force 
l^n  a  part'iguXar  school,  6t  among  a  particular  group  of 
teachens,  one  finds  a  fascinating  lack  of  professional  - 
cotninunication  a^^ng  the  teaching  staff  of  a  school 
Faculty  room  'discussTLons ,  for  instance,  seem  to  meticu- 
lousXy  avoid  -  the  subjects  of  'teaching  or  learning  or 
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individual  studetvts,  for  participation  in  such 

discussions  mighf  reveal  the  inadequacies  of  a 

teacher's  4nowled§e  or*skills.    There  is  little        ^  t 

sharing  of  techniques  or  solutions,  in  part  because 

this  would  place  one  or  more  teachers  ir^  a  psoition 

jof  admitting  that  they  could  leaiyi  something  froin 

someone  else.    Thetfe  is  no  discussion  of  classroom 

pt<>blems  because  the  possibility  of  gaining  assistance 

in  the  solution  of  a  problem  is  not  a  strong  enough  * 

incentive  for  the  insecure  teacher  wfio  must  admit  to 

having  a  problem.  ■  ? 

^  -6*. 

Sixth,  there  is" often  resistance  to^merit  plans  and 
various  other  incentive  programs  to  stimulate  hnd 
reward  excellence,  especially  where <juQgments  of 
excellence  are  to  be  made  by  administrators*  The 
argument  is  made  that  such- systems  undermine  the  collegxal 
relationships.    Yet  many  other  professions  and  occupation- 
,al  groupsT  seem  to  welcome  such  programs  and  function 
reasonably  well  uoder  them* 

■  •  / 

Seventh,  a  considerable  amount  of  energy  that  might 
be  directed  toward  educational  experimentation  a'nd 
improving  student  achievement  is  placed  instead  in 
activities  oriented  toward  status^  enhancement  (e.g., 
unionism) ♦ 

And  finally,  one*  of  the  most  significant  effects  of 
teachers'  status  insecurity  tiS^  be  the  all-too-common 
"not  invented  here"  syndrome       i*e*>  the  notion  that  , 
each  school  (and  perh^s  each  classroom), *ls  so  unique 
that 'programs  or  materials  designed  elseijhere  cannot  be 
used  effectively  to  meet  gfibther  school's  (or  classroom's) 
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needs.    The  teaching  culture  envisions  the  teacher  as 
a  cra£tsman>  and  the  good  teacher  as  a  creative  orfe* 
Consequently>  the  ideal  teacher^  carry  with  them  in 
their  heads  is  to  be  fresh  and  original*  to* design 
particular  solutions  to  meet  the  particular  needs  of 
particular  students  at  a  particular  time  in  a  parti- 
cular  placo.    Using  id^as  or  materials  or  .techniques 
develt>ped  by  other  teachers  (or>  even  worse  >  by  out- 
side "experts"  in  some  -i^niversity  or  R  fir  D  organiza- 
tion)  is  looked  down  upon  ^s  mere  "imitation>" 
reducing  the  Creative  teacher  to  a  mere  functionary > 
or  (in  the  case  of  "teacher  proof*'  materials)  a  mere 
'^teaching jftachine/'    piven  this  frame  of  miqid>  it  is  no 
wonder  that  teachers  devote  so  little  time  to  scanning 
journals  or  attending  conventions  to  learn  about  the 
latest  new  developments^ in  their  field  — *  quite  a  contrast* 
to  a  secure  field  such  as  medicine  where  doctors  pride 
themselves  on  keeping- up*^to-date  in  their  journal  reading 
and  being  aware  of  new  practices >  techniques >  ahd  findings* 

iv*    Other  Barriers  to  Innovation  in  Schools 

In  addition  to  thB  market  factors  that  E^^^i^^lly  work 

against  Xhe  adoption  of  innovations  and  the  bureaucratic 

structure  of  schools  which  ^ends  to  undermine  the 

'Implementation  of  innovations >  the  literature  describes^  . 

^several  other  barriers  to  innovation  in  schools-  Thouglf 

analyticall)^  distinct  >  some  of  these  arc  closely  related 

to>  and  Intertwined  with>  factors  already  discussed  above. 

41 

Host  of  these  are  derived  in  one  way.  or  another  from  the 

■ 

way.  the  field  Is  organized  —  the  way  the  school  is  organ- 
ized as  a  work  place  >  the  way  education  is  organized  as 
a  pr<^|ession>*  and  the  way  school  sjjstems  recruit  and  reward 
thei^  personnel.  ' 
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t  .      /  ■ 

Teaching  as'a  Lonely  Profession  —  Teaching  has  been 

described  as  a  **lonely  prof ession,*^^^^  referring  to  the 


fact  that  teachers  spend  most  of  their  working  day  in 

f  any 
52 


classrooiQS  with  young  children  and  have  Ixttle  if  any 


contact  with. other  Adults  during  thpir  work  day. 
Although  a  certain  amount  of  stimulation  and  satisfaction  , 
may  be  derived  from^the  teachers'  interactions  with  their 
students r  generally  lacking  is  the  intellectual  kind  of 
"stimulation  that  could  be  expected  if  there  was  more 
communication  with  ;)ther  adults*  ♦  v 

Few  schocTlS  are  organized  in  ways  that  provi'de  intellec"  ' 

tual  stimulation  for  the  professional  staff.  As 

53 

described  in  thia  literature^      there  tend  to  be  few  if 
any  professional  exchanges^  few  i^  any  professional 
problem-solving  conferences^    Even  the  supervision  a 
teacher  .may  be  given  by  the  principal  or  some  other 
administrator  tends  to  involve  little  more  th^n  a  short 
period  of  QbServation^  £ollowe*d  by  little  if  anv  feedback. 
Whatever  few  opportunities  there  mi'ght  be  for  interchanges  , 
^with  specialists  from  outside  the  school  tend  to  be       ^  ' 
regarded  more  often  , than  not  as  threats  or  intrusions 
rather  than  opportunities  for  exciting  exchanges.  Teachers 
"tpnd  after-a  while  to  be*^ overwhelmed  by  the  boredom  that 
results  from  the  routinized ■  nature^ of  £heir  day^  the 
relative  constancy  of  what  they  do  year*  after  year^  and 
thi  drain  of  constantly  giving  at  a  high  level}  without 
iietting  much  intellectual  stimulation  back  in  returi^tv^^^^^ew 
schools  ar^T'orgaaized  &  provide  this  "return"  for  teachers. 
Their  need  for  new  ideas  and  Intellectual  growth  is  not  met, 
The  consequence  .is  that  since  teaching  is  no  longer  excit- 
ing or-interesting  to  them^  they  put  less  effort  into 
making  learning  interesting  and  exciting  for  their  students- 
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4  •  . 

And  liEe  in  classrooms  becomes  duller  istill,  for  bol 
teacher  arid  students.     The  outstanding  teachers  are 
those  who  are  able  to  resist  the  psychological  effect5 
'    of  rbutlnization,  who  somehow  keep  their  autonomy  an^ 
focus  on  helping  their  students  as  individuals  *^  TJie 
literatur^  suggests ,  however,  that  these  teachers  arie 
.the/e;(ceptions*rather  than  the  rule. 

The  lack  of  communication  amon?  teachers,  as  a  result  ^ 
of  the -way  the  school  is  organized,  is  reinforced  by  the 
strains  of 'qYiasi-^professionalism  we  have  already 
considered.    Because  teachers  feel  insecure,  they  prefer 
not  to  talk  about  their  yorkj  and  especial-i^  about 
difficulties  they  may  be  having.    So,  the  talks  with 

4 

outside  experts  come  to  be  seen  as  unwarranted  intrusions 
to  be  endured.    And  faculty  room  discussion  runs  the  * 
gamut  of  topics,  except  for  the  conspicuous  absence  of 
discussion  about  students  and  teaching. 

This  lack  of  interaction  with  peers  retards  innovation  ~ 
because  valuable  ideas  and  information  are  not  exchanged^ 
Isecause  teachers  da  not  mutually  stimulate  one  another  in 
ways  'that  might  generate  new  ideas  and  additional  crea- 
tivity, and  because  it  means  the  absence  of  a  valuable 
source  4>f  reinforcement  and  support  f6r  efforts  to  try 
new  things. 

The  "psychological  loneliness"  and  lack  of  professional 
interaction  we  have  beqn  considering  is  closely  related 
to  another  factor  we  might  describe  as  the  pattern  of 
"time  utilization'*  that  typifies  the  teacher's  work  week 
in  most  schools^    The  proportion  of  work  time  that  teachers 
(or  administrators)  are  able  to  jdevota  to  their 
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advancement  is  typically  iriiniscule  or  non-existentf^ 

TtiQ  p'oint  seems  particularly  underscored  by  comparison 
* 

to  the  time  utilization  patterns  characteristic  o£  ^ 

reaching  on  the  college*level»  where  classroom  time 

generally  represents  a  small  share  o£  the  professor's 

ivork  week,  and  other  non-^teach^ng  activities  (research* 

journal* reading »  attending  conferences »  etc)  receive 

54 

the  dominant  share 'of  the  time  allocation.  Clearly^ 
the  purposes  o£  universities  are  defined  in  terms  that 
emphasize  making  contribution^  to  knowledge,  and  this  is 
not  generallv  true  on  th^  K-12  levej.* 


There  may  be  much  o£  value  to  be  gained  from  thinking 
about  the  , possible  effects  of  these  time  utilization 
patterns  on  the  teacher  and  the  teac^jing  that  is  provided 
at  these  two  levels  (as  well  as  on  the  rate  at  which  new 
knowle(^ge  is  accumulated).     It  has^^been  etrgueds  as  we 
shall  see  shortly*  that  organiziiig^scjiobls  in  ways  that 
make  the  continui-ng  upgrading  and  prof esaiojiaj^dvance- 
ment  of  teachers  a  central  principle  of  school  function- 
ing may  be  essentail  to  s&gnificant  improvement  in 
educational  practice*     It  may  .al*so  be  that  stimulating 
teachers  to  contribute  to  the  accumulating  knowledge  base 
on  practice  may  be  a, vital  eletij^nt  in  this  professional 
advancement  and  upgrading.    We  shall  return  to  these  points 

later  in  our  analysis. 

^  '  *  .  *  • 

5) 

Lack  of  Collaboratlyj  Norms  —  Several  analysts  have  also"^ 
pointed  to  the  lack,  of  collaborative  norms  among  teachers*'^^ 
These  norms  are  particular]^  important  "if  self-renewal 
appTpachea  such  as;00  are  to  take  Hold  in  a  school*  ^ 
Typically^  at  least  as  described  in  the  literature  (and 
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some  of  our  own  experience  and  observations  support 
this),  tochers  do  not  share  their  creative  ideas, 
approachesj  and  materials.-  It  is  the  exception  rather 
than  the  rule  to  find  a  creative 'teacher  enthysiast^^cally' 
describing  to  her  -colleagues  a  nfew  approach  she  devel- 
oped  or  sharing  'the  taaterials  she  developed  so  chat 
others  could  try  , to  use  it  theioselves.    It  is>pt  even 
unusual  to  fin^  teachers  hiding  away  their  imaginative 
gems  in  locked  fi-le  cabinets- 

U  *  \ 

This  phenomenon  i^i  related  no  doubt  to  the  notion  teach<3r;5 
have  of  creativity,  anfi'  their"^ images -of  what  they  do  as 
uniquely  fashioned  by  their  own  personalities  and  their 
interactions  with  particular  bodies  of  students  in  ^ 
particular  times  and  particular  places.    But  clearly, 
other  crafts  have  functioned,  even  thrived,  while  caifry- 
*  ing  out  lively  interchanges  on' techniques .    We  will  have 

more,  to  say  about  this  later  in  ouX  analysis. 

We'ak'ness  of  Information  Flows  and  Incentives  for 
Communicating  Innovative  Approaches  — -We  have  discussed  * 
^  elsewhere  in  this  volume  some  of  the-  key  weaknesses  c^f 

informatj^on  flows  within  and  amcmg  school  systems. 
These  weaknesses  take  oh  particular  significance  as  a 
constraint  pn  innovation  in  education.    Fewer  new  idea^ 
enter  th'e  practice  setting  to  intellectually  stimulate 
school  professionals  to  keep  the  classroom  an  exciting 
environment  for  learning  or  to  find  solutions  to  perceiv« 
problems .  '  , 

'   Part  of  tha  explanatioji  for^this  lies'^in  the  fact  that 
schools  are  ry^X  organized  in  ways' th^t 'permit  a  great 
*       ■         deal  of  interaoTioD  ^mong  colleagues  on  professional 
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matCers,     But  oCher  sources  of  the  difficulty  lie  in 
che>  fact  Chat  the  field  is  not  organised  in  ways  chat 
reward  creativity^  put  a  premium  on  trie  practitioner* 
playing  a  significant  role  in  the  innovation  process,  or 
provide  sufficient  incentives  for  risk-taking  t<^^ver-* 
come  the  practitiop€r*s  inclination  to  be  highly  sensi- 
tive to  negative  reactions  (and  e\fen  the  potential  for 
negative  reactions) <    Lacking  are  high  visibility 

institutionalized  mechanisms  for  practitioners ^ to 

!  '  57  * 

disseminate  the  innovative  approaches  they  develop  or 
incentives  to  sCimulate  sharing  and  collaboration.  Data 
from  one  study  showed  that  as  many  as  75%  of  the  teachers 
involved  had  thought  of  innovative  ideas  or  approaches, 

but  only  half  of  these  teachers^had  spoken  , to  anyone  else 

^  58 
about  them,  and  only. 5%  reported  any  action  as  a 'result- 

Teachers  could,  of  course,  spend  their  non-work  time,  in 
the  evenings  and  on  weekend?,  writing  up  their  novel 
techniques  for  publication  in  various  magazine^  targeted  , 
at  other  practitioners.    But  use  of  this  kind  of  mechanism 
clearly  pl^es  a  tremendous  burden  on  teachers,  many  of 
whom  already  ^^ote  a  considerable  amoUnt  or^  their  time 
in  evenings'  and  on  weekends  preparing  ^(^ir/lessons  apd 
grading  papers*  What  would  seem  to  be  needed  in  addition 
are;  (a)  approaches  to  organi^aing  teachers*  tima.that 
permit 'and  encourage  this  kind  of  activity  as  part  of 
their  work  week,  and  (b)  incentives  that  reward  teachers 
for  the  innovations  they  develop  and  package  (or  assist  in 
^ackgging)  for  use  by  others* 
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fiGlative  Absence  of;  Chafee  Agents  —  Another  factor 
 ; —  1 —  

'Cited^tb  explain  the  lljiiited.  amount  of  innovation  in  > 

education  is  thfe  realtiv^  abs^ence  of  change  agents  in 
59 

the  field.       Principals  and  superintendents  are  often 

described  as  educational  leaders^    But  the  literature 
I  ^^^^ 

on  these  administrators  suggests*  that  most  of  them  get 
overwhelmed  by  the  administrative  aspects  of  their  jobs 
and  relatively  few  are  abl*e  to  exert  strong  leadership 
in  identifying  problem  areas  and  directing  resources 
toward  overcoming  these  difficulties  and  improving 
school  functioning.    The  significance  of  the  leadership 
exerted-by  these  administrators,  though,  should  not  be 
underestimated .  ^ ''l^fhere  innovation  levels  ere  high,  data 
generally  ppint  to  the  principal  and/or  superintendent  as 
the- key  fa;:tor  accounting  for  successful  innovation. 

Much  research  literature,  points  to  the  significant  "roles 

.external  change  agents  can  play  in  stimulating  and  sup- 

60 

porting  innovation.        However,  until  recently  there  have 

no^|>een  many  instituticinalized  change  agent  rol^s  in  the 

field  o'f  education,  and  where  change  has  been  attempted 

froia  outside  the  syste^a  the  external  change  agents  have 

often*  fared  poorly,'  perceived  as  ^outsiders*'  who' do  not 

adequately  understand  the  system  or  its  needs,  who  are 

foisting  unwanted  changes  on  schools  merely  to  advance 
• ,  •  \ 

tfieir  pet  proposals,  and  their  own  Careers* 

'  \  ^ 

There  is^also  a  Bbdy  of  literature  which  suggests  that 
larger  school  districts  are  more  innovative. One 
interpretation  of  t^i^is  Jf  inding  has  be^ti\  that  larger 
school 'districts  tend  to  have  more  resources  toispend  on 
socialized  personnel   (central  curriculum  offices  or 
curriculum 'coordinators,  for  Instance)  who  function  to. 
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link  the  schqol  System  to  external  resources  for 
innovation  and  who  can  function  in  cl^nge  agent  'roles. 
There  are^other  factors  that  suggest^uhy  largeV  districts 
migfit  adopt  more  innovations  —  for  instance,  more 
diversity  in  the  student  body  antl  in  the  environment , 
producing  more  problems,  and  'greater  pressures  for 
programs'  to  solve  these  problems.     Still,  there  seems 
some  validity  to  the  assumption  that  larger  districts 
employ  more  resource  personnel  who  can  function  as  change 
^g^nte*    This  certainly  warrants  some  empirical  investi- 
-gation,  for  confimation  of  this  proposition  uoqld  suggesc 
an  important  avenue  to  pursue  to  increase  innovation* 

However,  there  is  another  interesting  and  somewhat 
different  finding  in  the  literature  that  bears  some 
investigation  as  well.    One  group  of  investi:gators  have  - 
concluded,  that  although  larger,  more  complex  district^  *  . 

do  h^ve  higher  innovation  adoption  rates,  they  have 

^  '  62 

substantially  lower  innovation  implementation  rates. 

This  would  suggest  that  greater  complexity  may  bring 

greater  external  pressures  to  adopt  innovations  for 

the  adopfion\^f  the  innovations  may  be  a  visible  enough 

force  to  relieve  the  pressWes  —  but  either  interest  in 

the  ^tiovation  dissipates  with  the  act  -of  adoption  (once 

the  external  pressure  is  reduced)  or  these  adopting  school 

systems  may  simply  be  unable  to  cope  with  'the  problems 

their  complexity  brings  to  the  effort  to  implement  these 

'innovations.    This  dilemma,  too,  wouXd  seem  to  warrant 

considerably  more  inves  tiga-tion. 
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Salary^  Tenure,  and  Promotion  From  Uicbin  — /)thor  ^ 
structural  features  of  the  field  of  education  also 
function  to  retard  innovation* 

^    -  • 

Salary  Scales!    Salary  scal'fes,  for^  instanc^^  are 
based  on  amounts  of  experience  and  f<?rnial  training 
;  rather  than  on  classroom  performance  or  development 

■  of  valuable  new^teacbing  techniques  or  success  i^n 
disseminating  nex^^approaches  ^o  the^'rest  of  the  field. 
Salary  scales  reward  len^*^  of  service,  and  there  is 
reason  to  believe  that  the  more  years  teachers  spend 

in  classrooms/the  more  established  their  patterns  6f  ^ 
functioning  become  and  the  less  willing  (and  "perhaps 
abble)  they  Wiy  be  to  chang^,  "Salary  scales  also  reward 
educa*^tors  for  additional  formal  training  (additional 

■  course  work,  advanced  degrees,  or  in-service  training^. 
But  our  observations  suggest  that,  for  the  mo!?t  part, 
teacher  training  institutions  are  not  heavily 'oriented 
toward  communicatrrig  innovative  approaches.     But  this 
Kieihanism  does  not  appear  to  be  used  as  much  3s  it 
night  be  for  this  purpose.  ^ 

Tenure:,    Whatever  may  be' said  on  behalf  of  teacher  ^, 
tenure  (and  there  ^  has  been  some  lively  debate  on  this 
'    itiatter),  teacher  tenure  does  little  to  -advance  innova7 
tion  and  probably  has 'some  effect  in  minimizing  the  felt 
'  need  for  innovation*"    If  teachers  are-  secui^/e  in  their 
jobs  for  as  long  a9--thei;  want  them,  they  need  not  search 
for  innovative  apnroaches  to  improving  their  -performance 

Promotions:  Another  common  feature  *of  school  sys*tem 
recruitment  and  promotion  policies  is  the  pattern  of 
promoti\)n  from  within.    Teachers  b^Jcome  assistant 
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pri,iicipals >  assistanc  ^principals  become  principals^ 

and  pr^.ncipals  become  superintendents)  often  all  within 

the  same  school  district.    A  substantial  amount  of 

literature  suggests  that  some  of  the  inost  innovative 

administrators  are  thos^  who  have  move^ about  from^ 

district  to  district,  atid  ihat  innovation  tSiis  to  be 

increased  by  hlfring  top  leadership  from-outside  t^e 

system,  enabling  a  "fresh  loo'k*^  to  be  taken  at  how 

t  ■ 

the  district  operates,  what  its^problems  lyiay  be,  arid 

63  ^  ' 

"how  the^sa  niay^e  attacked.        Stijl,  the  predominant 

pattern  in  school  systems  is  st^ill  that  of  promotion. 

from  wich-ln,  i  ^ 

All  of  these  incentive  structures,  then,  tend'  to  w<^k 
against  high  levgls  of  innoyation. 


.  History^of  Innovations       On^  other  factor  needs  to  be 
noted  before  we  bring  ihis  part  of  our  analysis  ^o  a    "  * 
close.    The  unhappy  history  of  innovations  tends  itself 
to  retard  innovation.    The  field  o'f  education  has  been 
swept  so  ofteif  by  fads  which  have  proven  to  have  little, 
value  that  practitioners  are  wisely  cautious 'about  new 
.innovations.    To  offset  negative  attitudes  practitioners 
Staaie  about  innovations,  RfiiD  people  make  exaggerated  claims 

for  the  benefits  of  their  products.    Then,  when  phese  claims 

■     *  /  '  "  ■  ' 

turn  out  to  be  exaggerated  (or  even  downright  falsfe),  this 

increases  skepticism  about  innovations  and  laake^'-^racti- 

tioners  even  more  resistant  the  next  time  aP'J^feb^J^tion  " 

6*4  ■  ■ 

.  is  proposed.       This  Is  a.fafctor  that  simply.^cannot  be 

ignored.    It  suggest^  the  need  ^or  more*responsible 

behavior  by.  the  advocates  of  a  given  innovation,  and  it  . 

*    ■  _  ■ 

points  to  an  aspect  of  reality  that  must  be  planVied  for  if 
innovations  are  to  be  adopted  and  imp^lementcd  in  schools- 
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b.    ^he  Educational  Setting:  Change  Desi5ite  the  Barriers'  to 
'  Change  .  ^  \\ 

We  have  devoted  a  considerable  amount  of  space  to  the  barriers 
to  change- described  'in  the  l^Pterature*,  for  iiiost;of  the  . 
liteisature  is  about  these  barriers-    However,  desp^ite  th^e 
barriers  there' are  substantial  numfDers  of  iiighly  innovative 
schools  and  school  districts,    \7hat  maktes  the  innovative  school 
dif f erent  ^f rora  those  described  in  the  lit-eratur&?    btany  of  the 
factors  we  have  considered  are  constaats  across  a^l  schDoJ. 
systems  —  certaiqjjy  the  domesticated  nature  of  ^t;he  school  as 
an  institution;  Its  vulnet'ability  to  environmental 'influence ; 
certainly  (at  least  ^to  some  degree)  the  bureaucra lie ^organi- 
zation of  schools  as  institutions  and  the  manner  in  .which  this 
conflicts  with  desires  for  professionalism;  ce;rtainly  the 
weakness  of  infomtation  flows;  and  the  inappropriatenes&  of 
salary,  tenure,^  and  promotion  policies  as  incentives  for 
, innovation; 'and  probably,  too',  to  .some  degree,  the  realtive 
absence  of  change  agents;  and  at  least  some  negatrf-ve  experi-- 
en^e  with^innovations*  v.  -    '  ' 


rrerence 


Are  the  diff erehces  .bdt;w^n  innovative  and  non^ innovative  ^ 
schools  simply  a  matter  of  degree?    Are  there  tnore  change 
agents  (or  iitore  forceful  and  effective  change  agentfe)  4n  ^ 
innovative*  schools?    less  intrednes's  of  school  district  lead- 
ership?    less  unhagg^  experience  with  innovations?  less 
im[)ositi^R<of  t^u^feaucratic  pro^re^ures  that^lirait  profeSfeion- 

lism?    moref^pr^essionalisTU?    more.,  autonomy?    m<^re  part;icipa~ 
tTve  decisionmaking?    more  effective  information  flows?  more 
rewards  for  innovative  behavior  and  dissem^-nation  of  innova^ 
tlve  approaches  -to  other  districts?  '  ^  - 
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This  may  be  a  part  of  the  story,    Certal'nly  tlWe  is 
ample  testimony  in  the  literature  to  the  ,Xmportan&ef of  the 
leadership  factor  in  dnncArative  ^^chobls  and  districts.  And 
our  observations  would  especially  lend  sugport  to  the 
importance  of  staf^E  professionalism' and  minimal  strain 
between  professional  autonomy  and  bureaucracy*.    Clearly,  we-  ■ 
need  to  learn  a  great  deal  more  about  this,  especially  how  to  ' 
develop^re  effective  leadership  in  support  'of  change,  and 
more  effective  information  flows  and 'incentive  structures 
to  stimulate  and  facilitate  innovation, 

■   ..In  oi^e  interesting  study^,  r^esearchers  tat'egorized  the  urjt^an 
secondary j^hools  they  studied  along  two  dimensifonsr  number 

of  linnovat^^ns  Adopted-  and .  proportion  of  high*quality  innova- 

65      *  *  ' 

tions  adopted*       Their  findings  are  ^summarized  in  Table  14,1* 

They  classified  22%  of  tKese  schools  as  "pacesetters"  (i*e., 

^  adopting  larger  numbers  of  innovations^  including  most  of  the 

high  quality  ones);  24%  as  "faddist"  (adopting  larger  numbers 

.  ^of  innovations  but  few  of  high  quality);  14^  as  "selective" 

(adopting  fewer  innovations  but  most  of  t^ie  high  quality  ones) 
+ 

4    and  40%  as  "backwe^d"  Adopting 'tewer  innovations^  and  especial 

ly  few  of  the  high  quality  ones).    It  would  be  Useftil  to  have 

information  of  this  kind  about  not  only  innovation^doption 

'    but  also  innovation  implementation.    And  it  would  seem 

f 

"especially  important  po  gathjt  data  that  would  shed  light  on 
what  factors  account  for"^ the  -differences  among  these  four 
types  of  schools. 


■  9' 
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Table  U.l 


Proportioiroaf  Hiah  Quality  Innovations  Adopted 


High  . 
(M6re  tha^  50%) 


00%  or  less)- 


■  High  22% 

■  Schools 

Number  of 

Innovations  ■   ^ '  

Adopted 


Low 


14% 
Selective 
Schools 


24% 

Fabulist 

Si^hodls 
4 


.40% 
Backward 
Schools 


N=6i3  schools 
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Ebr  the^r^sent,  fe  are  siraply^  left' with  the.  uncomfortable  . 
*^  'fe'^^ling  that  the;,  bulk  of  the  literature  .describes  schools 
in  ways  that  emphasise  the  barriers  to-  change  despite  the 
fact  that  there  is  a  substantial  amount- o£  innovation,  taking 
*   ,  places  'These  descriptions'are  interesting,  and  they  may  b^e 

useEuT  for  suggesting  certain  sources  of  resistance  tljat  maj^  » 
(or  may  not)  be^present  and  may  need  to  be  planned  for; 
However,  they  may  be  misleading  if  innova^ipn  strategies  are 
^developed  on  the  basis  of.  the  inpressions  one  ge^s  from  this'  ^ 
literature.    \ifhat^  this^  literature  *sugges^ts  is  that  there  is 
likely  to  be  substantial  resi^t^ce  to' change  in  schools  and 
that 'the  success  of  attempts  at ' innd^^tion  is  likely  to  be  ^ 
determined  by  how  effectively  this  initial'  resistance  over- 
come.   As  we  shal^  se$  in  the  next  section,  this  is  -too 
simplistic  an  approach  to  innovation  in  Vacation  and  may  in 
fact  result  in  failure- when  an  attempt  i^s  made  to  implement 
innovation. 


'in ,  .  FlMOtKGS  FROM  IMPLEMENTATION  "RESEARCH  '  - 

We  have  been  particularly  impressed  by  three,  studies  which  we  believe 
point  ,ln  more  fruitful  directions  ^^or'  policy  thinking  about  facilitating 
the  implementation  of  , innovation  in  education^    We  will  therefore  sum-* 
marine  the^  findings  ^of  each  o&^these  studies  and  their  possible  policy 
implications,  and  then  .suggest  the  kinds  of  unanswere^^i  questions  raised 
in  our  minds^  by  these -studies  and  the  literature  we,  have  alrea<^^c^sid-^ 
ered.  '  *  -         "  - 

1 .    Gross,  Giacquirfta,  and  Bernstein,  Implementing  Organizational 
"  Innovations^^*  ,  '  '  -  ^ 


Gross,.  Cr&i^quiqta,  and  Bernstein  studies  an  attempt  to  implement  a 
radical  change  in  a' small  elementary  school.    The  change 'required  that 
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teachers 'change  their  role  model  from  thac  of  th|  traditional  teacher 
who  fills  students  heads  with  learnlng>        a  newer  perception  of-  the 
teaqj)^  as  a  catalyst  who  "helps  students  learn  how  to  ^earn>  shift 
attention  from  tha  concent  of  learning  to  the  process  of  learnins> 
enablee  students  to  discover  the  intrinsic  satisfactions  to  be  derived 
from^  learning  and  discovery,  Encourages  thetn  ^o  beco^je  self-motivated  j 
and  self-directed  >  and  enables*  them  to  become -increasingly  responsible^ 
for  t)A^T  own  learniftg.*^  The  change  required  teachers*  to  redefitile  their 
roles  in  rel;ation  to  theii'  students  and  to  radically'chan^e  tJiAr 
behaviors  in  accord  \Jith  ithis  new  role  kadels  ^ 


The  particular  innovaton  wa5  of  interest  to  Gross  and  his  colleagues 
as  an  excellent  vehicle  ft>r  exploring  the  problems  of  organizational 
innovation.    They  conceptualized  organizational  change  in  terms  (tf  ^ 
beldT^foral  changes  required  of  an  organization's  "rjembers.     Some  behaviors 
they  noted, 'are  determined  by  personality  needs  and  valued.  Other 
behaviors,  however,  are  determined  Ky  "structured  roles  within  a  system/' 
As  tl^&y  conceived  it,' organizational  change  is  designed"  to  change  these 
organizational  behaviors  (i.e.,  thosq  >eha^iors  related  to  organizational 
goals),  so  as  to  resolve  some  organisational  ptobletns  and/or  to  improve 
the  organiaation's'performance.  -    '    "  . 

They  began  their  analysis  with  a  review' of  the  literature  on  planned 

change,  which  they  crXtlcized  as  unduly' focus6d  on  .the  adoption  of 

innovations  and  insufficiently  concerned  with  their  implementation, 

* 

They  noted  in  particular  that  the  literature  places  a  great  deal  of 
emphasis  on;     (a)\the  significance  ^  conditions  antecedent  to  change 
efforts,  and  the  importance  during  the  adoption  stage  of    (b)  outside  ' 
change  agents,  and    (c)  subordinate  participation*     Th§  reason  for  this - 
appears  to  be  that  most  change ^ theorists 'have  assumed  th^  inevitability 
of  staff  resist^nde  to  innovations  and  therefore  see  the  success,  of 
effort^  to  implement  innovations  as  determined  . by  their  ^effectiveness 
in  "overcoming  this  initial  staff  resistance-    Thus>  the  importance  of 
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Ithe  factors  pinpointed  in  the  literature.    Antecedent  conditions  are' 
likely  to  affeet  the  intensity  of  resistance,     (Past, unhoppy 'experi- 
ences with  innovatiPns*>  for  instance  >  are  likely  to  i-ncrease  resistance. 
Greater  community  pressure  for  change  is  likely  to  decrease  resistance-) 
"Outside  change  agents  (or  highly  effective  "inanagement  of  the  adoption  - 
process  by  an  organization's  own  leadership)  are  seen  as  important 
primarily  for  overcoming  this  initial  resistance*    For  much  the  sape 
rciason,  theorists  have  argued  f^>r  u^d^  staff  partic'ipat^n  in  the 
initiation  of  the  inpovatlon  process  (leading  to  the  'adoption  ond  intro- 
ductioa  of  the  iTinovauon)>  so  as       give  tbe  staff  a  sense  of  ''ownership'* 
o£  the  innovation  and  thereby  overcorne  initial  resistance  that  -is  v 
especiall/  likely  ^en^ change  is  imposed  f^om  the  top  down.  ^ 

Gros$>  Giocqulhta*  and^ernstein  argue<j  that  there  wa^ 'relatively  little 
evidence  to  support  these  various  assumptions.    They/then  pollected  data 
on  the  4^ey.  variables  identified  in  the  literature>  so  as  to  be  able  to 
assess^ithelr  importance  an  J:o  provide  evidence  for  their  own>  more  comple 
View' bf  the  innovation  process  and  the  factors  that  determine  its  success 

The  innovation  they  studied  ^was  of  the  "top  do^^nj"  variety.    Therefore  >  , 
if  the  liter^fture  was  correct  >  initial  resistance  'should  have  been  high 
and  the  staff  should  h^wve  had  little  commitment  to  it.    Iustead>  the 
data  showed  that  the  staff  itrtti^lly  supported  the  inniovatiou  and  was 
positively  oriented  toward  change.    Whatever  resistance  was  found  ^y  the 
researchers  developed  after  the  implementation  process  had  beguu>  but  not 
at  the  time  of  the  Innovation's  adoption  or  when  it  wos  firs^t  introduced. 

Equally  interestingj  most  of  the  factors 'suggested  by  the  literature  as 
important  for  insuriog  ^that  the  innovation  would  be  implemented  y^ere  to 
-be  found  in, this  case*    Both  the  external  and  the  internal  cottditions  - 
■  d^cribed  by  change  theorists  as  impor.tortt  antecedents  to  successful'* 
ch^inaa^^ere  there,    the  cli'mate  of  the  school  was  highly  conducive  to' 
chante-  ^The  previous  period  was  one  of  change  at  the  school.  School 
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norms' supported  charge.    The  staff  was  willing  to  make  changes  and  v 
,   even  seeined  committed  to  the  changes.    Financial  and  personnel  resources 
needed  to  support  the  change  efforts  were  provided*    Both  the  school 
system's  officialdom  and  the  surroundi?ng  community^  were  strongly  oriented 
tdward  change  and  recognized  the  need  for  significant  changes  to  be  made 
-'to  improve  the  school's  performance,    The  school  system  even  hired  an 
,  outside  change  agent  to  facilitate  the  innovation  process,  meeting  a 
further  conditioa^tnphasized  in  the  literature* 


In  short,  all  the  antecedent  and  prevailing  conditiuns  in  and  around  - 
the  school  were  highly  supportive  of  change.    Despite  this,  the  reseerch- 
ers' found  that  the  degree  of  implementation  of  the  innovation  was  minimal^ 
The  key  question  the  researcher^  sought  to  answer  was;  lv^y>  despite 

the  presence  of  conditions^  which  the  literature  suggested  should  support 

successful  innovation,  was  this  innovation  not  implemented? 

*   -^^  ^ 

The  ans'wer  they  found  was  in  the  circumstances  that  arose  after  the 

int*roduction  of  the  innovation,  dui^ing  ^the  implementation  process,  The 

approach  to  planned  xhange  found  in  the  literature  was,  they  argued,  too 

simplistic  because  it  ignored  the  fact  that  the  problems  that  accounted 

f or . thet^ailure  of  an  innovation  attempt  might  arise  during  th^  imple- 

merttatifln  process,  that  a  school's 'management  is  so  central  to  the 

functioiBing  of  an  "organization  that  its  behaviors  may  be  critical  in 
n  ^  >  ^  ^ , 

either  <a:eating  or  resolving  these  problems,  and  that  the  members  of  an 
.  organizasio^  who  ^ere  initially  favorable  to  an  innovarion  bight  actually  . 
become  Tftsistant  to  it  later  in  the  innovation  process  because  6f  the 
frustrations  they  experienced  in  trying  to  implement  Che  innovation^ 


Gross  anmiis  colleagues  argued  for  an  alternative  view  that  conceptual- 
ized "thej  success  or  failure  of  the  implement<ition  of  organizational 
innovatiors  as  the  result  of  a  complex  set  of  linterrela ted  fiorces  that 
ofcur,  one  3  the  innovation  has  Ijcon  introduced,  over  an  extended  period 
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o£  time"  and-coo^L  cognisance  of  che  fact  that  this  interrelated  set  of 
forces  "can  shift  over  time.'* 


ited  for  the  (failure  of  this 


*^eir  data  showed  that  five  obstacles  accounted  tor  the  (taxiure  ot  this 
innovation  attempt:     (a)  the  staff  *s  lack  of  clarity  about  _the  innova- 
tion  and  its  requirements;     (b)  the  staff's  lack  of  capability  to  perforr?! 
the  new  role  model';     Cc)  the  unavailability  of  necessary  loaterials  to 
support  its  implementation;     (d)  the  incompatibility  of  existing  organl-' 
zational^ arrangements  with  the  requirements  of  the  innovation;  and 
(e)  staff  resistanc*>  to  the  innovation.    The  first  four  of  these  condi- 
tions  existed  when  the  innovation  was  first  introduced,  and  persisted 
thrgugbout  the  innovation  process,    iffe  last  of  these,  however>  staff 
resistance  to  the  Innovation^  emerged  only* during  the  implementation" 

\e£^rt  and  was  a  result'  of  the  frustrations  produced  by  these  other 
problems .  '  ♦  '  ^ 

The  reseax5j:hers  fourfd  the  root  of  these  difficulties  in  management's 
faulty  view  of  its  role  and  what  was  required  for  the  process  of 
innovation.    Because  they  assumed  success  required  only  focusing  on 
overcoming  any  initial  staff  resistance,  they  failed  to* anticipate,  take 
cognizance  of,  or  adequately  cope  with  the  problems  that  were  emerging 
during  tlt^'implementation  process,  ^ 

•Initial  staff  resistance  inay  or  may  not  be  present,  thfey  argued.  In 
any  given  change  effort,  the  .existence  of  initial  staff  resistance  must>* 
be  established  empirically,  riot  assumed,    xhe  assumption  of  initial. .staff 
resistance  is  based  on  the  premise^that  an  organization's  members  are 

highly  satisfied  with  the  way  things  are*    In  fact,  however,  there  is 

■  *n 

often  a  ^bstahtial  amount  of  dissatis.facj:ion  in  organizations  because 
the  ptembers  (in  this.. case  the  schoQl  staff)  may  be  exposed  to*difficult 
problems  that  are  not  being  resolved*_  h  <  In  many  such  cases,  then»  the 
staff  is  likely  to  welcome  an  irfnovation  if  it  seems  to  have  the 
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pbtentlal  of  overcoming  some  of  thes^e  difficulties* 

Gross  and  his  colleagues  argued  th^t  th^  error  of  all  coo  many  innova- 
tive attempts  is  overlooking  the  complexity  of  a'given  innovation  and 
the  difficulties  it  is  likely  to  present  during  jthe  iiaplementation 
process-    I'fhat  is  called  for>  then>  is  a  recognition  of  the  critical 
role  management  must  play  in  anticipating  implementation  problems  as 
inevitable  and  providing  mechanisms  and  supports  to  overcoiue  these 
problems  —  training  and  other  supports  to  resoc^alize  teachers  and  to 
enable  them  to  unlearn  old  behaviors  while  learning  new  ones  >  and.' 
workable  feedback  systems  so  that  problems  can  be  iC^ncified^be^ore  t\iey 
become  unmanageable*  ' 


This  study  suggests  to  us  the  need  for:    development  of  a  better  under- 
standing of  fhe  implementation  process  as  **a  dynamic  process  involving  - 
a  complex  set  of*  interrelated  variables*';    the  develofJment  of  programs 
to  train  innovation ^mainager's  in  Analyzing  and  skillfully  managing  tViese 
interrelated  variables;  and  the  development  of  the"  kinds  of  implementa-- 
tion  supports  they  may  require  to  facilitate  successful  innovation- 

5,    Sarason>  The  Culture  of  the  School  and  the  Problem  of  Chanfie^^ 

In  The  Culture  o^  the  School'and  the  Problem  of  Chang^e^  Seymour  Sarason 
provided  a  fascinating  analysis  of  why  major  innovations , have  failed*  , 
'He  stnalyzed  two  change  efforts>  an  effort  to  introduce  the- "new  math'* 
into,  an  elementary  school-^nd  an  effort  to  establish  an  MAT  iprogram  at 
a  prestigious  urviversity,  ^ 

\  '    '        .        "  '       '  ' 

tn,  both  casks,  Sarason  argueJ>  suVface  changes  ve re  made  but  real  chan'ge 
did  not  ocGu^-    The  reason>  according  to  his 'analysis >  is  that  the 
changes  th^at  were  made  failed  to  affect  relationships  among  people 
(teacher-sfrudent  relationships  >  teacher-administrator  relationsfiips> 
parent-teacher  relati'onships ,  etc.^.    And  the  reason  for  this  was  that 
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the  changes  that  were  nade  did  .not  challenge  ther  assumptions  aad  the 

f. 

behavioral  and  programmatic  realities  that  people  take  for.  granted.  An 
adequate  theory  of  change, 4  he  suggested  must  start  from.ati  adequate 
description  of  what  needs  to  be  changed,  and  this  requires  a  close 
examination  of  the  regularities  that  characterize  the  scho61  culture.  . 

The  problem  with  most  approaches  tp  change,  Saradon  pointed  out^  is 
that  they  tend  to  focus  -on  individual  personalities  rather  than  complex 
role  relationships*^    \VhaC  would  seem  to  te  essentail  to  effective  change 
efforts  is  an  understanding  of  the  complexity  of  each  rolje  in  the  school 
stru<:ture,  its  demands,  the  inherent  conflicts  Within  e^ieh  role  ^nd 
its  relationship  to  other  roles  and  to  t^e  overall  system  o"f  relation- 
ship^.    (Thus,  Sarason,  like  Gross  and  his  colleagues,,  focused  on  role 
relationships  and  the  need  to  fundamentally  affect  these  role  relation- 
ships that^people  ^ake  for  granted*)  "  ^ 

flost  change  theories,  Sal:ason  pointed  out,  are  developed  by  outsiders 
(generally  do  not  adequately  understand  the  school  culture-  and  therefore 
have  unreajistically  simple  notions  of  how  to  bring  about  change)  or  by 
insiders  who  do  not  themselves  identify  with  the  school  culture  (and  who 
therefore  are  also  pot  likely  to  understand  that  culture  or  £6  be  able 
to  deaf  effectJA^ely  with  It).    Sarason  di4,  not  fall  into  either  of  ithose 
two  categories  since,  although  he  was  an^outsider,  h^^ and  his  colleagues 
from  the  Yale  Psychoeducation^l  Clinic  were  working  wifh  the  school 
personnel  tliey  studied  in  an  ongoing  helping  relationship*    The  research" 
fers  were  helping  teachers  ^o  deal  with  some 'of  their  problems  while  they 
were  ^Iso  observing  and  analyzing  the  school's  behavioral  regularities.  " 

»  + 

The  observations  suggested  that  in  .these  cases  littJe^real  change  occur- 
red  and  the  purposes  |f  tip^  innova&ions  were  not  achieved,  because  people 
continued  t^nctioning  much  as  they  had  b&fore.    The  change  stltnulus  cams 
from  outside  the  school  culture.    There  wag.  little  or  00  attention  to  the 
characteristic  regularities  of  the  school -culturfe  and  the^ifr  possible  ^ 
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social  and  psychological  correlates.    And,  there  was  an  unverbalized 
assumption  that  the  changes  could  be  achieved  without  affecting^ny  of 
the  regularities  of  the  school  culture.  '  *  , 

4 

Sarason  s  analysis  ^  probably  the  most  useful  single  piece  in  the 
literature  fot^  underscoring 'the  fundamental  pifobleiu  in  radical  changes  — " 
i.e.,  that  they  tend  to  require  that  f>jeople  both  unlearn  old  bejiaviors 
and  ways  of  thinking  while  learning  new  ones.    In  order  to  change  an 
existing  reality,  .the  people  who  are.  bein^  asked  to  change  must  coioe  to 
some  understanding  of  what  regularities  must  be  changed,  what  the 
rationales  were  £ur  the  existing  regularicies >  and  what  "universe  of 
altserhatives"  ior  meeting  the  same  needs  might  be  considered^^^ -Those 
regularities  tend  to  be  taken  f o^^^jxaii^ed  and  assumed  to  be  t^  only 
way  .things  are  done.    uTiy>  .for  instance,,  do  teachers  make  all  rules 
for -students'  classroom  behavior?    UTiat  purposes  are  those  rules 
supposed  to  achieve?    Are  there  some  other  ways  the  same  purposes  might 
be  achieved  that  might  also  make  life  in  classrooms  more  pleasan't? 

Sarason' s  analysis  shows  that  regularities  exist  because  they  are 
supposed  to  have  intended  outcomes  which  are  discernible  in^ overt 
behavior  and  various  kinds  of  interactions,  and  they  are  generally 
justified  by  value  statements.    But,  at  the  same  time,  there  are  frequent 
discrepancies  betweert  these  regularities  and  their  intended  incomes. 
Unfortunately,  school  peissonnel  rarely  become  aware  of  those  discrepan- 
cies because  Ihere  is  no  regularity  built^into  the  school  culture  to 
facilitate  the  recognition  of  these  discrepancies.    Once  some  mechanism 
is  established  to  ppxnt  ou£  these  discrepancies  ax\d  help  t|ie  staff 
understand  the  wider  r^nge' of  .alternatives  that  might  be  considered  for 
achieving  the  same  purposes  without  such  discrepancies  (and  this  is  the 
sort  of  mechanism  Sarason  and  his  colleagues  were  trying  to  establish), 
real  change  becomes  more  likely.  >  ^ 

Much  of  th&  spncp  in  Sarason*s  book  Is  devoted  to  analyzing  some  of  the 
regularit^.firS'"3ftdi''inherent  dilemmas  and  conflicts  within  the  .roles  played 
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by  the  principal  and  the  teachers  in  a  school.    That  analysis  is 
fascinating  in  itself*    We  took  note^of  many  of  Sarason's  points 
earlier  when  we  considered  sojne  of  the  sociological  descriptiot\s  of 
school  functioning  and  especially  the  barriers  to  change  created  by 

the  tensions  between  the  school ^s  bureaucratic  structure  and  the 

^  68 
teacher's  image  of  prof essifbnalisra.  '* 

For  our  purposes  here>1:he  parts  of  ^the  book  that  are  most  "useful  are 
those  in  which  Sarason  sfeoued  how  he  helped  teachers  change  ^fcheir 
perceptions  of  their  rore  by  giving  them  alternative"  ways  of  seeing 
theikr  problems  artd  avoid^ing  premature  closure.    Once  he  was  able  to 
get  ^teachers  to  verbali&  their  assuinptions>  the  teachers  found  them- 
selves disa^eeing  with  wha^.  they  were  doing,  seeing  that  their  behavior 
(based  on  assumptions  they  w^re  not  even  themselves  aware  of)  were 
having  effects  they  did  not  want.    Once  they  saw  for  themselves  what 


their  assumptions  had  been^  how  theyviewed  their  own  role,  and  what 
behavibrs  their  views  implied,  ^they  ^ai&e  to  understand  the  need  for 
change.'  Their  examination  of  ^alternative  ways  of  viewing  how  to 
achieve  their  objectives  opened^jip^^£«rf"  them  new  avenues  to  bring  about 
the  needed  changes.         "  '  "  ^  ■ 

Sarason's  point  Is  that  the  way  pr&blgms  are  verbalized  affects  the 
way  they  are  resolved^    If  the  formulation  of ya  problem  i^  structured' 
in  a  way  that  permits  the  problem  to  be  reformulated  on  the  basis  of 
new  information,  then  there  is  more  likely  to  be  a  changer-oriented 
response  when  the  staff  comes  to  see  the  range  of  alternatives  that 
might  be  considered  to  meet,  a  given  need>    He  agreed  that  innovations 
are  often  resisted  because  an  organizatloh's  members  fail  to  see  the 
universe  of  alternatives  to  current  practice,  and  seeing  this  is  the 
beginning  of  positive  change.    The  implication  whould  seem  to  be  that' 
change  efforts  must  begin  with  an  understanding  of '  the  behavioral 
regularities  that  must  be  changed  for  successful  implementation  of  a 
proposed  innovation,  what  the  intended  outcomes  are,  ahd  how  existing 
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i)ractice  and  the  proposed  Innovation  compare  in  terms  of  achieving 
'those  outcomes-  *    .   .  . 

If  schools  are  to  become  self-renewing  structures >  they  will  require 
that  mechanisms  likely  to  facilitate  such  ^staff  analyses  are  bqllt 
into  the  school's  structure  and  modes  of  functioning,  ^  • 

H  ft  *  * 

Sarason  pointed  to  the  example  of  Dewey's  school  as.  a  model  of  what 
may  be  needed.    As  princip^l>  Dewey  functioned  tjculy  as  an  educat^ional 
leader  in  a  setting  that  emphasized  colleagial  relationships  among  the 
staff-  Staff  conferences  were  one  of  the  school's  built-in  regularities> 
stimulating  teachers'  minds >  satisfying  their  needs  for  new  learning  and 
understandinCT^Jnd  keeping  them  focused  professionally  on  the  needs  to 
'be  met  and  the  problems  encounter^ed  as  well  as  the  range  of  possibilities 
that  might  be  considered  for  meeting  those  needs*    In^'th^^kind  o^  school  > 
one  would  assume  the  psychological  loneliness  of  the  teacher  was  mini- 
mizedj  professiona^llsm  was  stressed>  and  there  were  as  few  strains  as 
possible  between  the  requirements  of  bureaucracy  and  prof essionalisin* 

3.    The  Kand  Corporation  Change  Agent  Study>  Federal  Profirams 
Supporting  Educational  Change 

« 

Beginning  in  1973^  Rand  Corporation  research  team  headed  by  Paul 
Berman  and  Milbrey  Mclaughlin>  funded  by  the  Office  of 'Education>  studied 
four  federally  funded,  change  agent  programs.    The  four  programs  were: 
the  Elementary  and  Secondary  Education  Act  Title  III*  Innovative  Projects; 
the  Elementary  and  Secondary  Education  Act  Title  Vtl>  Bilingual  Projects; 
the^Vocational  .Education  Act>  1968  Aipendments>  Part  D>  Exemplary  Programs; 
and  the  Right-To-Read  Program,    Their  malti-volume  report  includes:  a 
survey  of  the  literature  on  planned  change  in  education  and  the  develops 
ment  of  a  conceptual  model  of  factors  hypothesized  to  affect  change 
provesses  in  school  districts;  analyses  of  survey  data  .from  a  nationail 
sample  of  293  projects  in  18  states;  analyses  of  29  case  studies  of 
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han^  agent  projects  s^electcd  from  the  sanple  of  293  surveyed  earlier;; 
a  sumiaarv'^of  ftmiings  aad  possible  policy  tmplicattoas;  and  various  , 
technical  appendices,  ^  •       ^         ;  . 

The  study  was  designed  to  identify  which  factors  do  and  which  faotors 
do  not  proD.ote  change  at  the  lo<fal  school  district  level*    'Jhe  Innova- 
tions selected  all  involved,  the  creation  of  "temporary  systejfis"  designed 
to  bring  iibout  reforms  ''within  or-  through"  the  existing  school  district 
structures*    /rhe  conceptual  model  formulated  by  the  research  team  gave,  > 

particular  weight  to 'the  interactions  between  the  innovations  studied. 

^  *  ^  * 

and  the  institutional  settings  wherx^  th^y:  wer^  implemented,  "  The  research 
ers  hypothesized  that  the  innovation's  characteristics  as  implemented 
in  a  given  setting  would  be  affected  by:  the  innovation'^  lnit;ial 
characteristics;;  the  s.upport  it  received  in  the  particular^choal  dis^- 
trict;  the  characteristics  o£  the  institution^  that  changed  during  ^he 
implementation;  and  the  characteristics  of  t^e  institution  that  did  not 
change,     (The  Sand' team  explore^  a  broader  array  of  questions,  but  we 
will  focus  our  attention  priftiarily  on  this  ^^isperct  of  their  research^,) 

The  researchers  found  that  the  projects  rtiey  studied  differed  slgnifi-.^ 
cantly  in  terms  of  (and  as  a  result  of)  the  kinds  of  initiation  pro-  ' 
cesses  that  led  to  their  adoption. in  a  given  school  di'Strict,    In  some 
cases,  t^e  motivation  was  largely  opportunistic: '  mone^  was  available, 
and  sothe  district  decided  to  adopt  a  given  projej:t  even  though  there 
was  no  strong  commitment  in  the  ^iistrict  to  the  project 's'^mTLs  .  In 
other  c^ses,  the  adoption  decision-was  the  outcome^of  a  {Srocess  of  local 
problem-solving,    with  the  project  being  adopted  because  it.  was  sepn  as 
^meeting  a  local  need,     (HotvSver,  even  in  the  cdse  of  the  problem-solving^ 
mode,  the  innovation  was  usually  adopted  without  any  wide  "search  fcjr 

4 

alte-rnative^"  and  weighing  of  evidence  on  alternatives  designed  to.meetr 
the  district's  need.    Generally,  the  adoption  process  in  these  **p^'^hlera- 

L 

fsolving"  cases  was  based  largely  on  intuitive  approaches  to  assessing 
likely  effectiveness,' not  ijie  rational  decisionmalting  models*  generally  - 
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ass,ociated  ^^Ithj  problem-solving*  behavJLor  as  this  is  described' the 


literatur^O 

■  ^ 


^Four  kin4^.,^£^jAi^emenrtation  proces^ses  were  identified  from  tfte  data  ^ 
analysis:  '(a)  pro-fppna  j^^plementaMlon  or  "technological  learning^  (the 


project  was* implemented  without  modificatio 


n  or  any  effart  to  adapt. tlie 


institutional  setting  to  the  r^jfuirements  of  the^  innovat^ion;  (b)  coopta- 


'tion  (the\j,pro3ect  was  modified  to  fit  the  iistitutioaal  setting,  without 


Any  ad^pfion'of  the  institutional  setting); 


(c)  non- implementation  (the 


setcingj;  \ 

project  was  impl'finented  only  symbol i'ca^ly^btr  not  at  all);  a^lid  (d)  mutual 
adaptation '{both  project  and.  itistitutioti^l  setting  were  adapjied  to.  each 
dther)     ^  (Ue^onsi^iered  these  patterns  earlier  in  this' chapter, )  » 

The  tyfje  of  impl3feient;ation  process  found  in  a  giveil^ setting  depended  on; 

(a)  the  motivations  and  conditions  that  led  to  a  project's  being  imple- 

minted  (opportunitistic  vs,  problem-solving);  (b)  the  substance  and  sco^ 

'of  the  change  required  (how  co^Sprehensive  an  innovation,  how  congruent 

with  existing  arrangements/ etc.) ;  and  (c)  its  implementation  strategy, 

■ 

r   *  . 

Thos^  project^that  were  implemented  effectively  gen'erally  showed  the 

m^ual  adaptatipn  pattern.    And  only  projects  initiated  as  a  consequence 

-of  problem-solving,  (rather  than  opportunism)  sftowed  evidence  of  the 

A- 

.mutual  adaptation  .mode. 


Effective  implementation  strategies  included;  adaptive  on-line  planning 
.staff  tfraining  keyed  to  the  local  .setting  and  emphasising  practical  ■ 

classrooAi  issued  (rather^  than  theoretical  concepts),  local  staff  dcvel- 
jjpment  of  materials  (rather:,  than  external  development  by  consultants 

or  R&D  organ! sjj:iona)  >  and  allocation  of  a  "cr^^cal  mrfss"  of  staff  to 

the  project  to  insure  th^  the  project  did  not  become  isolated  and  was 

provided  with  needed  mutual  staff  support.  * 
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Ks  to  th^  substance  at^d  scope  of  change,  projects  ^atfwe^  iiSt^/Temented 
effectively  tended  to  be  those^  that  were  perc^ived^'^^I^h  .^^r.tprity 
items,  were  congruent  with  staff  values  and  3oals ,  ^epquf^^^di^^^'nges  in 
teacher  behaviors  4ind  also  required  comprehensive  cHang'^/iril^afe  beha- 
viors of  several  oth^^dif ferent  actors  in  the,  institutional  setting* 
5?eithef  jthe  type  of  technology  involved  in  a  given  project  or  the  re- 
source level  allocated  were  significantly  related-  to  the  success  of  the 
project's  Implementation. 

The  receptivity  of  the  institutional  sfetting  to  change  was  of  critical 
importauce  in  affectins  implementation.    E&pecxally  important  were 
staff  commitment  to  the  project,  high  teacher  morale,  teachf^  willing- 
ness to  invest  the  additional  energies  required  fey  the  changes,  and 
support  from  the  principal  an4tdistrict  administrators. 


Institutional  receptivity,  then,  was  an  essential  condition  for 
effective  impl^imentation ,    But  also,  needed  vere  implementation  strate- 
gies^ that  promoted  mutual  adaptation. 

At  the  classroom  level,  project  continuation  after  federal  seed  money 
ran  out  was  more  likely  where  the  innovation  involved  replacing  existing 
pftctices  rather  than  simpler  supplementing  them.    Continuation  was  also 
more  likely  whfere  the  implemenation  stage  had  included  training,  where 
that  training  was  focused  on  practical  problems  in  local  classrooms,  and. 
where  materials  for  the  project  were  developed  locally.  *  At  'the  district 


level,  however,  'coqti.nuation  decisions  were  based.ion  whethe^^^^or^oot 
district  oStici'^ls  viewed  the  proj*ects  as:  (a)  successful,^  ,(b).  affoxc^ 
able,     (c)"  related  to  district  priorities,  and    (d)  politically  accept- 
able.   Opportunistic  projects  were 'generally  viewed  negatively  on  at 
least  the'first  three  of  these  criteria,  wher^s  projects  initiated  as 
a  result  of  j>roblem-solvitig  were  more  likely  tq^e  viewed  positively  on 
^1  tour  poldts.   ^"...iri  effect,  the  pattern  of  expected  continua'tion 


this 


tended  Co  folliow  the  patt'ern  evidenced  daring  iiiltiation.  .It  is 
important  to  note  that  th*e  superintendents \perception  of  project. 

"success"  seemed  to'reEJect  attitudes  formed  during  initiation  rather 

t  70 
thSft  after  evaluation,  vhich  vaa  seldom  considered  seriously," 

The  rand  tears/  summarized  their  findings  follows: 


;       ^  bur  ddta  shov  that  a  receptive  institutional  getting  is  a 
^  necessary  but  not  a  sifficient  condition  for  effective 

implementatif^.    \h  implementation  strategy  that  promotes 
mutual  adaptation  is  critical ► 

The  main  factors  affecting'innovations  vere. the  institu- 
tional* settings  particularly  organizatsional  clipiate  and 
moti'vatiojSs  of  participants;  tWfe  iiopl'fementation  strategy 
:    ,    ,    employed  Dy  l<^*cal  innovators  \to  install  the  project  treat- 
?ien*t;  -and  th^  scope  of  change  implied  by  the  project 
relative  to^,its  sett/ng:    Neither  the  technolbgy  nor  the 
project  resources  nor  the' dif  fer^iit  federal  management 
'stra^etiea  influenced  outcomes  in  majt^r  w^s,  'Th«*>project 
,        outcomes 'did  not  depend  primaoly  on  "inpifcsV  from  outside^ 
.  but  on  interpal  factors         local  decisions, 71     ,  ^  ^ 

The  policy  implications  they  drev  from  this  vere  that  federal  poli-- 
cies  should:  (^)  'encourage  mutual  adaptation' strategies,   '(b)' help 
school  systems  develof>  tKe  capacities  tfiey  need  to  effectively  imple-- 
ment  innovations,  and    (q)  stage  federal  funding  for  innovations  to  * 

the  stages  of  the  innovation  pr*dcess,  to  make  certain  that  innovations 

*       '.  -  ^ 

are  not  only  adopted  but  al5o  imt}remented  and  then  incorporated^  into 

■  * 

existing  practice  and  also  perhaps  .to  support  the  capacity  building 
r<equired  for  success  in  each  of  the  stages  of  the  innovation  p 


>V^ess  * 


4,    Im!alications  of  the  Findings  from  Implementation  Research 


It  vould  seem>  on  the  basis  of^  the  findings  we  have  reviewed  in  this 
sectiSrS^  that  effective  implementation^  of  innovations  will  require 
considerably  mo-re  understanding  thah  we  have  now  about  tht;  implementation 
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process  and  its  requirements^  considerably Imore  ski^l  than  have  yet 
been  able  to  show  in  managinQ^fie  innovation  process,  and  the  develop- 


ment of  needed  capacities^^ii  Weal  school  districts  to  support  the 
innovation*  process. 

At  the  very  least >  we  need  to  understand:  what  kinds  ^  changes  are 
required  for  effective  implementation  of  different  kinds  of  innovations; 
how  commitments  to  these  needed  kinjis  of  changes  can  be  developed  more 
^ef  f  ectivelv; '  what  sorts  of  implementation  supports  are  required  for^  , 
different^  ki^nds  of  changes*  what  sor^ts  of  management  strategies  and 
skills  are  needed  to  effectively  manage  a  change  effort  throughout  all 
its  various  stages  (initiation,  implementation,  and  incorporation); 
whet^sorts  of  capacities  are  needed  at  the  school  district,  school.and 
classroom  levels  to  permit  effective- implementation  of  innovations; 
what  sorts  of  polities  are  most  likely  to  make  schools  more  receptive 
to  change  efforts;  what  sorts  of  mechanisms  are  needed  to  provide  an 
on-going  self-renewal  capacity  at  the  school  and  district  levels;  what  ^ 
sorts  of  di^sat;4sfaction  in  schools,  e^ist  to  be  capitalized  on  in 
^support  of  change*  effofts;  what  approaches  are  m6st  effective  for  over- 

^  * 

coming  initial  resistance  to  innovations  of  particular:  kinds  in  s(;liools 
^d  districts  of  various  kinds;  what  kinds  of  feedback  mechaTiisms  ^re 
^    most  effectiye  for  identifying  problems  that  energe  during  the  imple- 
mentation  of  an  innovation  an^  what  sorts  of  management  techniques  are' 
irtDst  effective  for  overcoming  thfes.e;  what  the  most  effective  balance  is 
likely  to  be  between  bringing'  in  external  resources  and  ceiling  upon 
internal  resources  to  support  the  implementation  of  different  kinds  of 
innovations,  in  different  kir3$  of  institutional  settings,  having  vary- 
ing  levels  of  internal  capacities  fqr  innovation;  what  kifnis  of  adapta- 
tions  of  project  and  institutional  setting  are  likely  in  a  given  instance 
and  how  mighV  thes^  behest  planned  for;  etc^  ^ 

Despite  the  accumulating  knowledge  base  in  areas,  such  as  OD,  few  if  any 
'  of  ^hese  research  questions  have* been  adequately  answered  to  serve  as 
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a  basis  for  poliq>'  development.    Lacking  are  not  only_  the^  answers  to 
the  questions  but  even. the  kiai  of  emerging  consensus' on  fundamental  ' 
questions  and  appropriate  methodologi-es  that  would  seem  to  be  needed 
as  a  basis  for  the  development  of  an  Ittiplemenation  research  field  of 
inquiry.    Iv'hat  wauld  seem  to  be  called  for  is  direct  attention  to 
capacity-building  concerns"  —  both  capacity  buildipg  on  the  school 
district  level  (to  support  effective  implementation  processes)  and 
capacity  building  in  the  research  community  (to  increase  the  likeli*- 

^  hood  of  our  finding  ^sounc  answers  to  some  of  these  questions  and 
directions,  for  developraent  work  tjo  further  enhance  impleTnentation  capa- 
city building  at  the  local  school  district  level).    Perhaps  in  time, 

N^ppJ^me nation  researchers  teaming  up  with  LEA  implementation  personnel 
can  develop  analytical  tools  tSj^at  will  enabl^  school  districts  to 
analyze  for  themselves;  the  imolementation  requirements  for  given 
innovatiotis ,  the  existing  regularities  in  school  functioning  that  need 
to^be  changed  to^support  an-  innovation's  implementation,  and  the  kinds 
of  mechanisms  and  management  strategies  they  will  need  to  increase^  the 
likelihood  of  effective  implementation  of  a  given  innovation  and  its 
incorporation  into  the  scKool's  standard,  routine  operating  procedures 
^nd  practices.    We  shall  have  more  to  say*about  th'is  shortly. 

J 

In  summary,  there  is  an  extensiv,e  knowledge  bade  about  operating  system 
norms,  values,  and  various  kinds  of  constraints  that  may  make  teachers, 
principals,  and  other  operating  system  personnel  resist  certain  kinds  of 
innovations.    Far  less  is  known  about, the  technical  problems  that  make 

,  innovation  difficult,  or  the  kinds  of  implementation  supports  needed  to 
'o^vercQme  these  problems,  or  evan  how  to  go  about  identifying  potential 
technical  problems,  assess  operating  system. capabilities  in  relation  to 
thes?  technical  problems,  or  design  trainijp  programs,  ^chnical  assis- 
tance roles,  or  other  required  implementation  supports.    And  there  is 
highly  suggestive .  eyidence  that  the  technical  PT^oblems  may  be  of  far 

'  greatar  significance  for  determining  the  fate       an  innovation  than 
attitudinal  problems.    More  practice-based  research  and'sysl^emattc 
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evaluation  of  iinpleinentation\support  strategies  vili  be  needed  ito 
develop  an  adequate  ltno>'ledge  base  to  permit  efficient  and  effective^  ^ 
attaok  on  the  technicaT  problems  of  inrj^ovation  impletnentation  in 
education.  *  '  \  ' 

IV,     RECENT  INITIATIVES  TO  STRENGTHEN  THE  IMI^LEMEHTATIQS/UTILIZATIQN 
FUNCTIONS  AJiD  IQCAL'  SCHOOL  SYSTEM  CAPACITIES  FOR  SEtP-RENEWAL 

Over  the  last  decade,  and  especially  in  the  last  three  or  four  years, 
there  has  been  increasing  federal' and  st.ate  attention  to  the  need  to 
provide  active  assistance  to  school  districts  in  acquiring  external 
resources  to  support  innovation  (information,  products>  programs,  expert 
consultants,  etc)  and  ^developing  their  own  internal  resources  to 
facilitate  innovation*     In  a  previoi/s  chapter,  ve  already  considered  in 
some  detail  tl\e  'shift  in  emphasis  in  federal  dissemination  policy  form 
relatively  passive  modes 'of  information  disseminatkion  tc^  providing  more 

active  assistance  in  gathering  and  tailoring  information  to  the  specific 

'  72  ' 

needs  of  a  particular  school  district-        In  addition,  in  recent  years 

several  new  fqnns, of  direct  sarvlce  to  school  districts  have  gained 
increasing  prominence  and  support  —  riot  only  the  school  study  councils, 
instructional  laaterials  centers,  and  various  forms  of  in-service  train- 
ing programs  that  have  been  around  for  a  while,  but  also  teacher  center^, 
technical^assistance  programs,  increasing  numbers  of  private  sector 
consulting  organizations,  and  various  state  and  Interstate  networks  of 
sfchool  service^  organizations ,    We  consider  some  of  these  never  forms  heTe 

1.    Types  of  Programs       ^  ' 

A  1975  survey  identified  well  over  1000  educational  linkagef  programs  in 
the  United  States, T    Some  were  of  the' traditional  information  dissemin- 
ation variety;    Otfters,  though,  vers  of  the  more  active,  implementation/ 
utilization  support  or  self **renewal  forms.    The  researchers  developed  a 
siX"fold  taxonomy  to  classify  ;the  variout  linkage  programs*  The 

V 

{     \     .  ■  ■ 
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diinensions  of  this  taxonomy  are  enumerated  in  Table  1A.2.    As  shown  here^ 
the  schenre  categorizes  litikage  programs  according  to:  the  level  of  spon- 
sorship  and/or  service 'provided  (national*  state*  regional)y^r  locap; 
the  institytional  base  (government,  university*  ^private*  etcV);  the  type--s 
of  seirv^ce  provided  (information*  instructional  materials j  technical  as- 
sistance* or  continuing  education);  the  focus  of  the  services  (general, 
subject  specific,  product  specific*  or  auSlience^^specif  ic) ;  the  type  of 
interface(s)  with  clients  (^int^  media*  or  "uman  interpersonal  services); 
and  the  source  of  initiative  for  undertaking  the  seirvices  (the  client  or 
the  staff  of  the  service  organization). 

Based  on  this  taxonomy*  the  research  teach  developed  a  classification 
scheme  of  more  than  40  different  linkage  models*  which  they  then  simpli- 
fied into  the  taxonotty  of  linkage  programs  presented  in  Table  14.3,  This 
listing  shows  ten  main  categories  of  programs,  along  with  sub-categories 
relevant  to  each.    Each  sub'-category  listing  is  foll^ed  (in  parentheses) 
by  the  name  of  one  example  of  a  program  of  i:his  type.    Thus  *  ERIC  is  used 
to  illustrate  ^fhe  first  type  of  linkage  program*  a  federal-level  Informa-^ 
tion  program  providing  general  information  on  a  wide  range  of  subjects. 
The  Research  Coordinating  Unit  of  the  Tennessee  State  Department  of 
Education  Is  used  to  illustrate  a  state  level  informatioa^ program  on  a 
focused  (rather  than  gen*eral)  area  of  subject  matter  (in  this  case^ 
vocational  education) «  ^ 

We  are  concerned 'in  this  chapter  with  programs  in  five  of  the  ten  main 

categories  listed  here,     (We  already  considered  the  programs  in  the  other 
«  ■  ^  -< 

five  categories  in  our  chapter  on  the  dissemination  function.) 
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■4V,  •  TABLE  1^^.2 

TAXONOMY  OF  EDUCATIONAL  LINKAGE  PROGRAMS  AND  SERVICES 

Level  o£ 'Sponsorship  and/or  Service 

National  '  ^  ^ 

Stato     *  ^    *  \       '  ' 

Regional    ^  ♦ 
Local 


Inscitutional  ^ase  or  Setting 

Government  j  Centralized 
Government ,  Decentralized 
Professional  Association 
University^ 
Private,  Non-Prof  it 
Private,  Fcrr-ProEit 
Consort turn 

Service  (s)  Provided 


[trf  ormation 
"instructional  Material-s 

Technical  Assistance 
,  Continuing  Education  ' 


General 

Subject  Specific 
Product  Specific 
Audience  Specific 


Interface(s)  with  Client 


Print 
Media 
Human 


rtakiti^ ; 


Initiative  for  Undertakiftg  Services 

Client  (Demand  Services) 
Staf^  (Scheduled  Services) 
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TABLE  14.3 
TAXONOMY  OF  LINKAGE'  PROGRAMS 


Inforiaation  Programs  and  Centers  ,    '  • 

Federal,  General  Subject  Matter  (ERIC)  *^ 

Federal,  Focused  Subject  Matter  (Special  Education  Instruc- 
"tional  Materials  Network  -  SEIMC/RMC) 

State,  General  Subject  Matter  (Project  Connnunicat^,  Kansas 
State  Department' of  Education)  '  ^ 

State^  Fpciised  Subject  Matter  (Research  Cbordinatfing  Unit, 

-Tennessee  State 'Department  of  Education) 
*^  \  ' 

Regional,  General  Subject  Matter ^(Research  Information  Ser- 

vices  for  Education^  Pennsylvania) 

Proprietary  *Infomation  Project,  Focused  Subject  Matter 
(XEROX  Curriculum  Clearinghouse) 


Teacher  Centers 

State  Consortium  (Texas  Teacher  Center  Project) 

Regional  Consortium  (Bay  Area  Learning  Centers-,  CalifcJrnia) 

University*-Base^  Individual  Center  (Workshop  Center  for  Open 
f      Education,  City  College,  New, York)  ^ 

Independent  Center  (Advisory  and  Learning  Exchange,  Washington) 

Residential  Center  (Teacher  Center,  Academy  of  the  Sacred  Heart 
Greenwich,  Connecticut) 

'Technical  Assistance  Programs  *  '  ^  ' 

Technical  Assistance  for  Planning  (Educational  Planning 
'"'Specialists  of  New  Jersey  Model  Cities  Program)  ' 

Consortium  for  Multi-Product  Implementation  (Northwest 
Laboratory/Far  West  Laboratory/Central  Midwestern 
Laboratory/Wisconsin  RiD  Center  Consortium) 
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Table  14.3  (copt,) 

Professional  Associatioirt  Programs 

Retrieval  Services  (School  Research  Information"  Service, 
Pfti  Delta  Kappa) 

Information  Collection  and  Synthesis  (Educational  Research 
Service,  independent  but  co-spensored  by  five  professional 
associations)  _  j  ^ 

*Muiti-Fahet^d  Information  Program  (AERA)  ^  - 

School  Study  Councils  ^ 

\  '  ;■ 

Emphasis  on  Staff  Developnient  -^etwork  of  Innovative  Schools, 
Massachusetts)  ^  ' 

\     -  .  ^ 

Emphasis  on  New  Product  Development  (Educational  Research  and 
Development  Council  of  *the  Twin  Cities  Metropolitan  Atea> 
Minnesota) 


broadcasting  for  Educators 

Information  Services  (KETSf^XT^S  -Arkansas) 
Brief  Workshops  (KET-ETV,  Kentucky) 
Longer  Courses  CIfflA-ETN-SCA>  Wisconsin) 

Publishing  for  Educators 

Professional  Books  (Education  pivision.  University  df  Chicago 
Press)  ,      ■  , 

Professional  Magasines  (Learning  >laga2ine)  '      *  ^ 

College  and  University  Education  Libraries 

Emphasis  on  Search  Services  for  Educators  in  Field  (Univenaity 
of  Indiana  Education  Library)  ^  ^ 


lO'Jl 
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TABLE  14,3  (cont 

9:      Inservice  Training 

College  Based  (California  State;  University  at  San  Jose)- 
Dlstrict-Based  (San  Francisco  Public  Schools) 

T 

10.      Miscellaneous  Linkage' Programs 

"  District-Based  Instructional  Materials  Cel^ter  (Itistruc- 
■      tional  Materials  Center,  Sunnyvale,  California) 

Evaluated  Pr^duit  Information  (Educational  Products 

Information  Exchange,  l^w  York)  •  .J. 

'  Pr^iecarv  Consulting  and  Research  Services  (Westing- 

house  Learning  Corporation,  New  ^York) 

State  Education  Agency  Consdlting  Services  (Consultants, 
Utah  State  Department  of  Education) 

School  Research  Of f ice- (Dade  County,  Florida) 

L 
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Teacher  centers  ma^'  be  singje,  independent  units  (such  as  the 
Washington-based  Advisory  and  Learniag  Exhcange  or  the  residential 
teacher  center  at  the  Academy  of  the  Sacred  Heart  in  Greenwich, 
"Connecticut),    Or,  they  may  be  affiliated  with  universities  (such 
as  the  Workshop  Center  for  Open  Education  at  City  College  in  New 
York  City),    Or,  teacher  centers  may  be  /linked  in  various  state 
consortia  (such  as  the  Jexas  Teacher  Center  Project)  or  regional 
consortia  (such  as  the  Bay  Area  Learning  Centers  in  California), 

The  idea  of  teacher  center  networking  received  strong-  endorse-* 
ment  from  NiE's  School  Capacity  for  Problem  Solving  Gr6up*    In  a 
planning  docucent,  the  KIE  group  described  their  interest  ih  'the 
teacher  centers,  and  especially  in  supporting  the  development  of 
networks  of  such  centers,  as  Epllows: 


The  strengthening  and  extending  of  networks  of  teacher 
centers  are  important  to  us  because  such  centers  per- 
form many  of  the  functions  essential  to  probl'em  solving 
as  an  effective  approach  to  school  improvement,  Tfte 
centers  we  find  most  proTq^lsl^S  help*ii^achers  solve 
their  own  problems  in  such  areas  as  classroom  manage- 
ment, the  creation  of  physical  and  social  en^ronraents 
fa^^rable  to  learning,  sel^ction^nd  implementation  of 
curricula,  individualization  of  instruction,  and  others* 
They  are  places  where  teachers  can  reflect  on  their 
concerns,  find  informat^ion  relevant  to  them,  work  out 
solutions,  and  get  help  in  carrying  them  out.  * 

+ 

In  addition,  such  teacher  ^centers  address  a  long-felt 
and  well  articulated  need  for  teachers  to  gain  control' 
over  tljelr  own  professional  development*    They  help  to  ^ 
reduce  the  isolation  of  the  self-contained  classroom* 
They  provide  a  climate  of  support  where  teachers  can 
excha.ng^  ideas  and  engage  in  joint  activities  without 
fear  of  failure.    They  provide . opportunities  for  teachers 
themselves  to  become  active  learners,-  to  develop  and  try 
out  curriculum  ideas,  to' engage  in  research  and  to 
continuously  grow  as  professionals.    They  carry  out  their^^ 
activities  through  the  voluntary  participation  of  t'cachers 
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Tne  N*TE  group  noted  t:hat>  at' the, time  they  were  <K)ing  their 
planning  in  1975 >  there  was  growing  interest  in  teacher  centers  — 
in  Congress>  in  professional  associations  such  as  the  tiEA  .and  AFT> 
and  especially  in  state  departments  of  education  wttich  "have  begun 
to  experiment  with. centers  as  the  priinary  mechanisms  for  deliver- 
ing staff  development  services."    However>  they  argued>  "There 'is 
little  reason  to  believe  that  these  efforts  will  be  inform^  by  the 
experience  of  those  who  struggled  for  many  years  to  develop>  adapt> 
and  refine  the  teacher  center  concept  —  unless  the  government 

engager  in  a  deliberate  effort  to  find  ways  of  linking  thesa  orig- 

75  ^ 

inators  with  emergent  centers-V 

Technical  Assistance  Programs 

Technical  assistance  programs  have  become  highly  visible  in  recent 
years.    They  may  be  government-funded  groups  (such  as  the  Education- 
al Planning  Specialists  of  the  New  Jersey  Model  Cities  Program*  or  ^ 
various  technical  assistance  centers  set  up  with  government  funds 
to  facilitate  implementation  of  various  kinds  of  categorical  legis-' 
lation  —  the  Emergency  School  Assistance  Act>  or  Title  IX  legis- 
lation>  etc,)'    Or>  they  may  take  the  form  of  consortia  of  various 
quasi-public  organizations  (f^or  instance>  the  consortium  establishe^d 
by  several^labs  and  centers  to  provide  assistance  to  school  district 
trying  to  use  their  products>^or  the  network  of  schools  established 
and  assisted  by  Research  for  Better  Schools  and  the  Pittsburgh  R&D 
Center  to  facilitate  the  implementation  of  the  IPI  program).  Or> 
a  technical  assistance  center  may  be  set  up  to  provide  assistance 
to  school  districts  trying  to^  implement  a  single  product  (an  example 
here  is  the  development  center  established  to'  a'ssist  schools  in 
implementing  the  Indiana  Social  Studies  Program), 

NTE  has  supported  two  studies  of  technical  assistance  groups  in 
recent  years>  in  order  to  increase  the  field's  understanding  of  what 

4 
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kinds  of  technical  assistance  strategies  nay  be  most  productive 

in  facilitating  school  improvement <    Both  studies  were  carried 

out  by  the  Centar  for  New  Schools,    In  the  first  of  th^se  studies, 

the  research  .team  produced  brief  descriptions  of-mare  tl^n-75' 

organizations  that  attempt  to  facilitate  educational  change  at 

76 

the  school/coirnnilnl ty  level.     ^  From  This  group,  they  selected  sr.:' 

organizations  for  in-depth  case  studies  and  described  both  iiv 
* 

individual  case  studies  and  cross-case  analyses):  the  history  of 
each  group,  their  current  method^  of  ^ntfirnal  functioning,  their 
philosophy  of  change  and  of  th^  role  of  a  tJechnicai  assistance 
group  in  the  cha^nge  process,  \n  aneiysis  of  two  technical -assis- 
tance projects  carried  out  by  each  group,  and  an  analysis  of  the  ■  , 

patterns  of  technical  assistance  Activity  provided  and  which  pat- 

77 


terns  weTo  most  effective  under  different  conditions, 
examine  their  finding  later  in  this  chapter, 


We  shall 


V 


^  - 


The  second  study  was  part  of  thf  Center  for  New  School*s  less 

ntation  9nd  Technical  Assistance  in  Urban  Schools 
Project,     The' project  had^  initially  been  developed  by"  NIE  to; 
(a)  document  the  problem-solving  process  as  it  was  carrie'd  out  at 
the  local  l&vel  in  model  projects;     (b)  use  the  documentation  dat» 
base  to  develop  technical  assistance  strategies  and  materials  which 
could  be  disseminated  to  and  used  in  other' school  districts;  and 
(d)  inc^ase  our  understanding  of  tJie  processes  through  which  . 
research  can  Inf otmjpractice  and  practice  can  inform  research, 
through  self-conscious  observiation  of  the  DTA  project's  function- 
ing in  a  research-on-*research  mode.    However,  the^project  broke  down 
* 

at  the  documentation  level,  provided  the  field  with  relatively 

'     "  78 

little  that  was  new  or  useful,      dnd  was  largely  terminated. 


C,      Broadcasting  for  Educatcfrs  and  In-Service  Training 


er|c 


V-Educational  television  and  in-^eirvice  training  have  been  used 
*  '    widely  for  some  time  now<    They  are  of  interest  to  us  h$re  because 
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of  their  potential. for  use  in  providing  trainipg^ to  support  the 
implementation  of ^externally  developed, innovationy^or  development, 
of  local  capacities  for  self-renevai  or  local  dJ^lopment  activ- 
ities.   Research  (particularly  the  Rand  studyS^  suggests  that  these 
prQgratns  are*  likely  to  be  most  effective  if  they  are  provided  vithi 
the  schc^  district  and.  if  they  are  tailored  to  local  conditions 
and  focusei  on  practical  is^es  arising  in  local  cl^ssroonis  rather 
than  on  theoretical  concepts  or  hypothetical  problems  or  cases- 


D*      ^^sultinj^  Services 


In  addition  fo  the  types  of  organizations  described  above,,  private 
sector  organizations  have  become  increasingly  conspic- 

\  the 


JUS  in  the  educatio  sector  "  providing  evaluation  services  or 
raining  programs,  diagnosing  district  needs  or  conducting  feasi*- 
bility  studies  for  proposed  innovation,  etc'-' .  Sifts  at. one  time 
ipearted  to  ^  significant  degree  through  sending  around  their  staff 
consultant  capacities *to  assist  school  districts,  and  at  least  * 
some  SEAs  seem  to  be*  showing  renewed,  interest  in  the  consulting 
approach  (for  instance,  the  Utah  State  Department .of  Education), 
Relatively  liftle  data  has(jbe,en  published  as  yet  about  these  variou 
c^sulting  arrangements  that  are  available  to  serve  the  field  of 
education.    Data  from  NIE's  Education  KPU  Monitoring  Program  organ- 

izational  survey,^vhen  it  becomes  available,  may  provide  some  o| 

.  .  ^     %  <?  ^  ■ 

th,is  needed 'infonnation,  :  ^    ^  ^ 

State  ^rid  interstate  Networks  * 

State  and  intersta^te  networks  do  not  represent  an  additional 
category  of  organizatioos  but  a  different  dim^sion  for  cla^sify-^ 
ing^ome  of  (the  organizations  already  noted  above.    These  networks 
hay^oeen  given  increased  visibility  and  some  increased  support 
through  NIE's  sponsorship  bf  its,  R&D  Utilization  Program-  ,  State 


\.  ■.  -, .  ■• 

V'  • 


networks  of  reg'lonal  ijitermediate  service  agencies  have  been 
developed  in  approximately  25  states,  and  some  other  states 
have  devel9ped  implementation  support  programs  using  other 
organizational  arrangements*    Interstate  networks  of  various 
kinds  have  also  ^een  in  existence,  to  link  schools.,or  districts 
dealing'with  similar  problems  or  using  siinilar  approaches* 
Examples  of  such  interstate  networks -include:  the  ES  '70  schools, 
the  Network  of  Innovative  Schools,  and  the  RBS  Network  of  Schools 
using  Individually  Prescribed  Instruction.     (We  considered  some 
of  Jthese  networks  earlier.)  *' 

* 

NIE's  R£[D  Utilization  Program  may  have  stimulated  the  development 

of  more  such  networks.    It  would  be  useful  to  gather  some  jiata  on* 

-*  ,  - 

whether  this  in  fact  hag^pened.    The  RFP  for  the  R6iD  Utilization 
79 

Program       called  for  proposals  from  existing  or  proposed  networks 
that  focused  on  "providing  servi<^  to  schools  to  implement  and  us 
existing  "research  and  developpient  (RfiiD)  outcomes-*'    The  long-term 
effects  expected  at' the  local  leVel  were  ^^escribed  as  follows: 

An  increase'  in  knowledge  on  thre  part  of  Bducational 
personnel  and  community  members  of  th^  existence, 
nature  and  utility  of^  refsearch  And  development  out- 
*'      «      c^mes ;  '  '  / 

^  ,  An  increased  number  of  formal  assessments  of  the 

potential"  of  specific  R^D  outcomes  fcfr  local  use-; 
_      "  ■  *  * 

■ 

^An  increase  in  the  instances  where  RfiiD  outcomes^tfr 
appropriate  adaptations  are  implemented  successfully;, 

^Art  abatement  of  local  problems  "as  a  result  of  the 
successful  implementation  of  R^D  outcomes  or  appro- 
priate adaptations  to  meej  local  needs. 

f 

*  ^ 

< 
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The  ttFP  specific  that  what  was  of  interest  to  NIE  were 
y  proposals  which  combined:  (a)  activities  to  implemeot  R&D  out-  ^ 
^comes  so  as*  to  help  solve  educational  problems;  with  (b)  sub" 
stantial  linkage  of  appropriate  agencies  (profit  or  non-profit  - 
agencies,  SEAs;  ISAs,  LEAs,  regional  or  national  K&D  agencies, 
colleges  and  universities,  professional  associations,  teacher 
centers,  information  clearinghouses,  community  gourps,  etc,)^ 
Specif ically>  tKe  BEp  indicated  that  NIE  would  fund  selected 
projects  organized  intp  four  configurations  of  implementation 
support  agencies r  (a)  a  scate-organized  system  of  intermediate  , 
service  agencies ;  .^b)  a  state  systeitt^not  using  intermediate  ^ 
service  agencies;  (c)  an  interstate  consortium  of  schools  organ- 
ized as  a  group  of  users;  and  (d)  an  interstate  consortium  of 
agencies  primarily  devoted  to  the  production  of  RfitD  outcomes  and/or 
the  delivery  of  technical  assistance  servicl^s, 


The  following  excerpts  from  the  RPP  should  provide  some  sense  of 

r 

the  kinds  of  la:nkages  NIE  had  in  mind: 

A  State-Organiged  Systetp  of 'Intermed'iate  Service  Agencies, 
In  states  where  formal,  state-authorized  or  created  sets 
of  intermediate  service  agencies  exist,  a  program  to" 
systematically  use  R&D  outcomes  to  help  solve  educa- 
tional problems  and  improve  ec|ucational  opportunity  may 
be  proposed.    The  project  would  focus  on  ths  intermedi- 
ate service  agency''  as  the  contact  point  and  primary 
source  (if  Services  to  schools.    Other  agencies  committed 
to  the  improvement  of  education  in  that  sta^  should  be 
involved  as  appropriate*    Included  would  be  the  SEA, 
colleges  and  universities  (such/ as  teacher  training 
divisions),  regional  or  national' educational  laboratories, 
and  other  relevant  agencies  or  groups.    The  proposal  could 
come  from  the  SEA;  a.  state-wide  or  intra-state  regional 
consortium  of  intermediate  service  agencies;  a  single 
intermediate  service  agency  which  has  ^  significant  ser- 
vice ;%rea  and  population  and  which  has  been  for||^lly 
designated  by  the  SEA  as  a  prototype  for  the  state;  a. 
college  or  u^iiversity;  or  any  public  or  priVate,  profit 
or  non-profit  agency;  th^t  represents  all  of  t^jie^parties^ 
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involved  in  the  state-organized  system  through  an 
appropriate  proj'ect  .governance  structure- 

A  State  System  Not  UsiiyR  Xntermediate  Service  Agencies. 
In  States  where  no  formal,  state  authorized  or  created 
set  of  intermediate  Service  agencies  exist,  a  program 
to  systematically 'use  it&D  outcoiaes  to  help  solve  ^ 
educational  problem^  and  improve  educational  opportun- 
ity may  also  be  proposed*    The  SEA,  one  or  more  polieges 
and  universities  (including  the  teacher  training  divi- 
sions) »  or  otjfier  agencies  coulB  serve  as  the  ciontact 
portit  and  primary 'source  of  services  to  schools.  Other 
agencies  committed  to  the  improvement  of  education  in 
that  state  ^hould  be  jjivolved  as  appropriate.  Propo- 
sals could  come  from  the  SEA,  a  college  or  university  or 
state  system  of  higher  education,  or  any  putlic  or  pri- 
vate, profit  or  non-profit  agency  that  represents  all  of 
the  parties  involved  through  an  appropriate  project 
governance  structure-; 

An  Interstate  Consortium' of  SchoQls  Organized  .as  ^a. 
Group  of  Users\    The  project  would  consist  of  an -inter- 
state consortium  of  users*    The  consortium  wolald  pro- 
vide>  or  contract  with  others  to  provide,  s^ervices  to 
implement  R&D  outccmies  to  help  splve  th^ir  educational 
p^roblems  and  improve  educational  opportunity  in  the 
schools  represented,^   The  key  differenc*"e  between  this 
category  and  the  one' that  follows  is  that  the  gover- 
nance of  the  project  proposed  in  this  category  is  in  the 
hands  of  a  consortium  of  agencies  fopnally  constituted 
by  state  action  to  conduct  instruction.  ;  Participants 
in  the  consortium  may  use  outcomes  developed  ty  others, 
but  inay  also  iJe  the  source  of  R^D  outcomes.  Consortia 
in  this  category  must  designate  a  single  public  or 
private,  profit  or  non-profit  agency  to  act  as  the  pri-^ 
\mary  contractor,  but  it  must  be  demonstrated  that  the 
governance  of  the  project,  wi^l  be  appropriately  shared 
by  the  eitt^e  consortium.    The'consortium  should  also 
observe  the  need  to  involve  appropriately  other  agencies 
committed  to  the  improvement  of  the^schools  served. 


hyi  Interstate  Consortium  of  Agencies  Primarily  Devoted 
to  the  Ijroduction  of  R&D  Outcomes  and^rfr  Delivery  of 
Technical  Assistance  Services.    The  croject  would  consist 
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of  a  consortium  of  producers  of  R&D  outcomes  and/or 
agencies  providing  services  to  schools.    These  pro- 
ducers must  have  organized  themselves  to  develop  a 
consumer-oriented  R&D  implementation  system  that  will 
help  solve  school-based  problems  and  improve  educa- 
tional opportunity*    This  coul'd  be  a  consortium -jof 
research  and  development  centers  or  laboratories,  or 
other  noHcProfdt  or  for  profit  producers  of  R&D  oOf 
c^mes,  of  sea's,  or  colleges  and  universities  with 
major  divisions  producing  R&D  outcomes*    SEA's  and 
ISA*s  nay  also  be  included  as  members  of  the  consor- 
tium as  appropriate*    A  single  agency  must  be  desig- 
nated as  prime  contractor,  but  the^^vemance  of  the 
project  myst  be  in  the  hands  of  the  consortium.  When 
appropriate  to  the  problem  addressed,  'a  consortium 
organized  undBr  this  category  should  also  observe  the 
need  to  involv^' other  agencies  committed  to  the  improve- 
ment of  the  schools  served. 


The  itFP  made  clear  that^'NIE  was  interested  in  all  four  different 
configuration^, ^ both  because  it  recognized  that  different  Con- 
figurations are  likely  to  be 'more  appropriate  to  different  sita- 
at^ns  and  because  the  Institute  wanted  to  develop  some  sense^of 
the  relative  e^f fectiveness  of  the  different  forms. 

One  of  the  most  interesting  and  encouraging  aspects^  of  this  RF? 
was  its  includsion  of  a  provision  for  a  **third  party**  research 
contractor  Uio  provide  the  field  with  an  understanding  of  what  is 
invoiced  in  successful  implementation  of  R&D-    The  RFP  stressed 
that  this  thirii  party  researcher  was  not  evaluating^ the  work  of 
the  various  contractors  participating  in  the  program.  Rather, 

this  '*research  on  research*'  work  would  be  focusef  on  learning  as 

* 

much  as  possible  from  the  project  about: 

ho:j  .to  bring  about  successful  R&D  implementation,  what 
the  key  variables  in  the  process  appear  to  be,  and 
whether  or  not  the  assumptions  behind  the  Institute^Js 
work  in  this  field  can  be  substantiated.    The  work  oT^ 
the  "third  party*'  research  contractor  will  be  directed 
at  the  general  areas  of  (1)  the  nature  of  information/ 
conimunication  flow  between  the  contractors  (and  suh-  ^ 
contraccors)  and  the  school  sites^  (2)  ^the  characteristic 


4 


1  i  0 


1135 


■i  .  I 

1 

K 

^  and  frequency  of  the  services  provided  >  (3)  the 

pattern  of  agencies  involved  in  providing  services , 
and  (i)  the  extent  to  ^;hich  Specific  organizational  . 
characteristics  of  the .  schoPl  sites  are  sy^stematicatly 
considered  in  providing  services.  # 

In  addition  to  these  sorts  o£  <}uestions,  we  n'eed  to  develop  some 
understanding  of  the  processes  involved  in  providing  the  various 
kinds  of  services  offered,  and         sorts  of  interactions  that 
produce  success  or  failure  in  implementation  efforts.    But  clearly, 
the  sort  of  information  called  for  here  in  this  RFP  is  vitally  \ 
needed  and  we  look  foryard  to  seeing  the  data  from  this  important 
initiative.  ^ 

One  other  ^oitit  should"  be  made  about  the  potential  for  future 
networking  activity  before  we  leave^this  topic-    A  1975  NIE  program 
plan  suggested  that  the  Institute  wa^  interested  in  making  at 
least  a  modest  investni^ent  in^  exploring  networking  for  rural 
education  and  also  for  parent  information  centers,  with  the 
latter  being  seen  as  an  important  resource  for  the  parent/commun- 
ity participation  movement  that  emerged  over  the  last  decade  and 
80 

a  half.       Aa  yetj  however,  it  is  too  early  to  expect  to  see  much  , 
progress  on  this  front,  but  initiatives  in  these  directions  would 
certainly  seem  to  be  warranted. 

2^.      Models  and  Strategies, 

There  is  not  as  yet  much-  of  a  highly  useful  literature  on  these 
various  change-orlentpd  organizations  or  the  strategies  they  use. 
Based  on  what^  has- been  written^^  the  one  thing  they  can  clearly  be 
said  to  share  in  common  is  an  approach  that  leans  toward  the 
clinical  change  model  of  working  with  clients  to  adap^innovations^, 
ideas,  or  information  to  local  circumstances,  as  contrasted  with 
the  R^iD  delivery  model  of  assisting  school  districts  in  acquiring 
standardized  products  dQveloped*T>y  external  K&D  organizations. 
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Within  JEhac  general  oriencacion,  a  dis\inccion  can  be  made 
betTu'een  models  which  rely  largely  on»  change  resources  brought 
in  from  oucside  che  operating  systrent  and  models  which  focus'on 
developing  needed  resources  inside  che  syscem.    The  key  element: 
in  che  discinction  seems  less  whecher  the  change  efforc  is  being 
directed  by  an  external  group  (such  as  a  training  or  cechnical 
assistance  organization  or  a  consulting  firm)  or  an  internal 
group  (such  as  a  school  district's  ceacher  trainers  or  a  district 
OD  or  renewal  teani)j  byt  rather  whether  the  effort  is -directed  at 
providing    resources  to  bring  about  change  or  developing  local, 
resources  to  facilitate  change. 


A.  Models 


istinguishe 


In  a  classic  article>  Ronald  Lippitt  distinguisned  six  models 
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of  research  utilization.       In  the  first  thre^>  knowledge  and 
practices  are  brought  in  fron  outside  to  change  th^  system. 
In  che  last  three>.  the  knowledge  and  practices  that  will  be 
the  basis  of  changing  the  system  are  developed  within  the  ; 
system. 

■  ^  r 

In  the  first  model >  a  consultant  identifies  and  defines  a 
problem  in  the  practice  setting>  retrieves  relevant  research 
and  theoretical  concepts  from^  the  field's  knowledge  base>  and 
uses  this  knowledge  to  design  an  approach  chat  will  solve  the 
identified  problera  and  thereby  injprove  practice. 


In  the  second  ::^odel>  a  n^w  program*  product*  or  practice  is 
developed  by  an  R&D  organization  external  to^ the  school  system 
This  externally  developed  innovation  is  designed*  tested*  and 
perhaps  also  demonstrated*  -qnd  chen  recommended  for  adoption. 
The  clienc  syscem  chen  adopc3  or  adapts  She  validated  model 
developed  elsewhere.         ►  ^ 
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The  thiTd  Qodel  involves  tTbe  identification^  validation, 
and  dlEfusion'of  exemplary  practices  developed  in  other 
school  systems^  and  especially  their  documentation  in  a 
manner  that  permits  t^ese  practices  or  programs  to  l)e 
used  elsewhere* 
» 

In  all  th,ree  of  these  models,  tften,  the  source  of  the 
knowledge  or  practices  this  will  be  used  to^change  a 
particular  system  is  located  out/ide  that  system;  This 
contrasts  with  the  other  three  models  which  focus  on 
developrndnu  within  tne  client  system  of  the  knowledge  that 
will  serve  as  the  basis  for  s4^1vlng  thje  system's  problems* 

Model  four  Is  referred  to  as  the  diagnostic  feedback  model* 
An  outside  group  of  researchers/consultants  gathers 

■X 

diagnostic  data  from  school  system  functioning^  focusing 
on  a  problem  the  school  system*  is  facing-    Tl^  reseachers 
then  analyze  the  data  arfd  provide  feedback  to  the  school 
system  for  their  own  use  in  solving  their  problem* 

Model  five>  the  Internal  action  research  model,  differs  . 
from  model  four  In  that  the  data  are  gathered  by  the 
school  system  personnel  themselves*    The  self-study  is 
conducted  by  school  system  staff  after  they  have  been 
trained  in  data-gathering,  analysis »  andf interpretation 
by  applied  'researchers ,  who  then  supervise  the  action 
research  process* 

In  the  sixth  and  last  models  the  training  of  practitioners 
Is  carried  one  step  further^  t^  d^%^lop  their  capacities 
for  fully  self-directed  local  problem-solving.    This  model; 
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focuses, on  the  idea  that  the  practitioner 
needs  direct  training  in  learning  to  be  a 
consumer  of  science  and  of  scientific 
ijesources  in  order  to  be  ah  Wfectiye  user 
of  scientific  knowledge.  ^-Hl^s  our  obs^^-* 
vation  that  the  desired  cWt^oration  between 
Che  consumer  and  the  scientist  often  is 
impossible  because  the  consumfe^>tfr  practi- 
tioner has  received  no  basic  training  in  how 
to  use  services  of  scientists  or  in  how  to  use 
inquiry  procedures  in  generating  their  own 
basfc  diagnostic  knowledge  for  the  development 
of  their  own  practice. 


There  are,  then,  a  range  of  organisifctioual  arrangements 
used  to  carry  out  educational  improvement  progr'ams,  some 
involving  *the  implementation  and  use  of  innovations 
developed  elsewhere;  others,  focusing  on  developing  in- 
tertill information  and  resources  for  solving  local  problems 
or  creating  self-renewal  capacities. 

■  i  * 
B.      Strategies  -  . 

We  do  riot  as  yet  know  very  much  about  the  strategies  used 
to  provide  implementation  supports  effectively.    There  is 
little  in  thd  literature  that  is  ufrftful  for  providing  ^ 
picture  of  the  kind^  of  strategies  tpat  promote  successful 
implementation  of  externally  developed  products  or  programs 
We  would  expect  sone  of  this  information  to  be  forthcoming 
from  NIE's  R&D  Utilisation  Program,  but  we  have  not  as  yet 
seen  these  results. 

Much  more  is  now  known  about  strategies  that  have  been 

effective  in  developing  local  capacities  for  change*  There 

is,  for  instance:  some  useful  litcraxure  on  the  existing 

8^ 

knowledge  base  for  the  degign  of  change  agent  progi^ams; 
and  there  are  even  some  training  pr^fgrams  and  resource 
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4  85 
D^terials  for  training  change  agents.       And,  as  we  noted 

earlier,  there  is  ^^one  very  usefiul  analysis  of  the  strategies 

86 

used  by  technical  assistance  groups,  ^ 

■  *    '  \ 

Examination  of  the  literature  suggests  .that  there  is 
significant  variability  in  the  patterns  of  functioning 
subsumed  unc3er  the  "change^  agent**  label.    For  instance,  one 
analysis  distinguished  four  general  categories  of  roles 
requiring  somewhat;  different  emphases  in  training  programs: 
(a)  programs  to  help  school  systenss  in  developing  a  self- 
renewal  capaclcy;  (b)  programs  ro  train  change  agents  orieneed 


toward  linking  the  school^system  to  external  resources; 

(c)  programs  to  bring  about  political  and  structural  changes 

ifk  school  *systeTns;  and  Cd)  programs  to  imprave  the  effective- 

87 

ness  of  other  educational  , agencies* 


Clearly^  different  kinds  of  strategies  are  likely  to  be 
effective  for  these  different  kinds  of  change  agent  foles. 
And  different  local  circumstances  are  likely  to  call  for 
different  strategies*    The^  Center  for  New  Schopls '  study  of 
technical  assistance  groups  (TAGs),  for  instance,  found  that 
there  was  no  one  "best"  strategy*    Rather,  what  worked  best 
in  a  given  instance  seemed  to  be- related  to  the  local  situa- 
tion.   Therefore,  they  argued,  what  is  called  for  is  the 
developinent  of  a  variety  o'f  approaches  tKat  can  be  .  responsive 
to  differences  in  circumstances  and  values  in  various  local 
settings . 

What  all  these  change  agent  strategies  seem  to  share  in  com- 
mon, though,  is  an  emphasis  on  the  practitioner         the  world 
of  educational  practice  —  on  the  practfSe  setting  as  the 
starting  point  for  change  efforts,  on  practitioner-initiated 
changesj  on  diagnostic  vQrb  in  the  practice  setting  be/ore 
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developing  solutions>  on  an  outside  helping  role  that  is 
as  non-directive  as  possibl'e>  and  especially  on  developir 
and  using  the  internal  resources  of  the  practice  setting* 

Thle  Center  for-Kew  Schools  study  produced  a  good  deal  of 
detailed  'information  about  the  processes  used  by  technical 
assistance  groups  and  some  of  the  factors  that  seem  to 
account  for  differential  effectiveness.    For  instanc^,  in 
the  long-term  face-to-face  assistance  cases  they  studied> 
they  found  that  the  groups  that  were  most  effective  were 
those  that:  (a)  were  most  skillful  in  mapping  the  social 
systens  they  were  trying  to  change;  (b)  focused  on  changing 
"central  rather  than  peripheral  Social  processes  and  struc- 
tures in  the  school  community";  (c)  provided  well  developed 
materials  in  addition  to  f ace7to-f aj^je  technical  assistance; 
id)  developed  their  technical  assistance  strategies  through 
a  pattern  of  periodic  self-conscious^  analysis  of  their  uork> 
followed  by  more  assistance-giving>  followed  by  review  and 
analysis  agian>  etc.;  (e)  functioned  through  a  process  o£ 
mutual  adaption  in  which  both  the  TAG  and  the  client  school 
system  were  adapting  to  each  other;  (f)  focused  their  assis- 
tance efforts  on  highly  specific  targets  rather  than  simply 
turning  facilitators  loose_  to  provide  any  forms  of  assistance 
they  decided  might  be  needed  (and  functioned  through  teams 
of  facilitators  in  giv'Sn  sites  who  received  regular  super- 
vision and  engaged  in  joint  anlaysis  to  lieep  them  on  target)!^ 
(g)  encouraged  independent  initiative  on  the  part  of  the  client 
^school  system;,  (h)  worked  to  promote  tliG  long-term  incorpor- 
ation of ^^Ke  changes  so  that  Che  effects  would  remain  after 
the  TAG  withdrew  from  the  school  system;  (i)  tried  to  trans- 
fer their  own  skills  and  knowledge  to  school  system  personnel > 
including  the  ability  to  map  the  env^roo^ent  and  use  cycles 
of  action  and  analysis  to  evaluate^^JL^s^f f ectivene^s  and  « 
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efine  their  tefchniques;  and-(j)  tried  to  develop  an  aware- 
ness in  school  personnel  that  they  were  developing  a  new 
set  of  skills  and  were  solving  probleins'j  and  perhaps>  too> 
that  they  were  part  of  a  broad  educational  or  social  move- 
ment of  some  consequence. 

In  addition>  the  CNS  TAG  study  produced  a  number  of  other 
important  findings.    One  was  that  there  was  very  little  of 
a  discernible  "ripple  effect'*  ia  the  change  efforjts  they 
observed.    Uliat  changed  (if  they  were  successful)  was  the 
specific  focused  target  of  their  efforcs>  but  little  beyond 
that.    If  tiiere  was  a  strategic  lever  In  the  school  structuro> 
it  was  the  principal  whose  attitudes  could  affect  change  iti 
a  range  of  areas-     Still >  there  did  not  seem  to  be  much 
evidence  that  producing  change  in  one  area  somehow  started 
a  chain  reaction  that  led  to  changes  in  other  areas* 
* 

A  second  important  finding  was  that  at  the  very  least  a 
successful  TAG  change^  effort  required  three  to  four  years 
and  probably  longer.    Funding>  however>  tended  to  be.  cut  off 
before  that>  and  so  the  fruits  of  the  long  process  were  often 
not  realized.    The  Implication  of  this>  they  suggested >  Vas 
that  funding  commitments  for  programs  of  this  kind  should  be 
made  for  periods  of  five  to  seven  years>  with  various  'evalua 
tion  criteria  built  in  to  permit  sponsors  to  3udge  progress 
along  the  ^ay. 

The  significance  of  the  entry  and  relation-building  process 
was  underscoi'ed  inthe  CKS  study*    This  period  was  alL- 
Important  for  the  future  success  of  the  change  effort  >  so  as 
to  establish  [the  credibility  of  the  TAG>  to  develop  a  mutual 
set  of  obligations  and  to  set  limits  on  what  was  and  was  not 
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to  be  expected  as  part  of  their  relationship^  and  to  ^ 
develop  realistic  notions  about  vjhat  could  (and  qould  no't) 
be  accomplished  over  how  long  a  period-  ^  ' 

Five  main  technical  assistance  techniques  were  identified: 
structured  experiences  (workshops) ,  "over-the-shoulder" 
assistance  and  advice  giving,  modelings  providing  matetiials, 
and  direct  intervention  on  behalf  of  the  client^  to  help  the 
school  system  do  something  (e.g*,  write  a  proposal  for  fund- 
ing) .    The  most  ef f ective  TAGs ,  according  to  the  CNS  findings , 
vere  those  that  used  various  combinations  of  the  first  four 
but  kept  the  last  (direct  intervention)  to  a  minimum  to  avoid 
dependency . 

One  of  the  most  useful  contributions  made  by  the  CSS  study  is 
their  analysis  of  "critical  activities"  for  TAG  functioning.  ^ 
The  CNS  researchers  defined  critical  activities  as  "those 
activities  carried  out  by. a  TAG  that  are,  based  on  our  data, 
most  important  in  establishing >and  maintaining  th^  TAG  as  a 
viable  organization  and  in  enabling^them  to  provide  appro- 
priate technical  assistance  seriic^."^^    The  critical  activ- 
ities they  identified  related  to  five  areas  of  TAG  functiorjing: 

(a)  formation  (forming  the  technical  assistance  group);' 

(b)  management  (establishing  and  maintaining  effective  inter- 
nal management);     (c)  funding  (obtaining  and  maintaining  funds); 
(d)  strategy  development^  (developing  assistance^  strategies) ; 
and  (e)  assistance  (carrying  out  specific  assistance  efforts). 
In  all,  a  total  of  100  separate  activities  were  specified- 
Clearly,  this  analysis  and  the. case  study  materials  should  be 
invaluable  to  any  TAG  group  or  otber  qrganizational  arrange-- 
ment  to  produce  change\ 
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Needed  Research  ' 


A-      Docmnentation  and  Process  Analysis 
■  *  * 

Whatever  knowledge  is  beginning  to  accumulace  about  effecCive 
.models  and  strategies  for  promoting  change  in  schools>  we 
clearly  need  considerably  more  process  analysis  and  ^^^^nta- 
tion  of  both:     (a)  the  processes  required  to  successf ully^^mple- 
ntent  and  institutionalize  particular  innovations  >  and 
processes  involved  in  providing  i^:ipler!ienCation  and  utilization 
supports,  ^  .  ' 

Schojol  system  personnel -need  to  be  provided  with  information 
about  how  to  take  a  project  description  which  elaborates  the 
substance  of  a  project  and  its  expected  effects  and  translate  , 
that  description  into  precise  ta^ks  and  activities  'and  the 
needed  skills>  sensitivities >  and  other  requirements  to  effec- 
tively carry  out  those  tasks  and  activit4es.    And  implementation 
and  utilization  support  personnel 'andMother  change  agents  need  to 
be  provided  with  p^rocess  "descriptions  indicating  how  to  carryout 
effectively^  the  tasks  and  activities  required  by  theiiT  functions* 
Descriptions  are  needed  from  successful 'models  indicating,  what 
happened  and  why>  and  what  one  needs  to  do  to  achieve  the  same  -< 
kinds  and  degrees  of  success  in  other  settings* 


r. 


The  difficulty  of  effective  documentation  and  analysis  is  under- 
scored by  the  less  t;han  adequate  outputs  of  some  of  the  attempts 

that  have  been  made  to  analyze  process  analysis  and  documentation 

91  '  '  * 

requirements      or  to  documefl't  and  analyze  given  projects  through 

>  ^  92      '  " 

case  studies  and  cross-case  analyses  •       However  >  there  are  also 

93 

some  few  nobble  successes  from  which  we  can  learn,  Cle^rly> 
cons  id^r^ibly  irlore  work  is  needed  in  this  area>  both  to  projduce 
the  needed  documentation  and  analysis  ^and  to  develop  a  body  of 
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effective  procedures  and  techniques  for  cai^rying- out  this  kiigfl 
ofi  work*       ^       ■      '  ^ 

Basi^^bata  gn'the  InSffiitutional  and  Personhel  Base  for 

-■  ^      These  Func^tions  .  » 

#   f  

the  recenc/  of  federal  awareness  of  the  importance  of  these 

fuhctioris^  ±t*^  not  particularly  surprising  that  we  are  lacking 

*    ^        ^  r>  ^  ■ 

_  even  the  most  basic  kinds  of  information  about  the  nature  and 

*  m 

scope  of  the  institutional  ■  and  personnel  base  available  to  be 
dravn'on  to  carry  0ut  these  fuifetioris*^  We  know  vejry  littje,  for 
instance,  about:  how  many  organizations' (or  orgahizatio^l  units) 
there^are  which  carry  out  these  fhnc^ionst  what  tVpes  of  organi- 
^zatjcxns  they  are;  ho^they  ^e  distributedT^eographieally  and  by 
services  provided;  how  many  school  districts  they  serve;  what 
strategies  they  use,  with  what  degrees  oJi*fef f ectiveness;  what 
kinds  of  changes  they  promote;  what  pers,onnel  bases  and  other 
resources  they  draw  on;  the  nature  of  their  linkages  with  KP  as 
well  as  ^  ^  other  linkage  organ^^zations etc " 

Some' information  usaful^  for  gauging  some  of  these  </uesVions  may 
be  provided  from  data  collected  bwNIE's  Educatioo'mljtonitoring 
Program  organizational  sut^ey.  yBut  since  implenientation  and 
utilization  are  not  f unc t i o AM^n e c i f ic a  1  ly'  addressed  by  this 
survey,  the  data  "are  P<^^W9S^F^^ -be ^  form  that  will  be 
immediately  useful  withon^H^  disagg/egakj^  and  examination*  of 
.su?^pjementai  backup  material/if  thi^  ij^*  even  possib^e^*  ^n  all 
ll*kelihbod,  new  ^ata  will  need  to  be  collected  to  ans^^er  ^question^ 
about  implementaion/utilizatkon  services  provided  an<^  received* 
W-ichouc  such  information,  we  vill  be  dev'elapin^  innovation  policy 
in  th^  dark,  without  an  awareness  of  what  structures  and  capa- 


bilities already  exist  in  the  edixcAtional  R/J)Sfi(I  systenLtoVe 

'  *  *  ■  ^  /•    '  \  ^ 

streh^^chened  and  expanded,  ^  *  '  \ 
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0,      NeedodT  Studies    '  ^  '  ,  ^ 

■  - "  """"    "       ^™  f- 

'  X 

throughout  this  chapter>  ve  have  tried  to  pinpoint  a"  number 
o£  .significant  questions  that  will  require  at  least  parSal 
anssers  before  we  will  be  able  to  design  sound  policies  to 
strengthen  and  support  the  imp^ffi^tation  and  utilization 
functions.    In  concluding 'this  chapter>  it  seem^  ^important  £ox 
US  to  suggest  some  needed  research  initiatives  to  explore  sone 
of  »these  questions  and  develop  a  stronger  knowledge*  and  tech- 

r  ■ 

nolo?^v  base  to  support  these  critical  Innovation  functions. 

At  the  very  least  >  there  appeaif  "to  be  four  areas  in  which  some 
conceptual  work  and  a  good  deal  of  empirical  work  are  needed: 
,(a)  understanding  the  processes  Involved  in  successful  imple- 
mentation of  various  type$  of  change  fonns  (adopting 'or  adapting 

, 'externallj^  developed  R&D  outcomes>  adopting  or^adapting  exemplary 
practices >  using  internally  9eveloped  information  and  Resources  ^ 
to  solve  a  particular  problem>^an^  deVeloping^-interpal  resources 
to  facilitate  change);  (b)  developing  a  clear  sense  of  the 
ran^e  of  variability  in  *operattpnal  settings  that  is  relevant  to 
different  implementation  requirements >  the  relative  significance 
of  motivational  vs»  technical,  problem*  for  different  types  o5 
change  efforts  >  and  the  opportunities  that  can  be  capitalized  on  . 
to  promote  change  in  practice  settings  as  well  as  th^e  barriers 
to  such^changes;  (c)  del;ermitiing**^the  range  of  existing  and  hypo- 
thetically  possible  organizational  arrangement^  to  support 
impiementdj^ion/utilization  and  cj^ge  efforts;  an3  (d)  determining 
the  types  of  chanae  support  roles  heeded  and. the  training  require- 
.lynts  and»  othi^  supports  needed  for  effective  functioning  in 

■these  roles.    We  consider  each  of  these  briefly  in  turn,  * 


V 


.  \ 
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a*      Types  of  Change  Forms  '  ^   '  ^ 

'    '  •  '  ■  ■  V::  ' 

There  are  clearly  different  implementation 'reguirfein€(Tlt^\^ 

involved  when  a  school  system  is  adopting  or  adap-tU-'tig  at!  *  ^ 

^  *        *  w  "  ' 

externally  developed  R&B  outputs  on  th^  one  haiiiv^bV  an  . 

'  exemplary  practice,  on  the  other-    Both  repre^sen:?^  change 

'         I   ^        ,  "■ '  ■  - 
forms  ^'which  the'*source  of, the  change  com€s  fr.fiiu^aUt^ 

^  .         .      ^  ^  ' 

side  the"given  school  system*    But  th^re  Vs^  a  gteater  like- 
lihood  of  ext^risiv^  packaging  of  the  new  prograia'-or_ 
practice  in  the  case  o£  th^  ^R^D- oytpUt  thad;  th^'.exemplary 
practice.    There  is  also  greater  lik.e,li1:^oi$.':tKat  the'  ^ 
develo|)ers  of-^he  R&I>  output  will  provide  print'ed  kimple- 
mentation  supports  and^even  i^pl^entation  siipgor^t  personnel* 
In  the  case  of  esfemplary  p^acticSs^  tK'^  likerSJiood  is^^jRat 
attest  the  adopting  school  system  msLy^be.  able  to  see  the 
practice  in  operation  in  one  or  more^^mbnsta^ation  sites* 
speak  with  its  developers  and  perhaps  others  who  have  used 
^e, practice,  andT>erhaps>  too>  be  proved^d  with,  validation 
information  and  perhaps  some  materials  for  use^in  the  imple- 
mentation effort.    But  in  the  case  of  the  exemplary  practice^/ 

*far  more  of  an  effort  is  likely  to  Le  required  to  understand 
the  innovation^  how  it  works>  and  , what  is  likely  to  make  it  , 
a  success.   .Wa  know  relatively  little  about  th£j;niple*menta- 
tion  requirements  of  these  dif^ferent  types  of  outputs-  And 
regardless  of  whether  the  output  is  an-ewtern^lly  developed 
R&D  output  or  an  exemplary  practice^  where  an  extensive 
amount  of  ''mutual  adaptation'*  is  likely  to  occur>  we  need 
to  develop  a  muc^h  better  understanding  than  we  have  now 
about  the  kirYds  of  adaptations  likely  for  different  types* 

^of  innoviitions  in  difftrent  kinds  Jffct institutional,  settings. 
Clearlyt  then,  we  need  well  funded,  carefully  documented 
analyses  to  develop  a  clear  underirt^nding ,of  the  kinds  of 
implementnt Lon/utilizat ion  requirements  to  be  planned  for 


: '  .P^occsses/of  locaJT^^i^  developing- selS** 

'^i'      -V^"         V        *        '  renewal \iga&aclties*  ',^e1:4*i-^\llkfely  to  ha  c'ortsidersble 
A'*-  ^//^-''^  "    '  ^\         ^>\'  ^         *     ^  , 

[^^rS*j:*if^i^P' bOcti':^sa\^me  are^s/(;hat:  are  clearly 


distincH/;  far",  it  t^akes  considj^rably^irKsre;^ .eff  ort  to  develop 
'  totally  ^ejf-alrected  r gn ewal^t:apf%^ ties  thsSi  stmply  to 
bring' In' 'eonsultaat  Histsrict  splve.^  paijtlcular 

problec^,;- 'good  deal .  9^  ^  cohsef^iual  wprjc  Jias  Already  been 
,  done  on ' vairious"  mod6l3  of  change  processes/    but  the  field  »  '  , 
nefefls  to  arrive  at  some*  :cdns$n3ps  *on  tlie  Ve^p^oints  *pf  ^- 

^"  '    '       ^ ;  ■     ■'  ■  '  ^  "  '\  *  ^ 

^  ,  difference  aVong  these  mod^e,!^  arid*  the  Tno$t  iinportant  pr'o-* 
^  ^   cesses  to  be  studies*    Wha'fe-  seems  'to  be  called  for  then,  ''^^^^ 

^vould  b«  carefusT  documentation-'atrd  analysis  of  ^these  various    \,  V/ 
mcfde'ls,  in  operation ^atid  what  Stoi-cs  of  chahge  agent, roles-  X  ^ 

''and  other  supports  are  needed' to' efiective^y  solve  problems  ^  - 

'-'^  and  develop  needej  capacities^  . 


'Given  the  range  of  xhange-orlented  prpgrarns  tliat  are  ^ 
federally  funded,  it  should  be  possible^  to  builds  into 
existing  initiatives  ^  requirement  for  third-party  docu-- 

^mentation  and  analysis,  to  be  carried  ouU^by  a  critical  mass 
of  talent^n  this -emerging  new  area  — ^  either  an  existing 
critical  ftiass  of.  talent^  or,  more  likely,  one  that  needs  to  be 
developed,  as  a  high  priority  in'  federal  support  of  educa- 
tit-nal  R/D&I. 


b-      Ran^e  of  Operational  Settings 

In  an  Interesting  analysis  of  the  extent  of  federal  - 
influence  In  edticqtion,  Michael  Kirs^t  argued  tjiat  most 
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large  scale  federal  eclucational  programs  are  oriented 
Coward  promoting  innovation  or  change,  but  relatively 
little  real  change  Is  discernible  because  the  federal 
money  is  filtered  through  layers  and  layers  o£  rigi'd 
sd^te  and  local  educational  sti^ctures  which  resist 
the  changes  being  promoted.    Thus  the  force  o£  this 
inoney  is  largely  diluted  by  the  time  it-  reaches  the  clas§- 
room  level. .  -  * 

Part  of  the  explanation  for  limited  change,  then, 
may  be  located'  at  the  policy  level,  where  decisions  are 
made  on*how  to  spe,nd  the  federal  funds.    The  dec^^ons 
\thst  are  maj&e  often  resist  the  intent  of  the  federal  pro- 
grams or  so  distribute  the  allocated  ^uhds  that  it  becomes 
impossible  to  focus  needed  resources  in  a  way  that  is 
likely  to  achieve  the  intended  out<:omes.  \ 

\-  '    \  ■      .  . 

But  t;h*^re  is  also  another  part -of  the  explanation,  located 
at  the  school  iand  classrcfom  level.    Here  we  are  referring 
to  the  technical  problems  encountered  in  implemejiting 
innovations.    Most  school  personnel  may  simply  lack  the  " 
skills  and  capacities  to  make  th^  required  changes*  In 
a  fascinating  analysis  pf  educational  practice  as  a  craft, 
David  Coh^n  focused  oft  the  experiential  basis  of  craft 
knowledge-    The  basic  pi^mise  of  His  argument  is  "that 
''eJucational  pjractice  tur/is  principally  on  experiential 
knowledge  and  .trained"  judgment"  that  can  best  be  passed  * 
on  from  master  teachers  td  apprentices  thorugh  various 
arrangements  in  the  practice  setting^ and  not  through 
na^tional  diffusion  systems  geared  to  disseminating  infor- 
mation and  products.     Cohen  argued  that  this  type  of 
experiential  knowledge  is  organized  around  critical  areas 
of  judgment  required  for  effective  practice,  that  such 
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knowledge  dan  be  generated  only  in  the  practice  setting, 
and  that  therefore  reform  depends  "primarily  upon  the 
\Tnpro\rement  of  experiential  knowledge  and  judgment  among 
praotitioners  by  improyiixg  the  settings  and  supports  which 
,  assist<  the  generation  of  such  knowledge  —  in  the  work 
setting  itself/'^^    In  sl/ort,  he  was  ^irguing  for  developing 
^n^ernal  school  system  c^pajcities  —  both  the  capacities 
that  define  eEfectlve  practice  and  the  (S!?t>acities  needed 
by  school  systeipS  to  direct  their  own  self-improvement 
practice.  ^    ,  -  ^ 

If  C.t>hen,,isxorreat,  this  sugge&t  the. need  to  develop  an 
understanding,  of  what  those  Vcritical  areas  of  judgment"  - 
a'te  ^nd  what  kinds  of  organisational  arrangements  and 
supports  promote  the  generation  and  refinement  of  experl-  *  . 
ential  knowledge  in  these  areas*    This  will  be  possible 
only  through  support  of  practice-based  research  focused  on 
these  questions,   ^  -    '  - 

Once  we  develop  answers  to  these  -questions,  we  tnay  be  in 
a  better  position  to  analyse  the  implementation  req,uire- 
ments  of  given  innovations  in  terms  of  the  kinds  of  experi- 
ential knowledge  that  n^ed  to  be  develpg^id  for  effective 
impreftDentation  of  thes^  Innovations,  we  may  also  be  in,  a 
better  position  to  understand  T^hy  some  school  systems  are 
^  more  effective  In  implementing  drinovations,    Is.it  that 
their^  personney'have  experience,  skill,  and'^well  devel6ped 
judginent  in  ai^as  relevant  to  given  innovations?    Is  it  that 
these  school  systems  have  the  kinds  of  organisational 
arrangements  and  supports  that  permit  this  klna\of  craEt 
knowledge  To  be  generated,  refined,  and  passed  on^from 
teacher  DO  teacher? 
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Of  course>  there  are  likely  to  be  other  key  factors  as 
well  that  warrant  some  investigation.    For  lnstance>  the 
innovation  literature  suggests  that  Innovation  flourishes*' 

i  in  setting  character^ized  by:  organizational  attitudes 
that  support  change  (free  communication,  high  morale > 

.support  from  administrators  and  colleagues);  clarity  of 
goal  structures;  organizational'structures  that  favor 
innovation  (e,g/,  decentralization  of  authority>  large 
numbers  of  occupational  specializations>  Structures  for 
se|f-renev:al);  professionalism  of  the  staff;  orgar:i2a-  ^ 
tional  autonomy  (i.e.,  the  opposite  of  organizational 


^Vulnerability");  and  few  strong  ves'ted  interests  in 

96  *  ' 

pr^serc£?:g  the  status  quo.      -         -     j  * 

We  will  need  to  do  considerably  more  practice-based 
research  to  determine;  what  factors  are  most  significant 
'in  affecting  implementation  r^equireirients  for  different  ^ypes 
of  outputs  or  change  efforts,  the  relative  importance  of 
motivational  v&,  technical  problems >  the  kinds  of  opportun- 
ities that  exist  to  be  capitalized  on  in  support  of  change, 
and, especially,  what  factors  are  most  critical  in  distin- 
guishing innovative,  from  non^innovative  districts,  "pace- 
setters" and  "salective^*  distVicts  from  the  *'faddist** 

districts,  and  all  of  these  more  innovative  types  from  th^ 

97  * 

non-innovative  "backward"  districts-        If  KIE  does  conduct 


the  survey  of  practice  that  has  been  indicated  in  some  of 

 ^          '  ,  98  ' 

Jthe  Instivtute's  planning  docum<er\ts,      these  matters  wou 

seem  to  warrant  priority  attention  in  the  survey  design 
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c.      Ranji€  of  Organizational  Arrangements  and  Supports  ■ 

There  is  already  a  good  deal  of  survey  infotmation  about 
the  speccrutn  of  organizational  arrangements  that  eJllst  to 
^support  iniplementation/utilizatioa  and  chatige  efforts, 
and  more  such  information  should  become  available  "from  NIE's 
RSD  Utilizatioa  Prograin,  the  organizational  survey  undertaken 
as  part  of  NIE's  Education  KPjU  Monitoring  Program  and  the 


NI5  survey  of  practices  (i 


I  this  latter  survey  is  conducted) 


,What  would  seem  essentail 


BS  a  next"  step>  though,  woiild  be 
documentation  and  analysis  of  the  key  factors  that  account 
for  Success  or  failure  in/ each  of  these  organizational  forms 
ahds^iso,  perhaps,  a  colKJ)orfetive  brainstorming  effort  by 
key  leall^rs  in  the  afield/ to  arrive  ^t  other,  hypothetically 
possible  and  feasible  arrangements  or  supports  that  would 
seem  to  be  needed  but  npt  yet  found  in  operational  settlings* 

d.      Change  Roles  and  ^rainin^  ^equireisents 

/    *  '  * 

Finally,  given  the  limited  personnel  base  that  exists  to 
carry  .-Out  implementation/utilization  or  change  support 
activities,  it  would  seem  essential  to  elaborate;   (a)  the 
range  of  roles  calle<^  6or  by  the  existing  (and  perhaps,  too, 
the  hypothetically  possible  and  feasible)  organizational 
arrangements  and  supports,  and  (b)  the  training  requirements 
for  these  roles.    Development  of  the  needed  training  programs 
would  then  seem  "to  be  a  high  priority  item,  especially  if 
Chese_ programs  can  be  developed  in  practice  settings  by 
highly  effective  implementation/utilization  support  and 
change  agent  personnel,  using  clinical  approaches  to  train- 
ing, that  can  he  documented  and  analyzed  to  facilitate  the 
development  of  similar  programs  elsewhere! 


Ill" 
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Conclusions  * 


There  is  overwhelming  evidence  that  the  processes  carried  out  in  the 
practice  setting  -  either  to  implement  and  use  exterpally  developed 
programs  oc  practices,  or  to  develop  local  solutions  to  proble:ns  — 
are  critical  in  accounting  for  the  outcomes  of  the  whole  innovation 
process*    Clearly,  then,  investing  heavily  in  the  various  other  func- 
tions of  the  innovation  process  while^neglecting  implenientation/utili- 
zation  and  change  supDort  processes  vithia  schools  may  mean  that  the 
suSstantial  investnient  already  made  in  educational  innqyation  will  not 
bear  fruit  in  producing  the  iiitended  eiiucational  improvement. 

Federajl  policy  has  begun  to  take  cognizance^  of  this.    But,  clearly, 
considerably  more  needs  to  be  done,  and  considerably  mbre  first-rate 
policy  thinking  neecte" to  be  directed  at  strengthening  and  expanding 
these  key  functions  in  educational  R/d&I- 
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Psychology,  Vol*  5," Gardner  Lindzey  and  Elliot  Aronson,  eds *  (Read- 
ing, Mass.:    Addison-Wesley,  1968);  Robert  Dreeben,  The  Mature  of 
Teaching:    Schools  and  the  Work  of  Teachers  (Glenview,  111*: 
Scotc  Foresnian,  1970;  Philip       Jackson>  Life  in  Classrooms  (New 
■York:^  Holt>  Rfnehart  and  Winston,  1968);  Dan  C.  Lortie>  School- 
teacher:   A  Soci-trlogical  Study  (Chicago:    ^University  of  Chicago 
Press>  1975);  Ronald  Corwin,  A> SocioloCT  of  Education:  Emerging 
Pacterus  of  Class^  Scetus^  and  Power  in  the  Public  SchooJs  (New 
York;    Appleton-Century-Crof ts,  1965);  Ronald  Corwin  with  Willord 
Lane,  Foundations  of  Administ  ration  in  Education :    The  Beh^vio ral 
Settina  (;^ew  York:    Macmillan,  1967);  Ronald  Corwin,  "The  School  as 
a  Eonaal  Organization,"  Encyclopedia  of  Education  (New  York;  M^c-- 
millan,  1971);  Jame's  Fennessey  $nd  Mary  Sexton  McDill,  "Elementary 
Schools  as  a  Social  ^ystem,"  Encyclopedia  of  Education  (Kew  York; 
Macmillan,  1971} ;* Richard  0.  Carlson,  "Barriers  to  Change  in  Public 
Sehools,"  in  Change  Processes  in  t>ie  Public  Schools  (Eugene,  Oregon: 
Qenter  for  the  Advanced  Stu4y  of  Educational  Administration,  Universi-- 
ys  of  Oregon,  1965);  and  Sam  D.  Sleber,  ^^'Organizational  Influences  on 
Innovative  Roles >"  in  Know&.edge  Production  and  Utilization  in  Educa- 
tional Administration,  T.  L*  Eidell  and  J.  M.  Kitchel,  eds  *  (Eugene, 
Oregon:    Center  fof  th^  Advanced  Study  of  Educational  Adujinistratiott, 
Universitjr  of  Oregon,  1968).  ^ 

For  instance,  see:    Neal  Gross,  Joseph  B.  Giacquinta  and  Marilyn 
Bernstein>  Implementinfi  Organizational  Innovations:    A  Sociological 
Analysis  of  Planned  Educational  Change  (New  York:     Basic  Books,  1971); 
L*  M*  Smith  and  P*  M*  Keith,  Anatomy  of  Educational  Innovation  (New 
York;    Wiley>  1971)  ;XSarason,  The  Culture  of  the  School,  pp.  cit>;  and 
the  publications  produced  as  output  by  the  Rand  Corporation's  Change 
Agent  S;tudy;  cited  above  in  footnote  3. 

See  especially  Sarason,  -The  Culture  of  the  School,  op>  cit> 

For  instcince,  see  surveys  reported  in:    John  Lindeman  et  al.  ,  Sone 
Aspects  of  Educational  Research  and  Development  In  the  United  States  - 
Report  for  the  OECD  Review^  Final  Report  (Syracuse:    Syracuse  Uni-- 
versity  Research  Corp.,  1968);  Office  o£  Education>  Educational  Re- 
search and  Development  in  the  Uniged  States  (tif^shington:  OE,  1969); 
and  Ronald  G.  Havelock  and  Mary  C*  Havelock,  Educational  Innovation 
in  the  United  Stateg  (Ann  Arbor;    Center  for  Research  on  the  Utiliza- 
tion of  SicentiEic  Knov?ledge>  Institute  for  Social  Research,  Universi- 
ty of  Mchigan,  1973)*    Also  important  in  this  category  is  an  e:tamina- 
cion  of  classrooms  where  innovations  w^er^e  reported  as  being  used>  bu,t 
observation  indicated  the  innovations  disappeared  during  implementa- 

J 


tlotw    John  I,  Goodlad,  M,  Frances  Kle^n,  et  ql^  >  Behiad  the  Class-  ; 
room  Door  (Worthlngton,  OhiD:    Charles  A,  Jone's  Publishing  Co.,  , 
1970). 

y 

Bermhn  and  McLaughlin,  Federal  Trogfams  Supporting  Educational 
■  Change,  Vol,  I:,  A  Model  of.  Educational  Change,  op,  cit> 

Especially  important^  here  are;    Goodlad  et  al*.  Behind  the  Classroom 
Door,  op\  cit>;  Gross,  Giacquinta,  and  Sernstein,  Implementing  Or- 
ganizational Innovations,  op>  cit,;  Smith  and  Keith,  Anatomy  of 
Educational  Innovations,  op.  cit> :  and  Sarason,  The  Culture  of  the 
School ,  op,  cit. 

For  more  on  this,  see  Especially  Miles,  The  Teacher  Center,  op>  cit> 
ancj  Matilda  Butler-Paisley,  William  Pa'isley  et  al,^  Communication  ' 
for  Change  in  Education:    Educational  Linkage  Programs  in  tbe  1970's 
(Stanford:    Institute  for  Conimunication  Research,  Stanford  Universi- 
ty, 1975) ,    ,  ^  - 

See  especially  Center  for  New  Schools,  Assistance  Strate^l^s  of  Six 
Groilps  That  Facilitate' Educational  Change  at  the  School/Community 
Level,  op.  cit.    See  both  the  case  studies  described  in  Volume  I  and 
the  comparative  analysis  presented  in  Volume  II,    Also  see  descrip- 
tions of  technical  assistance  groups  in  a  number  of  projects  that 
have  been  studied  by  the  Center  for  New  Schools,  cited  as  follows; 
Rural  Education  Program,  Basic  Program  Plans  (Portland:  Northwest 
Regional  Educational  li^aboratory,  1972);  Wendy  Gollub,  Affective  Edu- 
cation Development  Programi    Research  Report,  1970-71  (Philadelphia; 
Publii;_Schools,  1971),  Mimeo;  Anne  M,  Busis  and  Edward  A.  Chittenden, 
Analysis  of  an  Approach  to  Open. Educations    Interim  Report  (Prince- 
ton:   Educational  Testing  Service,  J.970);  National  Sch5ol  Public  Re- 
lations Association,  Individually  Guided  Education  ""and  the  Multlunit 
School  (Arlington,  ^Virgini'ai    The  Association,  1972);  Superintendent 
of  Public  Instruction,  School-Community  Assistance  Process:    An  Over- 
view (Helena,  Montana:    Author,  1972);  Manford  L-  Holmes,  An  Examina- 
tior^  of  Two  Technical  Assistance  Styles  Within  One  Project  (Chicago; 
.Documentation  knd  Technical  Assistance  in  Urban  Schools,  Center  for 
New  Schools,  19)77), 

See  the  sources  cited  above  in  footnote    4-    Also,  the  AERA  annual 
meeting  programs  for  every  year  as  far  back  as  at  least  1973  show 
several  sessions  each  year  devoted  to  OD  topics  -  paper  sessions,  dis^ 
cussions,  symposia,  and  criticjue  sessions, 

t 

For  instance,  see  National  Institute  of  Education,  RFP  for  Studies  in 
the  Utilization  of  R6tD  in  Education  (Washington;    NIE,  1976),  HIE- 
R-76,-0006;  and  see  especially  Linda       York,  Arrangements  and  Training 
for  Effective  Use  of  Educational  R6tD  Information:    A  Literatutl  Survey 
(Berkeley:    Far  West  Laboratory  for  Educational  Research  and  Develop- 
ment, 1968)- 
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For  Instaice,  see  Butler-'Paisleyj  Paisley,  et  al.  >  Communicaiiion 
■g^or  Changej  in  Education^  op,  cit,      '      '      '  * 

See  especially;    Ronald  G,  Havj^lock,  The  Change  Agent's  Guide  to 
Innova  t  ion '  in  ^Edieca  t  ion  (Englewood  Cliffs,  New  Jersey:,  Education-- 
al  Technology  Publicationi,  1973);  and  Ronald  G.  HavelQ^k,  Training 
for  Change  Agents:    A  Guide  to^ the  Design  of  Training  PtoR^ams  in 
Educatior^and  Ot4ter  Fields  (Ann  Arbacjpenter  for  Research  on 
Utilization  *of  ^Scienti^ic  Knowledge,  ^(Utitute  /or  Social  Research/ 
Universi6r  of  ^lichigan;  1971), .ERiC  W'J^h  259, 

;Ron^ld  Lippitt,y'Th^  Use  o^^  Social  Research  to  Improve  Social  ^^^J^j^ 
tice,"  iq  The  Oregon  Studies  in  Research^  Development,  Diffusion  arJ^T^ 
Evaluation,  Vol.  II:    -The  Literature  of  Educational  RDD^Ei  Bette  C. 
Porter,^  ed*  (Monmouth,  Oregon;    Te^fhinj  Rfc^areh  Division,  Oregon 
S^cat^'  iyst^aof  Higher  Edui;ation;  1972).  :  v 

Pincus,  "Incentives  for  Innovation  in  the  Poblic  Schools^'*  op^  cit. 

For  instance,  Wee:    Lindeman  et  al. ,  SonMBL,.Aspgcts  ■  of  Educatdonal^ 
^Researcfr  and  Development  in  the  United -^,tat'es,  op.  cit. ;  aleo  OE, 
Educational  Researigji^  and  Devel6pmenL  in  the  United  States,  op^  cit. 

Of^ourse,  others  have  concluBed  just  the  opposite,  i\e*,  that  the 
rat^e^of  change  in^schowls  has  been  **glacial***    For  inst;&nGe,  see; 
Paul  R*  Mort;  "Studies  in  Educational  Innovation  from  the  Institute 
of  AdEninistratiVe  Research:    An  Ovetview,"  in  Innovation  in  Educa- 
tion, Matthew  B.  Miles,         (New  York;    Bureau  of  f ablications , 

Teachers  College,  Columbia  Uni^versity,  1964)*^ 

-       ■  :  ^  ^ 

K  ■  ) 

t^oodlad,  Lein  et  al* ,  -Behind  The  Classroom  Door,  op*  cit.  ^ 

, The  best  Single  source  on  this  is  Sarafan,  The'>Culture  of  thelfechool, 
op.  cit.  -  Other  good  sourcas  on  tJhis  include:    Gross,  Gi^.(^^nta, 
4nd  Bernstern,  Implementing  Organizational  Innov^j^ons,  op^  cit.,; 
and  th€  Ran<^  Study  cVted'  earlier  in  footnote  3*  *  '  -  . 

See  our  c^iapt^r  on  the  development  furi<Jtion  in  ed*:a^ionai^/D£[I* 

See  the  Rand  Study,  especially  Benaan  and  McLaughlin,  Federal  Pro- 
grams Supporting, jjiucational  Change,  Vol,  JV;    The  Findings  in  ^ 
— iew,  -op,  cit.  \  '  ^        .  ■  « 

'hce$  cited  above  in  footnote  3*  * 

McLau|tf^^i?^nd  Bertnjn,  Matro  and  Micro  Implementation,  op*  cit:,  pp.  5-6 

Pincus," ''Incentives  fo#- Innovation  i^  ^e  PublicHSchoolsT'^  op>f,cit^. 

S^e  especially  Wilaon,  Explorations  of  the  Concep         Local  CapacityV^ 
^or  ProBlem  Solving,  op.  cit.  -  '  .  - 

■  x\ 
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Pincas,  "Incentives  fo 
op*  cit. 

This  discussion  draws  Jieayily  on:    Carl^n,  "Barriers  fb  Chari^e 
in  Public  Sctyols,"  op,  c\t. ;  P^.nc<is,  "Iticentives  for  Innovation 
^in  the  Publi^  Schobis^"  op.  cit,;  and  Sieber,  "Organizational  Irt^ 
fiuences  on  Innovative  Roles,"  op^  clt,  \ 

Ci^-lsan,  ^Barriers  to  Change  in  Public  Schools^^*  op,  cit  > ,  pj>.  6-7*  ^ 

.See  our  chapter  on  environaaental  influences  on  educational  r/d^I* 

Si-eber^  "Organizational  Influences  on  Innovative  Roles,"  op,  cit*; 
Pincus,  "Incentives  for  Innovation  in  the  Public  Schools,"  op*  cit, 
.and  Matthew  B*  Miles,  "Mucational  I  nnovation:    The  Nature  of  the 
Problem/'  in  Innovation  in  Education,  Miles,  sd*,  op,  cit*,  p,  40- 

Some  sense  of  the  multiplicity  of  educational^goals  can  be  developed 
f rom^glancing  through  Benjamin  S*  Bloom,  Taxonomy  of  Educational 
Objectl^ves:    The  Classif i,cation  of  Educational  Goals  (New  York;  Long- 
mans, Green  and  Co*,  1956),  * 

Most  notably^  see:    Christopher  Jencks  et  al, ,  Inequality:    A  Reassess- 
ment of  the  Effect  of  Family  and  Schooling  in  America  (New"  York:  Basic 
Books,  1972);  James  S,  Coleman  et  al* ,  Equ^fclty  of  Educational^ppor- ^ 
tuni-ty  (Washington;    U*  S:  Government  Printing  Office,  1969}**"  Jhere^, 
is *also  a  sizeable  literature  on  the  influences  of  SES  background,  of 
peers,  of  television  and  other  communication  media,  etc* 


Sieber^  "Organizational  Influences  on  Innovative  Roles,"  op*  cit* 

^bidv    The  fon?^pts  come  form  Sieber:    We  have  added<the  examples*- 

See  especially;    Corwin,  A  Sociology  of  Education,  op.  cit,.;  Corwin  ^- 
and  Lane,  Foundations  of  Administration  in  Education,  op*  cit, ;  Corvln 
"The  School  as  a  Formal  .Organization,"  op?  clt.;  and  Bldwell,  '*The 
Schc^^  as  a  Fqrmal  Organization,"  op.*  clt* 

Xb±J, ;  also  see  Sieber,  "Org^niBational^  Influences!  on  Innoyative  Roles,* 
op»  clt  * ;  Art  Gallaher,  Jr*,,  '^Direct^d  Change  In  .Formal  Organizations: 
The  Schopl  $ysteni^"  In  Carlson  et  al*.  Change  Processes  in  the  Public 
Schools,  'Ofi*  icit* ;  Sloan  R*  Wayland,  "Structural  Features  of  American 
*  Education  as  Kaslc  Factors  in  innovation,"  in  Innovation  in  Education, 
Miles,  ed*,  op*  cit.  '  75  ^ 

See,  for  instance;    Sarasori,  Jhe'^Culture  of  the  SchooT,  op  *  cl  t  *  *0n^ 
the  consequences  of  this  for  innovation,  see: y  Daryl^  Hobbs,  "Facili^* 
tating^  the_  Change  Proce^  In  AgrLcuttural  Zducat*lon,"  in  The^C^egon 
Studies^  VoJ*  II,  Porter,  ed. ,  ,op,  cit , ;    and.Mort,  '/Studies  in-Educa- 
-tional  tnnovatJfon  from  th.e^  Instittfte  of  Administrative  R^s^earch," 
QPy  Cit*  .  ^      .     *  ' 
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52.  This  pact&rn  is  not  quite- as  prevalent;  as  it  used  ta  be  now  that 
there  is  more  teani  teachings  cluster  teaching,  teaming  of  several  , 
professionals  together  in    large  "open  classrooias,*'  use  of  parapro?- 
fessionals  and  aides,  etc.    Still,  the  single  teacher  in  the  self- 
contained  classroom  remains  the  predominant  pattern.  ^ 

53.  Sarason,  The  Culture  of  the  S<?hoQl,  op ,  ci t .  /  ' 

.  ^    '  '    ^  '  /  ' 

54.  '   Wayland,  "Struftfural  Features  of  American  Education  as/Basic  Factors 
^         in  Inhovation,"  op>  cit> 

55.  For  instance,  see:    Matthelr  >liles ,  *'A  Matter  of  Linkage;    How  Can 
Innovation  Research  and  Innovation^Practice  Influence  Each  Other?" 
in  IiJhat  Do  Research  Findings  Say  Aboirt  Getting  Innovations  Into 
Schools:    A  Symposium,  Sanford  Temkin  and  Mary  V,  Brown,  eds.  (Phil- 
adelphiii:   Research  for  Better  STWtols,  '1974).;*also  ste  COPED  (Coopera- 
tive Project  fort  Educational  Development),  Final  Report,  COPED  Data 
Analysis  Project Tyrolect  No,  8-0069,    OEG- 3^-0800^9-004 3  (OlO)  , 
(Washington:    OfMce  of  EdQcation>  1970),  Vol,  Iv  Resear.ch  Outcomes; 
Vol,  2j^Case  Stujies;  'Vol,  III,  Diaanosing  the  Professional  Climate 
o£*i.'our  School^  ^Appendix:    Instruments  and  Code  Manuals  * 

56,  Se^'O^r  chapter  on  information  flows.       ^  %  ^ 

57,  *  For*  iii^nce,  see:    Sar^son,  Ttf^.  Culture  of  the  Schpol ,  gp ,  cit,;  ^ 

Roland  3\  PelleRrin,..An  AnaT^^is  of  Sources  and  Processes  o£  Innova- 
^         tion  in  Education  (Eugene^  Oregon:    ^^i^tier  for  the  Advanced  Study  o£^ 
Educationa^^minist ration.  University  of  Oregon, -1966)  . 

58,  Miles,  ''A  Matter  of  Linkage,"  op,  ^git,    f,  ' 

59,  Carlson^  "Barr^G^s.  to  Change  is  Public  Schools,*'  op.  cib. 

60,  For  instance,  see  Ronald  6,  Corwin>  ."Strategies  f^c^Organizational 
Innovation:    An^  Empirical  Comparison,"  Ameifican  SocloloM^al  Review, 

-     Vol.  37,  August  1972),  ^  * 

61,  For  instance,'  see:    Lindeman  et  al>^    Some  Aspects  ^of  Educate  ^^^jj^  ^ 
Research  and  Development  in  the  United  States,  op.  j:it , ;    OE,  Ed uc ac- 
tional Research 'and  jDeveltopinsnt  in  the  United  States,  op>  cit* ;  J . 
Victor  Baldridge  an3  Rotert  Bui'nham,  The  A<ioption  of  InnovationsT 
Th^' Effect  o£  Or^anizaCional  Siz.e^*  Differentiation,  and  Environment 
(Stanford:    Stanford  Cfen'ter  fc^  Research  and  Development  in  Teaching, 

;    ,1973);  and  J.  Vic tor^ Baldriflge,  "Political  and  Structural  Protection 
of  Educational  Innqv^tioji,"  inyWfiat  Do  Research  Finding3„Say  , About 
Getting  Innovations  into  Schools,  Temkin  and  Brown,  eds  • ,  op.  ci£. 
*  *- 

62.  G.^altman,  R.  Duncan^  &nd  J,  Hplbek,  Innovations  and  Orsanizations 
(»(*w  Vai^fc:    John  Wiley,  1973). «     .  '  *  ^ 

63.  ©anlcl  E.  Griffiths,  "Administrative  Theory  and  Cliange  in  Organiza- 
tions,'* in  Innovation  in  Education,  Miles, >eci.,  .op>  cit. 


^  1  ^tj 
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64*      Pincus,  *'Incentivas  /for  Innovation  in  the  Public' Schools , "  op\  cit* 

65^^    Margaret       Nelson  and  Sam^.  Sieber,  Innovations  In  ^rban  Secondary     ,  , 
Schools  (New  York:    Bureau  of  applied 'Sociai-  research,  Columbia  Uni- 
versxtyj^  1975) . 

.   66*      Ne^l  Crosai  Joseph  B.  Giacquinta,  and  Marilyn  Bernstein,  An  Attempt 
to  Implemefpt^a  Major  Educational  Innovation:    A  Sociological  Inquiry 
\    (Ca^bridg??    Center  for  Research  and  Development  ou  Educational  Dif*- 
f/r^^ces.  Harvard  University,  1968),  ERIC  ED  032  649;  Gross,  Giacquxnta 
ana  Bernstein,  Implementing^  Orfianizacional  Innovations ,  op.  cit^ 

J 

V 

67.^     Sarason,  Thg  Culture  of'  the  School,  op.  cit^-  ^ 

68*  '    See  above  fn  this  chaptejr,  Section  II.2.B.a'.  iii^. 

69*      See  .the  rt^ferencas  cited  abijv^i  in    foai:nate  3. 

70/     Ibid .  J  Vol.- A:    The  Findings  in  Review,  op.  cit^ 
I  ^ 

71.      IM^.  ^  '  ^ 

'72.     ^j^ej^ur  chap^ter  on  the^  dissemination  function  in  educational  R/D&X* 

73*      Butler-Paisley,  Paisley,  etal . ,  CoEimunication  for  Change  in  Education, 
op^  cit:.  .  ^  ^  ^ 

74*.     NIE,  Pro-am  Plan,  Hay  1975:^   sSgol  Capacity  for  Problem  Solvinj^,  ' 
75*      Itiid.  '       ^  ,  ■ 

-if  ' 

76*^     Donald  R*  Moore,  Emiie  M.  Schepers,  Manford  L.  Holmes,  and  i^thy  A\ 
^  ^lair.  Listing  of  Groups  -that  Facilitate  Educatrional  Change  at  the 
School/Community  Level  ^Chicago:    Center  for  Kew  Schools,  1977)  Of  ' 
tjie  78  gr^ps  listed^  some/would  fall  into  othery^more  specifi^^'cate-  ^ 
-gories  in  the  scheme  w^-^e  using  (fo^  instance,  teacher  centers)  ♦   '  ' 
Still,  the  Substantial  number  of  organizations  listed  suggests  'tbtft^  '  ■ 
a  significant  amouat  of  assistance  and  support  is  being  pro^dep,  in 
one  form  or  a§other,vto  support  educational  change^^t^^he  local  level* 

77.*      Center  for  New  Schools,  Assistance  Strategies  of  Six  Groups \  that  ^     .  ^ 

Facilitate  Educational  Change  at  the  SchgOl/Comnuntty  Level/  ^opV  cit. 


ERIC 


7fl^*      On  technj.cal  a^istance,  in  pa^rticular a  document  produi^^by  the 

*  DTA  project  was;    Manfiord  LTHolmes,  An  Examination  ipf  Two/ Technical  ,^ 
Ass,tstance- Styles  V?lthin'Qne  Project  _(Chicago:    Documentation  and  y 
Technic'al*^Assistance  in  Urban  Schoc^ls  Project,  C^nter^for  New  Schools,  .  *  ^ 
1977).  '  V    ^  I  \  ■   '  "  *        ^      '  ■ 

'  '     V        1  >  ^ 

79*,    NIE,  RFF  for  Studios  *in  ^t^MizatjorP^  R^p  In  Education,  ^op.  clt 
7^  '  1  ^  ' 
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80.  KIE,  Program  Plan,  May  1975;     School  Capacity  for  ProbXem-SoXvlna, 
op,  cit,  '  *  % 

81.  Llppit,  VThe  Use  of  Social  Research  to  Improve  Spcial  Practice/' 
op^_cit* 

—  —  ^  *  ' 

^  ♦  ■ 

82.  Ibid.,  p.  795  .  *"  - 

* 

83*     The  change  ^gent  models  described  in  the  literature  vary  from  the 

more  passive  dissemination/information  consultant  roles  to  more  ac- 
tive' utilization  roles*    For  instance,  see:,   Bela       Baa^thy  et  al^ 
Th^  Educational  Information  Consultant:    Skills  in  Disseminating 
Educational  Info.naation  (Berkeley:    ?Sr  West  Laboratory  for  Educa-* 
.    tional  Research^^  Development,  1972)^  ERIC  ED  071  689;  Gerald 
Marker  ajid  HowarPb,  Mehlinger,  Report  of  the  Social  Stbdies  FJ^eld 
Agent  draining  Program^  Final  Report  Csioomington ;    Indiana  Universi- 
ty Foundation,  1972),  ERIC  ED  076* 463j  Rog^r  Rasmussen,  The  Product 
"  as  Change  Agent:    Advantages  and  Limitations  (Dayton,  Ohio;  Insti- 
tute for  Development  of  Educational  Activities*  1972),  ERIC  ED  063 
550;  Mark  Chesler  et  al, ,  The  Educational  Change  Team:    An  Effort  to' 
Develop  a  National  Facility  to  Generate  and,  Implement  Information  and 
Resources  Relevant  to  Secondary  School  Crisis  and  Change,  Final  Re- 
port ^  (Ann  Arbor;    School  of  Education,  University  of  Michigan,  1972),  . 
ERIC  ED  087  644;  Kenneth  P,  Lindsay,''  Research  Information  for  tfae 
Educator  to  Meet  the  Educational  Needs  of  Utah^s  Children:  Techni^ial 
Assistance  Information  Service*  ^Interim  Report  (Sdlt  Lake  City;  Utah 
State  Boa^d  of  Education,  1972),  ERIC  ED  069  327;  York,  Artangemeats 
and  Training  fot  Effective  Use  of  EducatrLoSal  R&D  Information,  op>  elk. ; 
and. Public  Schools  of  the  District  of  Columbia,  Reading  Research  Utili- 
zation Project.'  Ititerim  Report  (Hashingtoti:    Public  School  System, 

1972)  ERIC  ED  069  3&1* 

'    '  '  ft 

84.  ?or  in&tnace,  see  tiie  sources  cited  above  in  footnotes  12-15,  \>ut  also, 
.    more  directly  on  change  agents:    Ronald  G*  Havelock/  Training  for 

Change  Agents,    A  Guide  to  the  Design  of  Training  .Prograjns  in  Educa- 
tion and  Other  Fields  (Ann  Arbor:    Center  for  Re^^efarch  on  Ucilization     t^^^  J 
*  of  Scientific  Knowledge,  Institute  for  Social  .Research*  University  of 

'  ,   '  Michigan,  1971),  ERIC  ED  056  .259;*Colin  Mick  ep.al. ,  Development  of  ^ 

Training  Resourced  for  Educational' Extension  Services  Personnel,  Vol,  1; 
Final  Report  (Stanford:    Institute  for  Communication  Research,  Stan-  *t 
ford  University,  and  Santa  Monica;    System  Development  Coi;poration,  1973) 
^  ^      ERig  ED  077  534;  J,  Todd  Simonds  and  Theodora  St*  Lawrence,  Methodological 

^  and  Theoretical  Bases  for  Designing  L^cal  Educational  Change  Frogranis 

(Pittsburgh!    Learning  Research  and  Development  Center,  University  oi 
,    Pittsburgh,  1972),  Pape/ Presented  at  the  Annual  Meeting  of  the' American 
'     Educational  ites^arch  Association, 'Chicago,  April  1972;  ERIC  ED  063  679; 
and  Fred  S*  lloaenau.  Tactics  for,  the  Educational  Chaage  A^ent:    A  Prelinln- 
ary  Analysis  CSan  Francisco;    Far  West  llaboratory  for  Educational  Researc'n 
'  and  Development,  1974),  ERIC  ED  096  258*  '  '  ^  * 

*  ^  -■  • 

85,  ■  Fpr  m^tancfe,  see;    Mick  et  Development  of*Trrfijiing  Reso:jrces  for  Edu- 

cational Extension  Services  Personnel^  *op ^  cit*;  Volume^:  Trainers' 
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Book>  ERIC  ED  07?;535  and  Volume  3:    Trainees'  Bookf  ERIC  ED  077 
536,  and  Ronald^-G.  Havelock,  The  Change    A^ent^s  duitje  to^Iiifiova- 
tion  in  Ediica^Son  XEnglewood  CliEfSj  New  Jersey:    Educational  Tech^ 


4 


'^nology  Puljlication,  1973)* 

CenteV^r^  N^w  Schools,  Assistance  Strategies  ot  Six  Groups  Taa^ 
^.Jacilitate  Educational  Change  ati  "the  School/Community  Leygl'f^  op..  clt> 

*Havelock,  Training  for  Change  Agents >  oV>  cit> 

tnter  for  New  Schools,  Assistance  Strategies  of  Six  Groups  That  ^ 
cilitate  Educational  Change^  op*  cit> 

Havelock,  Planning  £or  Innovation  Through  Dissemination  and  Utiliza- 
tioti  of  Scientific  Knowledge,  op*  cit> 

Center  for  New  Schools,  Assistance  Strategies  of  Six  Groups  That 
Facilitate  Educational  Change,  op>  tfit/.  Final  Repolrt  Summ'ary^y^  p.  24 
and  Appendix.        ■     ,         -      ^    ^  ^ 

Flora  Young,  Process  Analysis  and  Documentation  for  Utilization  of  ^ 
Research  Findings  (Portland,  Oregon:    Northwest  Regional  Educational 
laboratory,  1973),  ERIC  ED  087  709* 

The  Documentation  and  Technical  /Cssistance  in  Urban  Schools  Program 
which  we  have  referred  to  before  is  a  notable  example  of  this  failure, 
* 

Xwo  good  examples  ar^  The,  Oregon  Studlesjin  Research,  Development^ 
dissemination,  and  Evaluation^  Volumes  I,  IV,  and  V  (Monmouth,  Or^on: 
Teaching  Research  Division,  pregon  State  System  of  Higher  Education, 
1972);  and  Center  for  New  Schools,  Assistance  Strategies  of  Six  Groups 
■  That  Facilitate  Educational  Change,  op*  cft>  '' 

Michael  W.  Kirst,  "The  Growth  of  Federal  InHilShce  in  Education," 
in  National  Society  for  the. Study  of  Education ^Yearbook  (Chicago: 
S£,  19*74)* 

Cohen>  Ideas  and  Action,  op.  cit>^  " 

Thes^  factors -were  identified  by  Pihcus  from  his  review  of  the  rele- 
^rant  literature  aV-described  in:^  Pincus,  "incentives  for  Innovation 
in  the  Public  Schools, I*  op>  cit>  "  i  ' 

T\^B  four^fold  distinctflon  is  from*  Nelson  arid  Sieber,  Innovation  in 
Urban  Secondary  Schools,'*^p*  cit* 

National  Institute?  of  Education,  Preliminary  Program  Plans ,  FY  78* 
Executive  Summary  (Washingrtn:    NIE,  July  1976);  and  NatioTial  Insti^ 
I  tute  of  Education,    Dissemination  and  Rest>urces  Group:    Program  Plan, 
FY  1978  (Washington:    NIE,  August  1976). 

Butler-'PaisTey,  Paisley,  et*  al  *  >^  Communication  for  Change  in  Education 
op>  ctt*;  and  Ytfrk,  Arrangements  and  Training  for  Effective  Itee  of  E^u- 
I  c^tional  R&D  Information,  op*cit * 
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I.     TKE  HISTQRrr^L  CONTEXT 

Evaluacioa  of  educacional  progratus  Is  hardly  new.     But  evaluation 
"emerged  as  a  specialize^R/l^I  function,  with  a  specialized  insti- 
tutional and  personnel  base  and  a  distinctive  methodology,  only  vith 
the  institutionalization  of  educational  R/D£tl  in  the  last  ^decade 
and  a  half.  '        ,  \ 

Prior  CO  the  mid-'60s,  evaluation  oi  e^^ucational  programs  (when 
It  ;;3S  dons  at  all)  vas  carried  out  by  educational  practitioners 
and  by  sorie  researchers,  but:  rarely  by  peofJle  who  identified  then- 
selves^  as- evalua  tion  specialists.    The  approaches  used  tended  to 
be  normative,  but  rarely  sys tema tic  ^or  rigorous.     The  predominant 
atrategy  was  casual  observation  and  .analysis/    Conclusions  tended 
to  bs  based  on  expert  opinion,  intuition,  and  impressions^  rather 
than  systematically  gathered  and  rigorously  analyzed 'empirical  data. 

This  pattern  changed  significantly  in  the  '60s  as  large-scale  fed- 
erally funded  social  programs  proliferated,  and  the  legislation 
that  create^i  them  tended  to  require  tH^  systematic  gatherings  and 
reporting  of  empirical  iiata  on  program  effectiveness.     Thus,  t^i^e 

evaluation  function  expanded  rapidly  as  a  new  specialty,  even  ^ 
1 

a  new  "industry."      In  less  than  a  decade  between  1965  and  1974, 
DHEW  and  Department  of  Labor  eval"uatH.on  contracts  increased  frotn* 
the  $5  million  to  the  $50  million  level.,  ^with  th'e  bulk  of  evalua- 
tion funding  going  to  the  non-prof it  and  for-profit  research  corpora- 
tions  whicti  became  the  dominant  p^rformer^  in  this  segment  of  the 
fedecal  contra-;t  ecoT>**iny.      Many  of  these ^  research  corporations^  are 
sector-spanning  institutions,  bidding  on  evaluation  contr^ct5  not 
only       education  "but  also  in  healthy  manpower  training  and  develop-' 
ment,  social  welfare,  and  An  the  case  of  some  of  the  'more  diversi- 
fied research  orga^izatipns  atid  msiiagement  consulting  firms)  indus- 
try, defense,  and  aerospace  as  well. 
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Given  this  historical^  contexc,  Che  expansion  and  maturaci<Jn  of 
che'  evaluation  function  in  education  fnust  be  viewed  as  pairt*  of 
the  broader  development  of  the  field  of  social  program  evaluation 
showing  the  same  rapid  growth  ia  nutrfcers  of  evaluators  and  amounts 
of  evaltuation  activity;  the"  same-^rowin^  influen^ce  of  research  corp- 
orations competing  wi th  ojnlversi ties  for  evaluation  contracts;  and 

the  same  kinds  of  attention  to  methodological,  organizational ,  *an4'-^ 

^  4 
political  issues  inherent  in  the^'^^aluation  role< 
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II.     MATtJRATION  SF  THS  FIELD'S  KNOWLEDGE  AND  TBCHNOLOGY  BASE 

The  early  phases  of  the  maturation  process  of  a  knowledge  and  tech-  " 

'nology  base  are  illustrated  with  [)artiicular  clarity  in  the  enormous 

literature  produced  by  the  evaluation  function  over  the  last  de;cade 

and  a  half.     Of  all  the  functional  R/D&I  specialties,  evaluation 

appears  to  have  experienced  the  most  self-conscious  and  concerted 

development  of  its  methodology  during  this  period.  -  The'  literature 

reflects  not.  only  the  inherent  difficulties  of  the  eyaluatloji  role 

and  evaluation  pjocesse^,  but  also  the  problems  of  weaning  a  new 

specialty  awa^  from  a  parent  field.    The  early  literature  wa5  filled 

with  self-conscious  analy^^es  drawing  distinctions  between  evalua- 
-  -  5 

tion  and  research,    and  emphasizing,  the*  inappropriateness  of  pre- 

vailing  research  methodology  for  the  educational . evaluation  context.  ^ 

Within  only  a  few  years,  the  distinction  from  education  research 

was  taken  for  grant^ed,  and  the  literature  documented  the  develop- 

ment  of  evaluation  as  a  new  field  with  a  distinctive  identity. 

The  rapid  <^ming  of  age  of  the  evaluation  function  could  be  seen 

in  the  quick  succession  of  seminal  papers  produced  by  evaluation 

theorists,     the  publiM:atlon  of  several  anthologies  reprinting 

g 

important  .articles  on  evaluation,     the  fretquent  citation  of  the 
seminal  papers  of  the  field  and  the  use  of  concepts  and  approaches 
developed  In  these  papers.     It  could  be  seen  in  the  emergence  of  a 
somewhat  common  frame  of  reference  among  evaluation  theorists  and 
a  common  vocabulary  --  including  such  terms  as  "formative"  and 
/'^Umniative"  evaluation    and  "context,"  "input/'  "product,"  and 


'pVoci^MAevaluation.        The  ^.aruration  of  the  evaluation  function 


^^^e\ 


could  b^l^en  Especially  in.  the  formulation  of  various  new^  evalua- 
tion xJesigns  and  methodologies,^^  in  attempts  to  develop  taxonomies 

12 

of  evaluation  designs,     ^in  the  publication  of  several  handbooks 


synthesizing  Bnd^  conFpresslng  the  a^cumalaring  knowledge  and  tech- 
nolo^;y  base  and  translating  itjinto  more  readily  usable  reference 


r 
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13  ' 
forms,      and  in  Che  publication  of  several  new  evaluation  journals. 

Still,  the  conduce  of  educational  evaluation  and  the  quality  of 

•  1  15 

evaluation  outputs  have  been  the  focus  of  considerable  criticism. 

The  field  still  lacks  an  adequate  theoretical  base.    Evaluation  in- 
strumentation is  in  a  jnosc  rudimentary  state  of  development.  And 
basic  conceptual  and  methodological  dilemmas  remain  unresolved. 
Two  centers  have  been  established ^specifically  to  advance  the  state 
of  development  of  evaluation  research  theory  and  methodology,  th^ 
Center  for  the  Studs       the  Evaluation  of  Instructional  Programs 
{one  of  the  federally  funded  i^fitD  centers)  and  an  "evaluation  center 
headed  bv  Dafiial  Stufflebeam  at  Western  Michigan  University,  In 
additiort,  a  sciall  measurement  division  within  NIE  has  been  working 
specifically  ip  zhe  area  of  strengthenings  evaluation  methodjjl^ogy . 
As  yet,  hovever,  despite  the  considerable  energy  that*  has  been  in- 
vested  in  advancing  the  state  "of  development  of  the  evaluation  func- 
tion in  education,  compared  to'^o^TiSr  R/DStI  systems  the  knowledge 
and  technology  base,  of  educational  evaluation  must  still  be  con- 
sidered relatively  weak  ana  immature. 
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III.     IN3TITUTI0N=\L  BASE 


/ 


Federal  funding  data  underscore  the  extent  to  u,-hich  the  evaluation 
funcAoa  has  come  to  be  dominated  by  the  "non-profit  and  for-profit 
research  corporations^     For^ instance ,  1971  data  for  DHEW  evaluation 
contracts  (^11  DHEU  work,  not  education  alond)  indicate  that  747^ 
of  these  funds  went  to  ncm-profit  afid.  for-profit  research  corpora- 
tions, and  only  21%  to  universities  or  unl^rsi  ty-af f  i lia ted 
17 

organizations ,        FV  1975  data  for  all  fede^tai-j&Wrrgations  in  th^  ^ 
area  of  e^rly  childhood  and  adolescen*t  educ|rcion  suggest  that  497- 
of  federal  evaluation  funding  goes  to  the  for-profit  corporations,. 

i 

27%  to  non-profit  'corporations ,  and  217,  to  academic  institutions.  • 

The  for-profit  corporations  are  heavily  depen^ient  on  >valua tioVi 

projects:  777>  of  their^FY  1975  federal  funding  rn  education  KPli 

1 8 

came  fron  evaluatrion  contracts.  "        .  '  .  y: 


V    It  has  baen  argued  that  the  modes  of  procuring  evaluation  work 
have  teadsd  to  turn  acade:::iic  researchers  away  from  federally 
funded^evaluation  work,^ofcen  because  they  feel  the  designs,  in- 
struinentation,  etc.  suggested  in  the  RFPs  are  faulty,  that  alterna- 
tive  proposals  are  often  greeted  as  "unresponsive,"  at  that  at  any 

^  rate  the  time  frames  and  political  context  in^^hich  federally 
funded  evaluation  vork  is  carried  out  make  it  generally  unattrac* 
tive  to  academic  researchers  more  comfortable  with 'other  modes  of 
inquiry.  ^  '  ^ 

However,"  another  school  of  thought*  on  research  corporation  domi- 

4 

'nance  of  fedtiraliy  funded  e^ralu^tion  work  is  that  the  research 

cgrporatioas  tend  to  be  favored  as  performers  jaore  suited  to  this 

kind  <f  woiilfc-,  and  that  the  consequence^  ha^e  been  pooler  quality  ^ 

evaluation  st'trdtes  than  would  be  the  case  if  more  of  the  work  were 

19 

car^ried  out  hy  academic  institution!;.'       The  debate  has  been  waged 
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"  ^over  rit>o»  oaly  ."the^basic  premise' but  also  the  validity  of  thie  data  ■ 

(and  *ln£ereaces  mide  from  the  data)  on' differpoces  between  the 
"     academic, and  entreprenauriaj^odes  of  ^evaluation^rfesearch^       *  ' 

Th^re  is  as  yei^little  consensus  on  the  isoint.'  Cearly,  thoughT,' 
some  assessments  do  need  to  be  made  of  the  quality  of  the  ^valua- 
^iQn  work  carried  out  bj^'dif ferent  types  of  perforinj^g  ins"t;itu'- 
*tions  and  even  sjjecif i(^contractors-%    If  evaluation  research  is 
,  ever*£o  have  substantial  iirtpact  op  educational  policy  making, 
^     \  this^is  clearly  not*  likely  until  poj^cy  makers  com^  Ho  View  evalua- 
rion  stuijies  as  oroyiding  sound  data"  that  can  inform  decision 
^  process .  '  '         .         ^       -  '  ^ 


"1 


-3 


>  ■' 
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'XV.     PERSON>.^L  BASE      ^  ^  "       *  ^  * 

/'She  'evaluation  funct  Ion  has  Expanded  so  FSpldly  that  evaluators 
organized  fhemselves  Into  a  separate- AERA  division 'a  few^years  ,ago* 
With  approximately  4,000  members^  it  Is  already  one  of,ABRA*s 
largest  divisions.    '  '  "    "  . 

-It  is  not  clear  as  ye^ what  kinds  of  formal  training  thes^  evalua- 

t  -  ft:  '  ^ 

tqrs  have  had- for  their  specialized  roles.     Future  studies  of  the 
personnel  base  nay  be  able  to  establish  this.    X^^^  ready  possi- 


bility if  analyzing  the  background,  data  ^avallafele  on  mem^'SK^af^the 
evaluation  division"  In  AEtlA'*s  demographic  data  fi-les.)    It  Is 
likely  that  most  hav^  been  trained  In  stanciard  educational  research 
<<lethodology*iand  have  been  trying,  on  their  own,  or  through  supports 
_  pro7ide<3*  by*  their  ^jork^  groups,  to  adapt  this  methodology  to  the 
^  ^  peculiar  f equi,recents  of  prograrrf  evaluation^  in  the  ej^ucation.con- 
,  ^text^.and  to 'absorb  what  they  can  from  the  prolijf^tating  literature 
^j^n  fiew  evaluatjLon  raodel^  and  technologies. 

Se^ral  Initiatives  have  been  taken  ^tn-  receipt  ^ears  to -try  to  up* 
i  gr^de  the  competencies  .of  evaluation  specialists.    Evaluation  re-* 
search  Was  one  of-  the  key  functional  areas  analysed  byAE^*s 
4f  -Task  Force  on  Training.    A^  a  result  of  their  work,  the  'specific 

*  competenc  T  es^  for  this  kind  of  work  have  been  anal)^ed  and  are  avai'l 

s      *  '  20      ■  ^ 

able  for  i^^e  in  designing  new  training  program^.  ^     Some  small 

^    amoij^^trj-f  federal  funding  has  been  Ir^vested'ln  the  design  of  train- 
ing programs  geared  specifically  to  the  reji^lr^ments^for  ^valuation 

research  In  education,      '  E^th  ^ERA  an<^  Phi  DelHta  IJappa  have  been- 

'  '      *  '  22" 

cond*ictlng  trainiftg  programs,  and  workshops,  in  evaluation  skills.' 

And  clearly,  sone  graduate' level  courses  are  now  appearing  focused 
^  op  evaluation  research separate  and  apart  f^om  ^en^^al  4nethods 
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courses.     iut  as  yet,'  it  is^  Utvcle^r  how  many  programs  have  been 
put:  ^nto  operation of- whst  t^es-j-^occ^ing— on  whet-<:oEnpetencie^ ; 
or  TTow  many  eyaLuators  at  work  in  the  field  have  been  exposed  to 
these  programs^  with  what  effects;  or  what  oth^'sourcss  (if  any) 

,evaluators  ar^  using  to  upgrade  their  skilJfe  and  competencies, 
fh^rft  is  clearly  a  ^reat  deal  of  empirical  an^  analytical  work- 
needed  in  this  area,  but  few  signs  as  yet  thq^^tsuch  work  is  being 
performed,  or  .even  that  educatiotjal  R/DSd  sponsors  are  interested 

'^arT  supporting  *uch  investigations.  ' 
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ETMDOLOGICAL-  ISSUES. 


f 


Key\^S5ues  Debated  in  the  *60s  anc^  earl^  ^ 

During  che'*60s  and  early  *70s,  Ch^ite  were  many  hea^^ed -debates 
aiaortg  evaluation  and  research 'ch^on^Cs  'abdu?]^ppropriaCe  mechod- 

dlogies'for  Che  e^mluaCion  function.    One  group  argued  that  ex- 

'       *^  "     .  /  ■  '  *  ' 

perimsntal  (or  quasi-^perimehCal)  d?sigris^were  more  pqi^erfiil  Chan 


any  other  research  approache^  for  assessing  the  effect iveness *of 
programs,  pi^oducts,  or  strategies  —  and  .that  it  wa§^  therefore 
rss'sr.^lal  to  uss  sf^^se  "app'roch'SS  to  tes  &  R5fD  outputs  and  to  reform 
programs  of  all  kuids.        A  second  grouo  argued  that?  expeorifiental 
*   approaches  imposed  unrealistic,  constraints  on  field  settings^-  , 
■'and  that  at  any  rate  it.coald  nevar  be  possible^to  meet  adequately 

the  statistical^  design^  anrd  tre4tment  assumpt ioris*  on  which  ex- 

*  -  24  i  ' 

perirnental  approaches  were  premised,  y 


ar^vjnc 


ofKe|:  methodological'  debates  revolved  ar^vjnd  the  need  for  evalua- 
tion approaches  to  provide  feedback  throughout  the  program  develop^- 
meW  prdcese  -r  not  simply  tilling  the  developer  at  the  e^nd  of^  the  '  ^*  . 

'devel<5l&ment  process  that  his  pq^gram  did  not  work^  but  working  I^Jth 
him  throughout  the  p;rocess  to  make  i,t  better.      ^Existing  ^re-postT^ 
evaluation*^  designs  made  it  difficult  for  program  evaluators  to 
provide  this  kind' of  feedback,  or  *ta  understmd  how  to  eval'ciate  a      •  " 
program  stimulus  that"  kept  changing,^,      '   '     *      .  ■  '  * 

2.     S^mni^tive  vs,'  Formative  Evaluations.    '  '    -  ^        ^       '  ^  \ 

•      ;   '.■•■„*-■  V .  ■■     ",  . ' 

Some  of  these  d^ajgreements  h^e  beeji  eased  .by  reiogtiiciion  among 
evaluation  sffecialis ts  that  there  are^a  number  of  different  kinds*  '  - 

of  eva      tion  services,  each  requiriftg  somewhat  different  approaches 
and  tech^iqr^^^-  The  distinctitop^  between  fori^ative  and^pummative 
evaluations  repre^en'ts  one  su/h  difference.  »  IpitiaTl^^^the  same  - 
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res€?archers  conducted  both  formative  and  sumniatLve  evaluations. 
Ov^u  time>  however, -ther^  ^appears  to  have  been  some  specialf^zation' 
of 'pe^^txnosl  and  organisatflon^l  units>  with  some  focusing  primarily 
on  f ortnative*"  evalua^tions  and  tft^^rT  focusing  largely  on  suEnmative 
asse'ssment^s .  -  ^  ^  ,  . 

Currefttly>  the  formative  evaluations /th^t  are  undertaken' as  ,part  ► 
ofc^the  R&D  program/ product  develop^^ent  process  are  generally 
carried  out  by  evaliiators  [who' work  with  developers  as  part  of  the 

'develt^taen:  team  and  Djf^^ide  on^ain^  feedback  designed  to  imorove' 
the  product  or  prograrr  be^g  developed,     They  "use  both  quantita- 
tive daca-b.a^ed  ^nd  qualr^tive  judgmental  approaches.  Their 
style  of  functtpning  enphasizes  flexibility  --"ohanging  their 
research  questians>  variables,  instrumentSj  and  approaches  as  the 

'eTrfe*itgLng  program  takes  shape  and  perhaps  goes  through  a  number  of  ' 
transformations . 


Summative  Evaluations:  Experimental  Nc 

[n-ExPeribental  Dfesipns 

*        X           y     '*  * 

The'debate  over  experimental  vs*  other  kinds  of  fesear-ch  desig^ 
is  now  centered  on  summative  evaluations  —  the  evaluations  under- 
taken ^  to  test  the  e f fectiveness ^  of  a  given  program  ar  product  ■ 
after  it  has 'been^  fully  developed.     Summative  'evaluation?  are 

,  usually  done  by  ^rfEt^eyalu^tion  orgafiization  or -organizational  unit 
independent  of  the  program's  developers*     Sumraatiive  evaluations 
ijncl^e  -  several  types  of  evaluations  differing  somewhat  in  empha'sis 

'because  t>6^he_  different  information  needs  of  tihe  decision  n^kers 
to  whom  they  are  adciress^d:     »       *   , 

1.     final  operational  field  tests  of  an  R&D  output  to  help 
th4  I^D6cI  manager  d^ternme*  Aether  or  not  it  is  ready" 
for  dissetniriation;  '    ^^^--^^  '  j  ^ 


2."  evaluation^  of  the  effectiveness  of  a  given  progratm>r 
product  inVa  giv^n  schoM  or  district  {nTii^'eting  locally 
defined  objectives ;  j)| 

valuations  tff  national  program^^^itiatives,  sampling 
program  jcomponents  n^'tLonvide  to^inform  Je'deiral  policy- 
n^kers  about  the  ef*fectiveness"^of  a  given  strategy  (or 
the  relativ ti^^^^ctiv^ness  of  altertiative'  strategies) 
*  in.{?^eting  feder'klly  defined  policy  ^oals, 


T'here  is  still  soce  disagreeinent  about  how  appropriate  ^xperimeatal  / 

designs  may  be  for  product  tescs  and  for  individual  school  or 

school  district  program, evaluations;  -and  many  other  kinds  of  research 

desigps  have  been  proposed  for  these  types*  of  evaluations,  ifone- 

theless,  a  federal  prOg^m  evaluation  policy  (to  whatever  extent 

such  a  policy  exists)  appears-  to  h€  moving  toward  experimental 

Approaches       increasing  numbers  ^jf  national  program  evaluations 

■ 

are  being  conducted  using  experimental  desigrts,  control  groups, 

^  26 

and  some  ramdomization  of  treatments.        However,  the  difference 
between  experinlejital  setting  in  the  laboratory  and  the  fiel^  is 
"^gaining  recognit/ion.  _  Federal  ev^luators  are  increasingly  ack- 
nowledgifte  the^eed  to  supplement  impact  data^with  process  data 
dem'orTSrtjja^ing  that  a  given  "treatment**  was  implemented  as 

specified  in  the  prdgram\desi^n, 'and  that  the  impact  evaluation  is  ^ 
a  valid  test  of  the  progtam^and  r(bt  simply  a  "non-event."  Other- 
wise,  <iuestions'cart^;:.^di2y  be  raised  as  to  whet*her  a  program 
evaluate3^s  a  failura  was  ip  farct  a  failure       or  whether  instead  , 
it  W3S  never  even  tried  (and  thus  what  was  evaluated  and  judged 
a  "failure'^  did  not  in  reality  even  resemble  thp  specified  pro-, 
gram  "treatment").  "     V  ^  * 


J- 


ORCiplZAKO:;AL  AHD  POLITICAL  DILEM^IAS 


The  'Eyaluator's  Role 


/ 


ERIC 


The  evaluacor'fe  role  has  come  to  be  understood  prioiariiy  as  one 

^  '  '  2S 

of  neeJ^pg  the  informa^tion  needs  of  decision  makers,  However> 

\ —     there  are  a  number  of  lasues  and  prol^leras  involved  In  this  assump^ 

,  ^  tion-  *'  fSr  exatnpl#:  ,        .  ^ 


'.^"jiicri"  iecisftn  makers  are  we  talking  sbouL:  implemenxsr- 
tLon  personnel?    program  managers  at  spi^^ific  sites?  ^pro- 
gram managers  at  the  loc;al^  state  and/or  federal  level? 
policy  makers  (and  at  vhat  Uevel)?  " 

Kow  does  the  ^valuator  deal  with  the  difficulty  decision 
markers  have  iq  defining  their  information  needs;  in. agree-- 
ing  on  .wb^^t  information  is  ^relevant  or  in  agreeing  on-what 
pieasurement  procedures  and  instrxfments  are' valid? 


How  muc*h  input  can'an  evaluat;</r"  haue  in  defining  i^at 'he  - 
inv^tigates?    Mu^t  he  a^ce'^t .  the^-cl  lent '  s  definition  of 
the  progy'am^s  ji^^jsctives  and*  simply  assefs  the  effectiveness 
of  the  prro'gcaa  in  meetin^^-these  ^objj^ctives?    Or  can  he  in- 
elude  in  hi.&'^evaluation  consi<{e»t'5tlon  o£  the  appropriateness 
of  these  ofeje^iyesr  (or  the  gro^rac^t's  rationale  x>r  strategy) 
for'ffleecifig  the  urtijnate  goa.l  ojh  tj>s"  progr^mls  developers? 


The  Po"Uti(;al  Di^eocyR  ' 


■ > 


•?,va  lua  t  i  onS' ate;  cff-{;ejj„^e!'S&tl§frt5  as  .5j^^g|^i3fV^,t^ols/des.igned  to 
pro'/Ld6  a  ''raFional^b;&si/..fot^^e.cV^i^n  -f^ak.lrig^^i-y^'^eclsioA 
maker^  ip  r^ie  pyb ^ic _^frtor  _|im,c^torf-i.il  ^ sphere. 
This  face*  rS*b'ed  irnpartdafi'  xHsxlsk  -Zt^-  kiip'^^  I 
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theoretical  as^  practical  levels^ 


On  the  theprsci(^l  level,  we  nius  c  ask  if  political  considerations 
are  ^**irracional,  "  or  if  they  are  based  on  ''a  , different  model  of 
rationality*'  from  che  one  gerffe««tily  u^'^^d  by  social  scientists. 

On  the  practical  level,  corr^  vderat  ion  must  be  ^iven  to  the  poKtics 

of  decision  "maktng.     Generally  speaking,  ^rograais  are  created  by 

■ 

Dolitical  coalition^  of  diverse  arttepests        interests  uhich  sup- 
;>ort.,oro%rams  r^r  Jivers^  reasons.     These  caalitions  t^nd  to  view 
negative  evaliiation  research  fit^din§s  unfavorably       and  generally 
have  enough  influence  to  modify  or  bury  negative  findings^and  keep 
their  prograrJiJk^oing ^regardless  of  whac.eval^ators  'repoFt.^"Con^ 
versely  {yet  similarly),  program^  Kiay  be  opposed  by  other  political 
interes!:  groups,--  interest  groups  who  will  use.  findings  of  evalua- 
tion r^eat^h  to  achieve  their  ends.    Thus,  evaluation  rese^ch 

findings  roay  be  used,  misused,  mOdj^ied,  reinterpreted,  buried, 

30  ^  * 

ect.    "    --  in  other  ,wordSj  used  as  ^a  ''political  football."  Given 

the  political  context  and  the  methodological  issues  we  have  noted 

Sbove,  it  is  not  surprising  that  controversy  over  negative  evalua- 

Kion  tteearch  findings  are  so  often  phrased  in  terms  of  metRodologi- 

cat  issues^racher  than  evaluation  findings  per  se-. 

3.    The  "Values^  Diletnma  *  " 

The"educational  content  is  value-laden^  and  valufe  choices  enter 
virtual  ly  .evej^y  one  of  the' key  decisions  made^by  the  evaluator. 
The  outcondT  of  evaluation  research  may  be  predetermined  by  the  choice 

r^se^arch  question's  and  object  Ives , -the  criteria  used  in  jadgiftg 
e f  fe<.r  i  veness  ,  or  the  neasurenent  instruments  administered.    From  " 
the  perspective,   the  question  must  be  asked:     Is  the  evaluator 
value-free  when  ^^^'S  evaluation  research?    Frpm  che  or^nizational/ 
^olitiif^il  context  perspective,  fhe  question  must  be  asked;  To 
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*  whac  extent  is/should  che^e  key  value  decision  chdices  of  the 
evaluator  be  Influenced  by  the  organisational  inEonnation  needs 

of  th^  decision  maker  on, the  one  hand,  and  the -political  con- 
text/dynamics on  the  oaher  hand? 


A.     Current  Trends  ^ 

Evaluators  are  developing  an  increasing  sensitivity  to  the  pol^i- 
"tics  o£  decision  making,    Xhe  evaluarion  research  literature  has 
'ShowTX  the  ]jrogress  made  by  tihe  field  over  tirne  in  coping  with 
this  situation       from  an  early  literature  that  simply  bemoaned 
this  situation,  to  more  recent  writings  that  accept  i*t  as  a  given 
and  build^^Mnsider&tte^^^Oi  tite-yo-H t-H^  of  decision  making  into 

the^pJannip4  and  implementation  of  evaluations  to  make  them  more 

\     f     M.  31 
"stM^eg^cafljijr  useful,'* 

The  eva\uation  research*  functipn  is  in  ^  much  stronger  organisa- 
tional and  political  position* now  than  it  was  a  decade  ago.  In* 
stead  of  b^ing  located  in  marginal  units  tjjat  could  be  easily 
ignored,  planning  and  evaluation  units  and  their  administrators 

are'  noy  included  in  the  top  management  decision  structures  of 
,  32  ^ 

federal  agencies.        The  evaluation  research  function  is  taking  on 

^tncreasiig  prominer^e  in  the  General  Accounting  office's  auditing 
33 

*  activities.        On  the  state  level,  legislative  oversight  committees 
with  strong  evaluation  7>esearch  staffs  o£  theiu  own  have  given 

"significant^visibility  to  evaluation  research  actljj^ies  and 

....        34  .  ■ 

rmdings,  ^        ^  ^ 
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VII.     TH?  IMPACT  OF  EVALUATIONS  IN  EDUCATIONAL  DECISION-MAKING 

There  is  still  substantial  disagreem^t  over  just  how  much  impact 

f 

ti^e  evaluation  function  has  had  (or  can  have).    But  clearly, 
there  is  relatively  little  evidence  of  extensive  use  of  evaluation 
research  findings  as  the  basis  of  policy  decisions.  Equally. 
clearlyv  ^fiistively  few  high  quality  evaluations  have  been  pro- 
duced  and  .even  the  better  evaluations^^have  ^suffered  from  serious 
methodological  flaws. 

The  evaluation  function  lacks  anradequace  theoretical  baS€>*^nd 
is  even  more  lacking  in  ad^juate  instrumentation.    There  is  no 
clear  federal  evaluation^ -policy,  art%  federal  agencies  have  ^not 
even -issued  guidelines  ^  to  what  constitutes  an  adequate  or  aporo-- 
prlate  evaluation."    (OE,  though,  the  doraina^it  s  pons  on  of  federally" 
funded* evaluations,      has  been  moving  in  this  direction  and  beyond 
for  the  evaluation  o£ 'ESEA  Title  I  brogratas.)    "  It  would  seem> 
then,,  j;hat  the  evaluation  function  in  education  (and  other  social 
program  areas)  remains  ^reak  in  comparison  to  the  evaluation  func- 
tlon  in  more  mature  R/D5el  systems. 
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"Deep  Dark  Deficits  of  the  Adversary  Evaluation  Model,"  EducationSjl 
Researcher^  Vol.  6,  tio.  6,  June  1977;  David*.^amiltonj  David  Jenkins, 
Christine  King,  Barry  MacDonald,  and  Malcolm  Parlett,  Beyond  the 
Numbers  Game:    A  Reader  in  Educational  Evaluation  (Londop:  >Iac[iiillafi  / 
-  Education  Ltd.,  1977);  and  M..  Provus,  Diy  repancy  Ei/aluatior?  for  Edu- 
cational Pro^rani  Improvement  and  Ass^ssmftt  (Berkeley:  McCutchen 
Publishing,  1971). 

For  instancy,  see  Rober^  Stake,  "Prototyp^es  of  Curriculum  Evaluation," 
in  The  OreROtt  Studies,  Vol  II,  op.  cit>  ^  ^, 

These  handbooks  iriclude:    B.  S.  Bloom,  J,.  T.  Hastings,  and  G.  F. 
^^adaus'!^  Handbook  on  Formative  ^vA  Sun\macive  £valuatiu:i  fcrScudiSP.c 
Learning  (New  York:    McCraw-Hill- 1971); 'Marcia  Outtentag  and  Elmer 
Struening,  ed . Handbook  of  Evaluation  Research  (Beverly^  Hills ,  Sage 
Publications,  1975);  Anderson,  Ball,  Murphy  et  al. ,  Ency clipped ia  of 
Educa I ional  Eva  1  ua t Ion ,  op  >  cit  ^ ;  ^  and  Borich,  Evaluating  Educat>ional 
Prograns  and  Products,  op.  cit>    Another  useful  ^nthesis  'is  Edward 
A.  Such=i^n,  Evaluative  Research  Principles  and  Practice  in  Public  Ser- 
vice and  Social  Action  Programs  (Mew  York:  "  Russell  Sage  Foundation, 
1967);    A  number  of  handbook-type  re^^erence  works  have  also  been 
published  for  practitioners,  ii^cluding  the  follo*sfii^g:    Lynn  Lyons 
Morris,  Carol  Tyler  Fitz-Gibbon,  and  Marlene  *E.  Henerson,  Program: 
Evaluation  Kit  (Beverly  Hills:    Sage  Publications,  1978);  Br<*ce  '-^^ 
Tuckman,  Evaluating  Instructional  Programs  (Rockleigh,  ^f.  J.t  Allyn 
and  Beicoa,  Long'.^ood  Divisioi^,  1979);. and  John  M.  Gottman  and  Ro^rt 
E.  Clasen,  Evaluation  in  Education:    A  Practi-tioner's  Guide  (Itasca, 
Illinois:    F.  E.  Peacock,  1972)* ^ 

The  evaluation  journal^  include  the  following:     (a)  Evaluation,  pub- 
lished by  the  Minneapolis  >1edical  Research  Foundation  Inc.  and  the 
National  Institute  of  Mental  Kealjfni  beginning  in  1972;  (b)  Evaluation 
Quarterly,  publishe<J  by  Sage  Pubjacations ,  beginning  dn\l-97.7;  Xc)  Evalu 
aAon  and  the  Health  Professions,  announced  by  Sage  Publications  'as 
^,  beginning  pjjblication  in  1978;  ^nd  (d)  Educational-  Evklu^ion  and   *^  ^ 
Polio/  Analysis,  a  publication  approved  by  the  AERA  Governing  Council 
late  in  1978,  to  be  the  newest  *AERA-spon^ored  journal. 

For  :r[St3P/:e,  si-e  Seln^  J-  Mushk^n,  "Evaluations;    Use  With  Cavitlon," 
"Evaluntion,  Vol.  \,  ^o.  2,  1973;  William  L/  Speizman,  "Evaluation: 
An  Evaluation  from  a  Sociological  Perspective,"  1974  Yearbook  of  the" 
^  I^.Ttional  Society  for  the  St^udy  of  Educyition  (Chicago:    University  of 
Chicago  Pres^,.  197^);  Egon  G.  Cuba,  "The  Failure  of  Educational  Evalu^i- 
tion/'  Educgtionl  TechnoloRv,  Vol.  9,  No.  5,  1969,  ret^rlrfted  in  Wei&s, 
Ev^luatinj^  ActioA  Programs ,  *op  >  cit.;  Carol  H.  Weis&,  ^*'The  Politiciza* 
tl^n  of  Evaluation  Research,"  injjjjjeiss,  Evaluatiln)^  Actiog.  Programs, ■ 
op.  clt.;  and  "Significant  Differences  on  the  SocLal  Insignlf Lcanca  of 
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0.  ^ 

Statisrrcal  Significance  —  A* Plea  for  New  Strategies  of  Evalua-  ^ 
^tion/'  Educational  Researcher  (N&ws  let  ter ) ,  Vol*  2Q^,*  October  1969*  \ 

16-      Araong  the  sources  useful  for  gaining  an  insight  in  to^  some  of^tJ:iese 
'  *  dilemmas,  see:    R*        Tyler^.ed*,  Educational  Evaluation:     New  Rolt^s,  . 

New  Means, .  68th  Yearbook  .of  the  National  Society*  for  the  Study  of 
Eduction,  Part  II  (Chicagt»:    University  of  Chicago  Press,  1969), 

'^nd  especially  the  f(;illowi*ng  articl^es  In  this  Yearbook:    Benjamin  S 
Bloom,  "Some  Theoretical  Issues  Relating  to  Educational  Evaluation," 
and  Robert  E.  Stake  and  Xferry  Denny ,^  "Needed  Concepts  and  Techniques 
for  Utilizing  More  Fully  the  Potential  of^Evaluation*"    Also  see  ^ 

-ejCcellenC  selection  of  articles  jCand  bibliography)  in  Weiss,  Evalua- 
ting Action  Programs,  op*  cit*    Also:    Rossi  and  Williams,  ed * ,  Evalu- 
ating Social  Pro^rauis,  op*  cit,;  W*  W*  Charters,  Jr*  and  John  E* 'Jones, 
'*0n  the  Risk  of  AppraTsing  ^Xon-Ev^ents  in  Program  Evaluation/'  Educa^     ^  » 
:_lan3l  I^as^rche^,  Vol*  2,  Xo*  11,  N'ove^nb^r  1973;  -Evans,  "Evaluating 
bdu^acion  Pr<igrams  -  Are  We  Getting  Anywhere?"  op*  ctt  * ;  Carpi  H*  Weiss, 
^^^'liere  Politics  and*  Evaluation  Research  Meet,*'  Evaluation^  Vol*  1^ 
\  No*  3;  1973;  Ernest  It*  House,  ed'*  ^  School  Evalu^io"^:    The  Politics 

*  and  Process  (Berkeley:    McCutchan^  1973);  *lLenfe  N*  Bernstein^  ''Validity 
Issues  in  i^valuative  Research/'  Sociolofiical  Methods  and  Research, 
August  1975;  and  Francis  C-  Caro,  '^Issues  itl  the  Evaluation  of  Social  , 

*Prograr.s/'  Review  of^ducational  Research,  Vod*  4l,^Ko*  2,*April  l97l* 

17*      Abett  data  as  adapted  and  cited       Biderman  and^  Sharp,  The  Competitive 
Evaluation  Research  Industry,  op:  p*  23* 

18*      Nelson  and  Mason^  19^  Federal  Funding  for  Education  Knowledge  Produc- 
tion and  Utilizataot^:    Pro.ject  Content  and  Performer^  By  Agency,  0£* 
cit* ,  Tables  15  and  16,  pp*  33-34*      .  v  - 

19*      Bernstein  and  Freeman,  Acd^demK  and  EntVepreneuriaif  Research,  op*  cit, 

 i   

20*    YB.  R*  Worthed  ^nd  R*  M*  Gagne ,  The  Development  of  a  Classification  r 
.SysteiaVfor  Funotions  aRd  Skills  ^Required  of  Resear-ch  .and  Reg^arch- j 
Velat^  Personne'W^  Edtioation  (Boulder,  Colora^^:  ,  AERA  Task  Forc^> 


^^oK^Research  Training,  Laboratory  of  Educational  iReseapch,  1969);  C*  V, 

R*  Uorthen,  Essentj.^  Knowledge  and  SkTIls  for  EducaP:! 
al  Re^S^at^h  and  Evaluation- (Bouifer,  Colorado:^  AERA  Taarfc, Force  on 
'  Research^^  Training,  Laboratory  of  Educational  Research,  1970);  R*  D* 
y        Anders^,  U*  M*  Sopfick,  W*  T.*,  Rogers,  and  B*  R*  Woisthen^  An  Analysis 
and  Inserpretation  of  Tasks  and  Competencies  Required 'of  Personnel 
Conduc'in^  Ex^fngl-iry  Research  and  RebP3rcn-R^latL*d  Activit  ieS' '  in  Edu- 
cation (Boulder,  Colorado:^  AERA  Task  Force 'on  Research  Training,^ 
Laboratory*Vf ^Educational  Research,  1971);  B*  R,  Worthen,  Some  Tasks 
and  CoTDpetencies  Frequently  Required  in  Educatlonarl  Research  and^,  Eval- 
ua.tion  (Portland,  Oregon;    Northwest  Regional  Educational  Laboratory, 
19?'0;  B*  R*  Worthen,  "Coripeeencies  for  Educational  Research  and  Evalu- 
ation,''  Educ^ti^^ia^^  Vol*  4,  Ko*  1,  January  1975)* 

21*      For  ini>tance,  see!    D,  L*  Stufflebean,  Proposal  to  Design  New  Patterns 
for  Training  Research ,  Development,  Demons tr at ion/Dissemlnati'o'n  and 

O  ^  '  -  V       ^  \ 
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Evaluation  Fersoaael  in  Education  (Washington:    DHEW,  197'0);  Paul  "^^^ 
Hoodp  Final'Report  of  h  Design  of  a  Survey  for  Determining  Train- 
infi  and  Personnel  Requirements  for  Edimational  Research^  D^eveloprnent , 
Dissemination,  and  Evaluation,  2  volumes  (Berkeley:     Far  West  Labora- 
tory for  Educational  Research  and  Develpp[nent>  1972)";  and  Richard 
A.  Der?ihimer,  U,  James  Popham,  and  William  J.  RusselH '  Development 
of  Ttainin^  Models  for  Educational  Research:    A  Conceptual  Scheme  for 
a  Professional-  Association  (Washington:    NIE,  1973), 

AERA  has  been  conducting  training  programs  ixeld  during  their  annual 
meetings  and  also  at  other^  times  of  the  year  organized  as  traveling 
training"  institutes,*    A^RA  has  also  developed  a  library  of  audio- 
training  tapes  available  for  purchase, '  Phi  Delta  Kappa  organized  an 
Evaluation  Training  Network  which  provides  training  workshops. 

For  instance,  see  Campbell,  "Reforms  as  Experiments,'*  op*  cit. 

For  instance,  see;    Egon  G,  Guba,  "Developments,  Diffusion,  and  Eval- 
uation," in  Knt}wledge  Prcfduction  Snd  Utilization  in  Educational  Ad- 
ministration^ T.  L.  Eidell  and  J.  M.  Kitchel,  eds,   (Eugene,  Oregon: 
Center  for  the  Advanced  Studies  of  Educational  Administration,  1968); 
and  Stufflebeam,  "Evaluation' as  Enlightenment  for  Decision-Making," 
op>  cit-  ^ 

See  especially  Scrimen,*  "The  Methodology  of  Evaluation,"  op*  cit. 

Evans,  "Evaluating  Education  Programs  —  Are  We  (letting  Anywhere?*' 
op.  cit. 

See,  for  instance.  Charters  and  Jones,  ,^'On  the  Risk  of  Appraising  Non- 
Events  in  Progfam  Evaluation,'*  op.  cit.    This  matter  was  treated  ex- 
tensively ia  our  chapter  on  the  , implementation  and  utilization  func- 
tions in*  educational  R/D^tl  •        "      ^  ' . 

For  instance,  see  Stufflebeam,  "Evaluation  as  Enlightenment  .for 
"Decision-Making,**  op.  cit.;  and  Stufflebeam  et  al . ;  Educational  Evalu- 
ation and  Oecision-Makina,  op.  cit* 

Weiss,  **Where  Politics  and  Evaluatid^isearch  Meet,*'  op-  cit* 

Ibid. ;  also  see  Weiss,  "The  Politica^ation  of  Evaluation  Research," 

op.  cit.;  and  Daviid  K.  Cphen,  *'Polltics  nnd  Research:  Evaluation^of 

Social^Action  Programs  in- Education,*'  Review  of  Educational  Research, 

Vol,  40,  4970,  ,  ^  ^ 

Vetss,  *'Wh^e  Politics  and  Evaluation  Research  Heet,'*  op.  cit\,  apd 
Laurence       Lynn,,  "A  Federal  Evaluation  Office?*'  Evaluation,  Vol.  1, 
No;  2,'  1973, 


Evans  ,  **Evaluating 
op-  cit- 


Education 


Programs 


—  Are       Getting  Anywhere?** 


Elmer  B-  Staats,  "The,  Clfellenge 'of  Ev/luatxng  Federal  Social 
Problems,"  Evaluation^  Vol,  1,  .No.  3^  1973. 

Jerome  T*  Mur-p^Ivy,  "Lelgfslative  Program  Evaluacion/'  Harvard  Gradu- 
ate Schiol  of  Education  Association  Bulletin,  VoL.  JO,  No*  1,  Fall/ 
Winter  1975A976,  f  ^    ^"^  ''  . 

Accojrding  to  J7  19^75  data,  89*5%  of  fjederal  funding  of  educational 
evaluations  is  obligated  through  OE*    S^e  Ward  S+  t'iason  and  ^fnot 
E*  Nelson,  "Federal  Funding  of *  Educational  R&D:    R&D  Function  by 
Agency,"  Educatlj&nal  Res^rcher,  Vol*  7,  1978,-  p*  13* 

,  ■■ 

For  instance,  see:    Office  of  Education,  Work  Statement  for  State 
ESEA  Title  I  Report^:    Review  and  AitalY-gis  of  Past  Reports,  and 
Qevelopment  of  a  Model  Reporting  System  and  Format  (Washington:  OE, 
1974);  G.        Tallmadge  and  D*  P*  Korst,  A  Procedural  Guide  for  VaCU- 
datlnfi  Achievameat^jCj.ins  In  Educational  Projects  (Los  Altos    Cali  forn 
ia:    RMC  Research  Corporation,  1974);  D*  P*  Hc^st,  G,  K*  Tallmadge, 
and  C*  T-  Wood,  A  Practical  Guide  to  Measudng  Project  Impact  on 
Student  Achievement  (Washington:^  Government  Printing  Officey  19  75); 
and  Office  of  Education,  Request  for  Proposals:    ESEA  Title  I  Evalua- 
tion Workshops  (Washington:    OE,  1975)* 
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The  project  reported*herein  was  performed  under  Contract  ff  NIE- 
C*-400-76-0110  for  thja  National  Institute  of  Education,  Department 
Of  H^al^h,  Education  and  ^'elfare,    Ho^raver,  tha  opinions  expressed^ 
herein  do  not  necessarily  ref lecf  the  position  or  policy  *t)S  the 
National  Institute  q£  E*ducation  atid  no  official  endorsement  of- the 
National  Institute  of  Education  should  be  inferred- 
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ADMINISTRATIVE  PROCESSES 


As  is  typical  o£  any  newly  developang  R/D6A  system,  concerns  for  mapag^a- 
ment  and  policy  making  processes  have  taken  a  low  priority  as  coinpared  to 
programmatic  concerns.    The  dilemma  is  classical-    Those  who  are  Jjost 
likely  to  initiate  an  innovative  thrust  are  least  likely  to  see  the  need 
tor  or  pay  atteijtion  to  effective  performance  in  the  "mundane"  problems 
of  institutional  ^nagement  and  the  "d^rty"  problems  of  policy  making 
This  has-been  the  situation  in  educational  R/Diil.    Little  attention 
given  in  the  past  to  such  issues  at  tite  practitioner  level>  and  man 
:*i^nc  for  educational  R/D£(I  was  not  seen  as  a  major  and  nec^assary  asp 
of  the  agenda  ttf  federal  funding  programs.    With  increasing  naturation, 
again    s  is  typical,  Concerns  in  these  areas  have  begun  to  appear.  Problems 
,of  organizational  design,  personne])  management  ►project  and  portfolio 
selection,  control  and  evaluation, /cash  flow  management,  'information 
f.  tnanagement,  etc.,  have  begun  to  pl^ague  managers  and  policy  bakers,  NIE 

V  j 

lias  begun  on  a  modest  scale  to  support  some  studies  of  management  and^ 
policy  making  processes  in  R/D&i/    The  time  would  thus  .seeiri  ripe  for  .a 
major  expansion  in  research  and  training  programs  devoted  to  upgrading^ 
the  quality  of  management  and  policy  making  processes. 


labile  little  attention  has  beep  given  the  management  of  educational  R/D&I, 
there  is  a  large  and  growing, body  of  literature  on  R/DfitP  management,  and 
we  can  therefore  identify,  in/ broad  outlines,  the  types  of  issues  and 
concerns  that  need  to  be  explqred  further  if  we  are  to  realise  significant 
advancement  in  the  management  of  educational  R/D&I. 

The  management  of  R/D&I  reaiiires  an  understanding  of  dynamics  which  seem 
to  be  generic  to  R/D£fl.    vkese  would  at  least  Include: 

-    R&D  is  by  definiticm  an  -area  full  of  uncertainty  and  risk,  especially 
as  one  moves  closer  toward  the  basic  research  end  of  the  RiD  spectrun. 


Because  w&  are  here  looking  at  general  r/DS.!  issues,  we  will  not  attempt 
^0  provide  references       that  would  be  a  monumental  task  by  itself. 
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©Both  the  nature  and  benefits"  of  R^D  outcomes  "may  be  unclear,  and 
it  is  oftdn  difficult  to  determine  cost,  skill  and  time  require- 
ments. 

Different  R/D6tl  functional  activities"  (i,e.  ,  research,  development, 
dissemination,  etc.)"  have  different  time  horizons  and  cost  require- 
ments.   Personnel  in  these  different  functional  areas  tenc?  to  have% 
different  goal  and  strategy  perspectives,  may  require  different, 
^ypes  of  incentives>"^etc,  . 

¥^ 

There  typically  are  censions  between  the  short  term  perspectives 
or  users  and  funders  of  R6tD -(leading  to  demands  ror  and  evaluation 
of  RStD- in  terms  of  "immediate  result^")  and  the'longer  tine  per- 
spectives inhj^rent  in' the  nature  of  R&D. 

\  r 

I 

Support  foV^t6D  in  general  and,  for  sp^ecifit  RfitD  prograimnatic  areas 
tends  to  be  cyclical, 

There  tehd  to  be  swings  in  emphasils  on  centralization  and  decen- 
trali2ati(^h  in  th^  matageinent  of  R/D6tl. 


-  The  control  requirements  for  R/D6tl  management  present  potential 
^    tensions  with  the  requirem^ts  of  creativity  and  innovation. 


Program  and  project  jnanagement  are  an  integral  part  of  the  management  of 

^  *  *  ' 

R/D6tl,    The  types  of  issues  that  lAPst  be  dealt  with  here  include:  programi 

I  .  .     ■  * 

land  project  selection'*  the  roles  of  and  interface  between  program  and 

I  '  ^  ' 

project  managers;    issues  of  balance  and. synergy  related  to  the  selection 
.and  developnteftt  of  projects  as^  part  of  program  portfolios  (rather  than 
having  a  Conglomeration  of  disaggregated  and  perhaps  conflicting  projects); 
relatedly^  issues  of  balance,  synergy  and  interaction  across  programs. 

The  manageinent  of  K/D6tl  must  b6  concerned  with  a  variety  of  critical  inter- 
and  intraorganizational  Interfaces.    Among  these  wouli^  be  the  interfaces 
between:    programs  and  projects;    the  various  R/Diil  functional  activities 
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(between  basic  and  applied  research>  beCwesn  research  and  development ,  etfc. ) ; 
Che  prod.ucers  and  users  of  knowledge;    departmenCs  within  organizations; 
different  organizations  (including  differences  in  the  type'  of  organizations 
;Lnvolved">  and  as  public/private>  federal/state  or  local).  ^ 


Closely  related  to  the  above  is  the  issue  of  information  flovs  within  and 
between  organizations!  whether  or*nbt  mechanisnis  *and  channels  for  infor- 
mation flow  exi^A  and  whether  they  are  used  or*  not  (and  by  whom);  choice 

among  mechanisms  and  channels;    incentives  and  disincentives  or  oth^r 
t 

barriers;  etc. 

Staging,  and  phasing  dynamics  present  "Special  concerns  for  the  management  of 
R/D5iI,    For  example>  the  type  of  and  requirements  on  R/D5il  management  may 
yary  significantly  across  different  stages  or  ph'ases  of!    a  program/project 
cycle  (e*g.:     initiation>  implementation >  tran&fer  of  ojltputs);  product- 
life  <;ycles;     level  of  .maturational  development  of  an  ^organi  zation  or  system 
(including  instances  where  differences  in  maturational  levels  exist  across 
the  different  R/D5iI  functions  or  across  different  organizations).  Here 
alsd  arise  manageoient  issues  of  timing  and  transition  across  stages  or 
steps  in  a  prbcess>  and/or  from  one  department  or  organization' to  anoijher;  , 
and  of  transition'  f  rom  *one  phase  of  maturational  development  to  another; 

Coordinatio^^is  at  the  very  center  of  critical  R/D&I  management  tensions 
such  as  the  management-of  interf^c6  relaj;ionships ;    the  allocation^of  scarce 
resources  in  the  light  of  uncertainty  and  risk;    the  need  to  be  innovative 
vs,  the  need  to'solve  '^practicgtl"  problems;    coordinating  research>  develop- 
ment >  dissemination >  etc,  in  light  of  their  differences  in  time  horizons 
and  cost  reqjUirCm^nt^;     the  difference  in  perspectives  >  missions  and 

needs  of  ko6wledge  producers  and  knowledge  users;    how  to  deal  with  system 
"gaps";    tensions  between  "political''  and  "technical"  perspectives;  and 
so  on,    Qijfestion^  arise  as  to  the  type  of  coordination  mechaiiisms  to  use; 
whether  c^ordin^iion  should  be  through'  formal  organizational  mechanisms> 
through  leadership  or  consensus^-developing  types  of "^rocesses>  or  through 
more  emergent >  developmental  processes;    the  dynamics  of  the  relationship 
I  ^      '  . 
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between  the  parties  Involved;    coordination  issaes  arise  within  an  organi- 
zation,  between  an  organization  an<i  other'  organizations,  and  across  an  * 
entire  R/D&I  system  or  sector-     In  this  latter  case,  the  term  "orches*- 
tration"  may  appropriately  depict  the  litikage  and  coordination  needs^ 
among  a  set  of  separately  autonomous  organizajtions,  where  such  issues  as 
turf^j  competition  vs.  collaboration,  "etc*  * ,  come^J^to  play** 

From  a  broad  R/D&I  system  or  sectot  perspective,  a  number  of  R/D&I  jnanage- 
ment  issues  arise"-    Of  particular  importance  are  the  roles  and  relationships 
of  public  vis-a-vis  private  agencies ,  funding  agfencies  vis-a-yis  funding 
recipients,  and  knowledge  producers  vis-a-vis  knowledge  producers-  For 
example^,  what  should  be  t^e  agency/field  reldtiohship  regarding  funding 
emphases  and  program  or  project,  selection  of  a  Federal  funding  agency?  ^ 
More  broadly,  to  what  extent  and  iri  what  ways  should  and/or  can  any  single 
institution  provide  a  'llead  agency"  role  in  R/D&I  system  orchestration? 

■  4 

The  above  discussions  illustrate  the  ra^nge  of  critical  R/D&I  management 
issues*    While  there  is  a  large  body  of  relevant  literature,  it  is  no 
exaggeration  to  say  that  compared  to  other  R/D&I  sectors,  educational 
R/D&I  management  is  a  virtually  unstudied  and  unfooiulated  "area .  With 
the  exception  ot  some  literature  in  the  areas  of  change  and  innovation  in 
schools  and  some  recent  general  examinations  of  educational  R^iD,  there  is 
nothing  to  com^pe  with  the  resources-  (books,  journals,  ^Associations,  etc-) 
in  R/D&I  management  as  can  be  found  iri  other  R&D  sectors- 

This  does  raise  the  question  of  possible  transfer  of  R/D&I  management 
technologies  from  other  sectors  to  education.    While  this  does  hold  impor- 
tant possibilities,  it  is  ecjually  important  first  to  recognize  the  many 
ways  that  differences  in  sector-specific  contextual  factors  can ' inf luence\  *' 
both  the  nature  of  R/D&*1  management  requirements  and  the  applicability 
of  specific  R/D&I  management  technologies*    For' example,  there  may  be 
significant  variations  across  sectors  in  stich'matters  as\  constituencies 
served;    sources  and  forms  of  extemal^pressures;    concept  of  a  "product**; 
innovation  capabilities;    differences  in  knowledge,  pecspnnel  and  insti- 
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tutional,  bases,  nature,  sources  availability  and  availabilit>^f  incentives 
and  disincentives, 

Thus,  we  may  note  that  the  r/d&I  management  field  has, .for  the  most  part, 
grown  out  of  sectoral  contexts  that  vary  in  significant  ways  from  the 
educational  context.    Industrial,  military,  nuclear  and  aerospace  R&D, 
have  been  the  largest  contributors  to  this  field,  yith  contributions  also 
being  made  in  health  and  agriculture,    These  sectors  tend  to  differ  froin 
education  in  the  ways  just  noted,  *  Further,  the  underlying  scientific 
disciplines  in  these  sectors  are  primarily  the  natural  and  biological 
sciences,  while  educational  R/D&I  builds,     to  an  important .degree,  on  a 
social  science  knowledge 'base  and  applies  th?  products  of  R&D  to  sensitive 
social  systems  that  arfe  highly  diffuse  and  complex, 

l^ile  it  is* the  purpose  of  this  volume  to  describe  more  fully  the  various 
aspects  of  the  educational  R/D&I  context,  we  may  note  here  that  it  is  a 
multi-disciplinary,  political,  value-laden,  immature  and  vulnerable 
context  —  factors  which  will  significantly  affect  the  management  of 
educational  R/ffid, 

It  may  be  hoped  that  a  growing  maturity  in  educational  R/D&I  will  lead  to 
a  growing  recognition  of  the  need  to  study  the. management  of  educational 
R/D&I  "  both  to  determine  the  specific  R/D&I  management  dynamics  and 
requirements  in  the  education  sector  and  to  be  able- to  utilize  approxi- 
mately, and  effectively  the  existing  body  of  krK)wledge  about  R/D&I  m^nafee- 
ment  gained  from  other  sectors*  *  As  was  noted  at  the  beginning  of  this 
discussion,  the  time  does  seem  ripe  for  such*  an  undertaking* 
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I>    THE  PRODUCTION  FUNCTION  tN  GENERIC  TER>1S 

In  most  R/D6fl  systems,^  the  production  function  represents  a  crit?a'cal 
linkage  between  knowledge  production  and  knowledge  utilization.  The 


9utput»of  knowledge  producing  processes  cannot  be  utilized  by  po- 
tentiST  consumers  unless  they  can  be  produced  in  adequate  quantity 
and_  quaflity,  in  appropriate  forms,  and  at  acc^eptable  prices.  Generally, 
the  production  process  requires  translating  a  developed  product  or 
proto'i:yi)e  into  a  set  of  product  spee^if icafions  and  engineering  re-^ 
quirements  for  the  production  process,  establishing  quality  control 
procedures,  determining  what  production  -skills  are  needed,  prlanning 
production  arrangements  and  controls,  assenmbling  the  needed  capitol 
and  other  resources,  negotiating  with  suppliers  and  possibly  also 
subcontractors ,  etc,  .  .  - 

II.    LOW. PRIORITY  OF  PRODUCTION,  ISSUES  I«  EDUCAT/IO^JAL  R/D&I 


Examination  of  what  is  involved  in. the 'production  of  educational 
R/D&I  autpn,ts  suggests  why  production  issues  are  of  relat>ively  low 
priority. and  minimal  concern  in  educational*  R/D&I.  In  e^ucationi 
essentially  all  design  and  development  work  is  subsumed  under  the  i^ 
research  ^nd  development  functions*  Th^  prodiiction  f^nct^ion  is  ed- 
nucation^  as  we  have  conceptualized  it,  is  restricted  simply  to  tjie  ^  - 
.repro^uctiqf^^^or  manufacturing  in  quantity  of  fully  developed  and  tested 
%4iems»  "Prjjjiuction"  per  sq,  then,  is  either  nbn-existent  in' that  the 
mass  production  scage  is  never  reached,  or  it  is  little  different  from 
production«*-iil  other  fields.  \ 

'^V  i  ■  '  '    '  ■  "  '  ■ 

A  few  ^xamjples  should  illustrate  the -point,"  Usin^  our .  t;ermiTwlogy, 
the  taping  and  editing  of  Sesame  Street  segments,  for  instance,  though! 
referred  to  In  xhc  tele^^f4ion  industry  as  "production'',  is  really  part 
of  the  development  functiob,  A  considerable  .amount  of  creativity  may  be 
involved  in  both    the  taging  alid  the  editing  processes,  and  a  numbelpj 
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6f  decisions  made  during  these  processes  may  affect  the  finished  * 
product  as  much  as  the  original  scripts  written  for  the  segments.  In 
,    this  instance,  **pr€«iuction">  as  we  use  the  term>  is  restricted  to  re- 
s    producing,  the  finished  tapes'  for  distribution^  a  process  no  different 
.  for  education  'than  for  the  entertainroenf  or  advertising  industries- 

\  ,  / '    ;  ^  .  /         '  ■ 

:To  take  another  example,  as  we  are  using  the  term,  t*he  ''production**,  bf 
a  multimedia  instructional  system  (including  print,  film,  audio  t^pes, 
*and  interactive  computer  console  compdyients)  involves  the  reproduction 
or  marflfacturing  in  quantity  of  each  item *ir>  the  system  (as  previOusly- 
,    desig^d  and  revised  by  the  product's  developers  and  evaluators),  and 

perhaps  the  packaging  of  each  set  of  items  as  a  complete  multimedia 
^    .system.  All  the  usual  production  issues  come  into  play  —  e-g-,  assur- 
ing  a/iequate  sources  of  materials,  training  and.  supervising  production 
workers,  a:ssuring  quality  control  of  the  finished  products,  controllings' 
costs,  ,etc<  But  none  of  these  issued,  and  none  of  the  product-ion 
activities  involved,  would  seem  in  a^tiy  way  specific  to  education* 


Similarly,  producing  a  textbook  or 'set  of  {)rinted  materials  for  the 
education  sectoj-  is  no  different  from  producing  books  and  printed 
materials  for  other  sectors-  Much  of, the  same  could  be  said  about  * 
produc  ot  equipment,  or  how"tO"do-it  manuals,  fpr  innovative 

change  processes  or  instructional  programs,  and  so  on  for  all*,  the 
various  inno^tive  output's  o^f  educational  R/D&I* 

\<e  do  not  mean  to  impfy  that  producers  uho^supply  equipment  to  schools 
fie^  not  worry  about  the  mechanical  quality  and 'durability  of  the  tape 
r^brders,  audiovisual  equipment,  etc-  that  they  provide.  Continual 
equipment 'fereakdo^s  are  no  more  likely  to  be  overlooked  by  scljool 
districts  than  by  other  clients  in  making  futurje  purchasing  decisions, 
(There,  are  already  equlpmentjU^jesting  organi^^ations  such  as  the  edu- 
cational Products  Information  Exchange  that  specialize  in  providing  - 

Iff"- 
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providin^consumer  product  information  for  the  education  ^sector*)  Our 
point  is^is»ply  that  the Vverwhelming  majority  of  educational  products, 
programs,  and  other  R/O&I  outputs  are  software  rather  than  hardware, 
thi^  predominant  jnedium  is  print,  and  the  ke^  issues  of  performance  and 
reliability  of  such<  products  have  less  to  do  with 'possible  breakdowns 
in  the^  production  function  (as  we  have  defined  t>iis)  than  with  weak- 
,nesses  in  the  development  function  <?r  the  implementation  process.. 

III-  INSTITUTION'AL  BASC  AND  FORMS  OF  PRODQCTION  IN  DIFFERENT  SETTINGS 

<^         '  ^  . 

Product  the  education  sector  tends  to  take  one  of  two  forms,  da-' 

pending  generally  on  the  type  of  institutional  setting  in  which  it  takes 

'  place*  Id  amounts  to  little  more  tj:ian  reproduction  of  copies  of  mater-- 
ials  —  m^eographing,  photocopying,  etc*  —  in  the  case  of  most  R6D 
jorganizations,  and  even  more  so  in  the  cafee  of  practice-based  (ievelop^    .  * 
mervt.  Considerably  more  cfomplex  forms  o£  produdta^n  tend  to  be  involved 
in  the  commercial  production  of  outputs  —  e.g*,  the  production  of  text- 
books,  fijlms,  audio-visual  materials  and  equipmentf^'^dtc.  The*JB|stitu- 
tions  that  provide  these  production  capabilities  include  publishers, 

,film  produci^ioti  companies,  manufacturers  of  hardware  and  e()uipment, 
etc*  and  tend  to  be  sector-spanning  in'nature  (i-e*,  they^produce  out- 
pjats  for  not  only  the  education  sector  but  also  several  other  fields  | 
as  well*)  .      -  * 

There  is  generally'a  considerable  difference  in  appearance  between  the 
products  that'co^e  from  the  comercial  firms  and  the  outputs  of  ^he' R&B, 
institutions  and  practice-based  "settings,  s^ojumercj^al  publishers  ^ener- 
ally  strive  for  a  high  quality  prirtt  produc't  using  costly  mat^itials  and 
*produ9tion  techniques*  On  the  other  hand,  the  gloss  of  commerci'al  pub^ 
^ications  is  generally  absent  from  the  outputs  of  R/D&I  orgatiizations** 
To  some  significant  degree,  this  appears  to  be  a  consequenci  of  clearly 
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articulated  policy  decisions  of  educational  R&D  sponsors  and  contractors. 

Educational  R/D&I  decision  makeirs  haye  opted  consciously  for  allocating 

'  J-  ^  >  >       '  * 

maxiinal  resources  to  the  research>  design,  development,  and  evaluation 

of  tHe  Substance  of  the  i(paterials  >^aTici  the  barest  mlViiinura  to  production 

—  justi  enough  to  insure  that  a  suffeifcient.  quantity  of  usable  materials 

can  b"e  distributiad  to  operating  sy3l:™s.    School  personnel  are  as 

likely  to  anyone ^^Ise  to  be  attracted  to  beautifully  printed  materials 

with  exquisite  graphics  and  layouts.  &ut  their  wi^jLingness  to  adopt 

and  dijje  ejcce^lLent  timte^sials  that  happen  to  be  produced  by  means/of  . 

offset  or  xerox  machines  ^hou^l^  not       parti'cularly  surprising:  the 


teacher-made  materials  that  make  UR  pe  bulk  of  what  is  used  from  day 
to  day  in  classrooms  are  likely  "to  be  reproduced  by  such  inelegant 
technaiogies  as  mimeograph  arid  ditto  machines, 

IV,''  ARRANGEMENTS  TO- STRENGTH  EH  LINKAGES  TO  PUBLISHERS  AND  OTHER 

 ;^  "  

PRODUCTIO^^  ORGANIZATIONS 

■  "b 

There  have  Seen  S(3me  notable  instances  of  collaborative  relationships 

between  R/D&I  .organizations  with  strong  development  capabilities  and 

commercial  publishers  who  can  provide  high  quality  production  facil*- 

-  .  *^  *  ' 

ities,  ProbablJ?'  the  mast  frequently  cited  of  these  is  the  arrangement 

between  Appleton  Century  Crofts  and  the  developers  of  Individually 

■  2 

Prescribed  Instruction, 


Two- notable  federal  initiatives  were  undertaken  to*  increase  the  poss- 
ibilities for  commercial' marketing  of  R&D  outputs.  One>  the  Copyright 
Approval  Progran,  allows  t^J)yrights  to' be  granted    on  materials  devel- 
oped with  federal. funding.  It  supersedes  the  former  "eminant  domain" 
policy  J  and  thereby  provides  a  financial  initiative  for  cornniercial  pub- 
lishers  t6  use.  their  resources  to  produce  and  market  these  materials. 
Between  196<)  (when  *t his  policy  was  put  into  operation)  and  1976  (when 
apta  on  this  was  reported)  >  more  than  550  authorizations  for  copyr^ights 


•  '  3 

had  been  granted  under  this  program. 

Thk  other  effort^  a  Publishers*  A^-^^^t  Service,  was  created  in  1972  to 

m^ke  publishers  aware  of  various  sets  of  materials  developed  under 

federal  funding  that  were  becoming  |ivailable  for  puWitfhprs  to  produce 

and  market.  HoweveXj  the  publishing  industry's  response/to  more  than 

97  "Publishers'  Alerts'*  distributed  to  them  led  NIE  to  suspend  this 
4 

service  in*  1976*  .    -         .  ,  . 


Stillj  there  .appeirs  to  bs  a  readiness  .on  the  part' of  at  least  some 
publishers  to  take  a  more  active  role  in  the.  production  and  laarketing 
of  R&D  outputs,  if  Adequate  incentives  can  be  made  available  "and  if 
the  RfitD  outputs  seetn  to  be  of  sufficiently  high  quality  to  warrent  their 
investment^  "  '  - 

Whatever  may  be  possible  for  the  future,  at  present  these  arrangements 
are  relatively  few  in  number;  the  existing  linkages  appear  to  be  ten- 
tative and  experimental;  and  as  yet  the  production  function  is  barely 
visible  in  the  corffiguration  of  educational  R/DScI* 

v.   future  data  sathering  and  analytical  ^work  when  the  state  qf 
systSi  development  warrants  attention  to  production  issues 

Before  we  will  be  in  a  positi6n  to  strengthen  the  production  function, 
we  will  need  to  know  considerably  mote  than  we  do  know  about  the 
ancillaXy  system  o^support  services  linked  (or  with  the  potential* 
for  link^e)  in  various  ways  tOt  the"  educational  R/D&I  s^yst^*  For  ^ 
Instance,  we  will  need  to  knov  more  about;  numbers  and  types  o£  pub- 
.  lishers,  film  and  videotape  laboratories,  data  processing  organisations, 
etc.;  their  specialised  capabilities;  scale  of  operations;  costs  of 
services ;  etc .  ■  ,  ^ 
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It  would  .be  usefibl,  too,  to  know  what  linkages  now  elKist  between  these  . 
protfuctlon  facilities  and  existing  r/d&I  performerfff  distribution 
channels >  etc.  Inforination  of  this  Icind  might  possibly  be  gathered 
in  some  future  cycle  of  the  ovganizati^nal  survey  conducted  by^NIE's 
Education  KPU  Monitoring  Program,  if  this  program  continues.  The  list 
of  production-relevent  organizations  generated  by  this  research  might 
then  be  used  as  the  basis  for  sampling  frames  for  subsequ^afif^n-^eptjj 
research  on  the  production  capabilities  able  to  supg^ji^che  functioning 
of  tbe  educ3tlonal%/D6Ei  system. 


However^  as  we  noted  earlier,  produfctlofTissues  are  not  of  high  priority 
jjin  the  management  of  the  educational  R/D&I  system*  Given  the  nature  of 
educational  Rfij)  outputs  and  their  "pridyction" ,  these  matters  may 
never  become  of  great  consequence  foi^^e  management  of  the  educational 
R/D6eI  systeiA,  At  the  .very  least,  they  are  not  likely  to  be  given  much 
attention..   Until  the  system's  KP  functions  and  resources  are  suff* 
iciently  strengthiened  to  ^make, available  a  substantial  number  of 
outputs  fop:  masd#*productlon>  and  until  the  financial  resources 
operating  system  acquisition  processes  are  substantial  enougt 
warrant  the  degree  of  gloss -afld  quality  that  commercial  production 
organizajiions  can  provide  best, 

^Clearly,  then,  this  data -gathering  and  analytical  work  on  the  'production 
function  can  be  shelved^  at  least  until  some  future  time  when  KP  iksues 
may  be  resolved  sufficiently  to  allow  policy  makers  to  shift  their 
attention  to  such  other  matters  as  strengthening  production  capabilities 
^or  large-scale  production  of^high  quality  output^. 
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.  I.     SUPPORT  SYSTEM  ISSUES  GENERIC  TO  ALL  R/D&I  SYSTKIS 

'  R/D&I  systems  arc  ra^rely  totally  s^lf-contained ,    They  generally 
re.^ire  support  services  from    other  systems,  organizations,  and/or 
sectors.    Different  support  services  are  generally  required  for 
different  K/D&I  functions  and  activities.  j 

We  have  noted  elsewhere  a  number  of  key  issues  that  need  to  bfe  ex- 
plored to  understand  the  relationship  between  an  R/D^I  system  and 
the  support  systenis  on  which  it  relies.^    Sqnie  of  these  issues  have 
to  do  with  suppjort  service  requirements  (e,g,i  determining  the 
tern's  requiretna^tfi  f<;>r  diff erent " kinds  of  Supp6rt  services,  the 
level  of  sophistication  and/or  specialization  required  in  the 
various  services,  and  how  these  requirements,  may' differ  ^^y  R/D&I 
functions,  institutional  type^,  product  types,  and  level  of  matur" 
ity  of  R/D&I  system  functioning).    Other  issues  relate  to  tjhe  char- 
acteristics of  the  services  available  (e.g,,  quantity,  quality, 
level  of  technical  capability,  and  costs),.    Still  other  issues  re- 
late to  linkages  to  support  services  (e,g,^,  what  linkages^  exist, 
what  gaps,  and  what  barriers  or  constraints  to  linkage)",    A  key 
set  of  questions  revolves  around  the ^extent  to  which  a  system  is 

'  either  able  to  provide  such  services  for  itself  or  must  "rent*'  or 
buy' the^e  services  ^rom  outsid"^  the  system,  which  services  should 
or  shoi^ld  not  be  provided  by-  fixe  system  itself,  and  what  the  ef- 

^  fects  are  likely,  to  be  of  de^ndence  on  other  systems  for  the  p>ro- 
visiori  o^  different  service^,      *  v  "  ■ 

The  educational  P,/D£I  system^  has  inot  yet  begun  tq  consider  such" 
matters.    The  primary  institutional  base  of  educational-  R/D&I  pet^ 
forming  organization  is  still  so  w,eak  and-  immature  that  support 
services  have  riot  as  yet  been  seen  as  a  signiflc^ant  concern.  And 
\^  this  is  as  it -should  be.    However,  with  greater  system  matur*ity; 
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support  service  requirements  may' warrant  greater  attention*  ^ 

ir.  -  SyPPORT  SERVICES  FOR  EDUCATIONAL  R/D&I:    THE  CHANGES, BROUGHt 
BY  LARGE-SCALE  RESEARCH  AND  R&D 

As  educational  research  and  K&p  aQtivities  have  lexpar^ed  in  scale, 
the  traditional  research  pattern  of  the  indicidual  scholar  working 
relatively  alone  in  his  study  or  his  labor^^frtJry  has  been  replaced 
by  team  research  under  corapl-4x  organizational*  and  int6r-organiza-  , 
tional  arrangements,  supported  by  a  cojnplex  su^ijDrdihate  system  of  * 
mostly  sector-spanning  private  "ctirporatif>ns  providing  sei;yices  and 
supplying  and  maintaing  equipment^ 

Included  in  this  supports  system  are  the  traditionaL  research  sup- 
port  services  —  e*g*>  research  libraries  and  suppller3  and  main-- 
tainers  of  the  equipment  Used  in  laboratorl^,  ^  Also  included,  how- 
ever, are  suppliers  and  maintainers  of:  the  kinds  of  equipment  and 
services  ttiat^^d^5*lngu:jfeK^  ^      newer>  lar^geiT'^sc^le' research  and  R&D 
from  the  older,  smaller-scale  research  and  R£tD*pattern  —  e-g*, 
computer  centers>  data  processing  service  buife^p^,  ^^nd  completer 
maintenance  serv:^ces;  tlte  suppliers  and  tnai^talners  *of  calculators, 
photocopiers >  typewriters  aifra  other  office  eqi/ipment  and  of  the 
various  kinds  of  audiovisual  hardware  that  arej  be'comxng  so  prom^ 
inent  in  instructional  system  development;  the  film  laboratories, 
v;LdeQtape  editing  facilities,  cassette  Reproduction'  laboratories, 
and  printing  and  publishing  facilities  that  play  such  important 
support  roles  in-  the^porduction  of  materials  and  complex  multi- 
media instructJlonal  systems;  survey  research  service  organisations 
that  play  a  dual  role  both  as  R/D&I  performers  on  projects  of  their 
own  and  as  suppliers  of  support  services, for  other  p/D&I  orgnnisa-* 
tions;  and  the  various  mechanisms  and  arrangements  that  exist* to 
protect  proprietary  rights  -for  R&D  outputs  that  are  not  clt':irly  in 
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the  public  domain*     Included  too,  especially  for  the  larger  and  more 
complex  projectSj  ^re  secretarial  atid  clerical  servicesj  generally 
but  not  a^way?  provided  internally* 

111.     AN  INADEQUATE  KNOtJLEDGE  BASE'on  THE  SUPPORT  SYSTEM 

 "  r — ^  

There  is  relativ^y  Aittle  in  the  puT)lished  literature  about  the 
subordinate  systeioVAf  -support  services  for  Ediicaeional  R/D£iI*  We 
assume  that  there  is  a  great  deal  of  information  in  the  files  of 
feder-^l  agencies  a^id  ?70^tI  organizations  that  icould  be  useful  for 
assessing  the  scale>  distribution,  organizational  capabilities >  and 

*- client  service  patterns  of  the  various  support  systferas;  the  rela- 
tive cost-e^f^tiveness  of  the  in-hei^^e  .vs*^  external  strategies  for 
supplying  different  support  services  (eVg*,  data  processing  or  sur- 
vey  jesearch  units)  for  different  purposes  in  different  types  of 
organizational  settings;  and  the  strengths  and  weaknesses  of  various 
kinds  of  procurement  arrangements  that  are  used*    Some  Analytical 
work  might  provide  a  considerable  amount  of  useful  information  from 
these  existing  {lata  sources.  ' 

*-  ' 

In  addition,  information  about  linkages  to  aupport  services  may  be 

fnerated  from  future  cycles  of  the  organizational  survey  conducted 
part  of  NIE's  Education  KPU  Monitoring  Prcygram>  if  this  program 
continues*    Lists  of  ^support  service  providers  might  be  generated 
from  this  work  and  used  as  a  basis  for  sampling  frames  fpr  subse- 
quent in-d^pth  research  on  the  services  used  to  support  various 
kinds  of*R/D&I  activities  and  "^ypes  of  organiza^tions  performing 
these,  activities,  to  determine  from  R/D&I  performers  what  support 
services  they  use,  the  extent  to  which  they  rely  on  Soari:es  within 
or  outside  the  educational  R/V&l  system  for  these  services,  and  the 
implications  of  these  different  use  patterns*  -         '  ' 
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Transfer  of  support  sysjtem  management  strategies  frocn  other  sectors., 
might^^^b|,,*^«omplish^  with  relative  ease  once  the  configuration, 
dimensions,  and  service  patterns  of  the  support  system  for  educa- 
tional R/DjSil  are  clarified  and  related' to  those  ^contextual  condi,- 
tions  tjiat  function  as  constraints  on.  the  procurement  and  provision- 
of  support  services  for  the  educational  R/D&I  system*    However,  ^ 
work  of  this  kind  is  clearly  a  Ipng  way  off*    It  is  not  likely  to 
warran&*priority  .attention  until  tjie  institutional  base>of  R/DS?I 
performers  is  suf ficient;iy  strong'^a'nd  mature  to  permit  syscetiu-pol- 
icy  makers  to  shift  their  attention  to  strengthening  ther  various  , 
systems  of  supijort  services  required  "for  educational  R/D&I  funct^iqft- 
ing.    Still,-, system  policymakers  shduld  be  aware  of  the  siabordinate 
system  of  support  services  and  keep  it  iT^™ind*as  an  area  for  poli-' 
cy  development  at  ^ocie  futuT;e  point  in  the  historical  development 
of  educational  R/D&I-  *  " 


( 
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THE  EXISTING. ilTERATURE  *  .  .   *  *  "  . 

Factors  Accounting  for  Prolifer^ion  of 
Literature  on  Educational  R/DSI  , 

Functioning   

Types  of  Literature  .  .  *  *  

NEEDED  INITIATIVES  i  / 


Two  of  the  inost  significant  indicators  of  the  maturity  of  an  r/d&I 
system  niay  be;  the  state  of  development  of  research  on  the  R/D&t 

♦ 

system  itself,  and  the  extent  to  which  data  on  system  functioning 
is  used  as  a  basis  for  policy  formation. 

♦ 

There  is  a  sizeable  literature  on  the  functioning  of  educational 
R/D6I.     (We  have  been  attempting  to  review,  synthesize,  and  assess 
that  literature  throughout  this  volume.)    But  there  is  relatively 
little  of  what  we  would  describe  as  either  R&D  system  studies  in 
a  **research-on-research"  mode  (i*e,,  systematic  studies  of'the 
research  and  development  process  for  purposes  of  increasing  know- 
ledge about  the  R&D  process  and/or  as  an  aid  to  decision  making  and 
policy  formation*'  )-    And  th^re  is  little  if  any  evidence  that  what- 
even  data  hav^been  gathered^on  system  functioning  have  signifi- 
cantly affected  system  policy  formation  or  decision  making. 

Iri  this  chapter  we  will  £icamine  first  what 'is  availabe  in  the- 
literature,  a*nd  fWen  turn  to  what  more  may  be  needed  to  further 
<he  maturation  of  the  educational  r/d&I  System,  inform  system  policy 
dex^elopment,  and  improve  system  functioning* 

I.  THE  EXISTING  LITERATURE  ^ 

♦  ♦  - 

1.    Factors  Accounting  for  Proliferation  of  Literature  on  Educational 
r/D&I  Punotioning  *  _ 

Given  the  relatively  brief  histojy  of  educational  R/D&I,  there  is 
an  astojiishingly  large  accumulation  of  analyses  and  empirical  research 
on  the  functioning  of  the  system*    This  is  attributable  in  part  to 
the  negative  political^  cliiglte  in  which  Uhe  system  functions  —  the 


system* 
Lwte  in 
jress  anc 

educational  R/D&f  enterprise*    As  commented  on  in  early  literature. 


lack  of  confidence  in  Congress  and  various  federal  agencies  In  the 


*Thi3  chdJter  presents  in  summary 'form  material  that  will  be  expanded 
^Ktensivaly  in  the  next  draft  of  this  volume,  already  in  preparation* 


1227  ■ 


thete  has  been  a  tendency  to  pull  the  system  out  by  its  .r<5^ts 

T  ^ 

every  couple  of  years  ^to  see  how  well  it  is,  growing  atid'to  duster- 
mine  how  its  effectiveness  might  be  improved.    A  lArge  number  of 
these  analyses  were  conducted  by  or  for  federal  agent^ies  or  Congress 

sional  committees*  ^ 

ft  '  ' 

t 

<* 

A  second  factor  of ^ some  importance  in  accounting  for  the  large 

number  of  anal^^ses  was  the  increasing  self  ^consciousness  of  the  ' 

social  sciences  in^the  late  '60s  as  to  their  proper  role  in  relation 

to  governmental  agencies  and  the  utilization  of  social  science 

knowledge.    Some  of  the  relevant  literature  was  provided  by  study  * 

commit/te^s  of  the  National  Academy  of  Sciences  -  Katonal  Research 

'  ^  *  ^  f 

Council;  the  Matonal  Science  Board;  the  National  Academy  of  Education; 

the  President's  Scieace  Advisory  Coinmittee. 

* 

Some  of  the  relevant  literature  is  traceable""  to  an  international 
stimulus  a  request  from  t"he  Organization  for_Econoraic  Cooperation 
and  Development  (OECD)  for  OH  to  participate  in  a  crossHnational 
review  of  educational  R&D  and  an  analysis  of  how^R&D  might  be 
strengthened  to  d^ncrea^  its  potential  for  improving  educational 
practice*  *  -  '  , 


Some  of  the  more  recent  literature  is  the  result  of  the  emergence 
of,  knowledge  production/utilization  as  a  new  research  area  in  the 
educational  research  community 


But  probably  the  most  important  impetus  of  all  in  recent  years  has 

cope  form  the  sporrsors  of  educational  R/D&l,  not  only  0£  and  N'lE 

biJc  also  private  foundations  such  as  Russell  Sage  . —  e»g.,  their 

srrong  interest  fn  evaluation  research  as  a  basis  for  policy 
J '  6  *  ' 

formation,  and  their  initiatives  to  support  the.design^  develop- 
ment, and  utilization  of  routinely  collected  data  bases  fotr 


f 
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monitoring  the  progress  of  the  educational  KPU  system,  detecting 
problems,  and  deterniining  the  impact  of  policy  initiatives.^ 


2*  '  Types  of  Literature      ^  '  , 

The  literature  can  be  categorized  into  eight  tvpes  of  presentations: 

1,  '^distillations  of  Expect  analys^is  and  opinion; 

I 

2,  systematic  empirical  evaluations  of  particular  components 
,or  outputs  df  the  educational  R/Dcfl  system; 

3,  secondary  analyses  of  'existing  data;  ' 

,    4-    case  studies  of  exemplary  educational  "R/D&I  projects; 

.    5*    syntheses  of  the  relevant  literature; 

6*    conceptual  work  on  system  definition,  mapping  the  domain 
of  educational  R/D&I,  developing  and  integrating  concep- 

s 

tualizations  of  the  nature  of  the  system,  and  identifi- 
^^cation  and/or  exploration  of  conceptual  issues; 


^  7*    pblicy  studies  on  "system"  issues;  and 


8*    Outputs  of  the  Education  KPU  monitoring  Program  (including:- 
descriptions  of  the  data  base  and  monitoring  program  and 
al^o  data  gathered  under  that  program)^ 

t&Jch  of  the  relevant  literature  (and  virtua'lly  all  of  it  that  was 
produced  during  the  first  few  years  of  the  federally  funded  system's 
history)  falls  into  the  "distillation  of  expert  analysis  and  opinion" 
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^category.    These  analyses  were  generally  based  on  interviews;  site 
"visits;  examination  of  materials  in  agency  files;  perusal  of  system 

outputs ;of  the  insights  of  individual  members  of  advisory  panels >  or 

*  8 
the  judgments  or  recommendations  of  tull  advisory  panels,  i 


Systematic  empirical  investigations  make  up  the  seconc!  largest 

category  —  e*g.,  evaluations  of  personnel  training  programs;  or 

*^"*10  *       '  11 

ERIC  information  product?*];      or  pilot  state  dissemination  projects; 

6r  AERA  meetings  an^KJourn^l  publications  as  critical  elements  In  ' 

^  12 
the  XP  information  flow  syslen  in  education;      etc.  .  ^ 


We  include  here  especially  several  studies  of  tjie  evaluation 

research  function  and  how^  it  is  organized;  wlio  does  what  kinds  of  ^ 

evaluations  with  what  degree  of  effectiveness;  how  evaluation  find- 

13 

^  ings  are  used; -etc*       The  "research-on-research"  character  of  these 
studies  of  the. evaluation  research  function  suggests  a  particularly 
igh  level  of  self-awareness  within  this  function. 


Existing  secondary  analyses, havel  been  done  in  two  areas  in 

14 

particular       demongraphic  data  bn  AERA  members,      and  funding  data 
on  federal  sponsorship  of  *educatii€>nal  R/D&I  activities.'''^    We  would 
hope  to  see  more  secondary  analyses  when  data  from  the  Education 
KPU  Monitoring  Program's  organizational  survey'''^  are  made  available 
for  analyses  by  the  R/D&I  research  community* 


Some  useful  case  studies  h'^ve  been  p^roduced  about  R/D&I  functioning 

-       .  17 

in  various  projects  and  project  settings.       We  would  like  to  see 
many  more  such  case'  studies,  expecially  if  they  are  designed  to 
provide  process / analyses  of  R/D6I  functioning  in  a  "Vesearch-on- 
research"  mode. 


er|c 


There  are  ^reladively  few  documents  in  the  other  four  categories. 

The  literature!  t iat^s  available  clearly  reflects  the 

1 


lis 


5 
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institutionalizatioh  of '"research-on^research"  in  educational  * 

18 

R/D&I  —  efforts  to  synthesize  the  existing  literature;  efforts 

/       19  ' 

to  map  the  domain  of  educational  R/D£(I;      policy  studies  on 

20 

questions  of  funding  and  how  NIE  should  relate  to  the  "field'*; 

descriptions  of  NIE's  KPU  moni-torin^*proj  ect  designed  tat  develop 

a  data  base  on  educational  KPU  functioning;  use  the  data  base  to 

build  models  of  the  ^ynamic^  of  KPU  functioning  in  education;  and 

monitor  KPU  functioning  to  identify  problems  requiring  new  policy^ 

initiatives  or  to  assess  the  effects  of  iBxisting  policies  and  policy 
21 

changes;       and  data  tron  the  organizational  survey  undertaken  as' 

*    22    '  ^ 

pare  of  the  ntonitoring  program^  , 
^  \  i  - 

In  suamaryr  at  present,  the  research  literature  on  educational 
R/D&I  functioning  touches  on  dnly  limited  areas  of  system  function-- 
•  ing;  provides  relatively  little  empirical  data;  is  atheoretical ; 
and  appears  to  be  only  minimally  utilized  by  eithr  sponsors  or 
performers  of  r/d&I  activity.    Hoyever,  all  of  this  may  change  if 
the  iflE  monit:oring  project  is  effective  in  institutionalizing 
research  on  the  educational, r/D&I  system  and  providing  the  kind  of 
data  base  and  policy  analyses  suggested  in  program  descriptions. 
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11.     NEEDED  INITIATIVES 


In  its  1973'review  and  assessment  of  NIE  funding  policies;  the  . 
advisory  panel  headed  by  Roald  Campbell  called  for  the  establish- 
ment of  "a  ,very  sophisticated  research  and'analysis  unit  at  the 
very  top  of  NIE>"  nj^th  active  involvement  in  the  short-term  and 
long-terra  planning  and  decision  making  carried  out  by  the 
Institute's  leadership.    As  envisioned  by  the  panel>  this  unit 
would  have  sufficient  resources  to  permit  theih  to  monitor  and 
analyze  system  functioning  and  to  provide  the  data  base  for\4 
"inEorni|d  choice. "^^ 


NIE's  RSD  System  Support  Division  has  the  potential  to  function 
in  this  nsanner>  and  tpok  several  icjportanL  steps^to  begin  develop*- 

2 

ment  of  the  needed  ct)nceptual>  analytical>  and  empirical  work. 

Of  particular  importance  was:- their  work  on  the  publication  of  ' 

the  1976  Databook>  updating  OE*s  1969^^^^tus  report      (which  was 

until  1976' the  only  coraprehensive  compilati^on  and  synthesis  of 

information  on  the  educational  R^^D  systejn);  their  planning  for  an 

Education  KPU  Mpnitoring  Program  and  their  sponsorship  of  ^an 

organizational  survey  of  R/D&I  performer  organizations  as  the  first 

25 

data-gathering  effort  under  the  monitoring  prograrav     their  awarding 

26 

of  several  grants  for  preparation  of  conceptual  papers  and 

^everal  other >  larger  scale  efforts  designed  to  map  the  educational 
27 

R/D&I  domain     and  develop  the  beginnings  of  an  R&D  system  studies 
research  community;  their  issuing  of  an  "R&D  Source  Sought" 

solicitation  for  the  establishment  of  an  R^D  System  Studies  Policy 

23  *  *  ' 

Center;      and  their  own  important  analyses;  of  federal  funding  data> 

leading  Co  publications  providing  the  best  'available  information 

/  29 

on  federal  sponsorship  of  educational  R/D&I  activit^^^ 
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However>  the'R&D  System  Support  Division  has  remained  a  small,  . 
underfinanced  unit>  functioning  largely  in  ^isolation  from  (and 
seemingly  with  little-  influence  on)  top  NIE  planning  and  decision 
making*    Plans  for  the  RfitD  System  Studies  Policy  Center  were 
drojsped,  and  even  the  future  of  the  Education  KPU  Monitoring 
Program  may  ie  in  jeopardy/  Clearly,  this-unit  has  not^been 
-permitted  to  function  in  the  manner  suggested  by  the  Campbell  panel, 
and  this  critical  system  need  remains  unmet* 

A  veil  functioning,  adequately  financed  unit  of  l;his  kind  could 

facilitate  the  emergence  and  development  of  an  educational  R/Dfiil 

system  studies  research  cotfimunity  and  provide  top  system  policy 

makers  with  the  kinds       soundXl^mpirical  data  heeded  to  inform  , 

the  policy  process  and  enable  NIE  t.o  actively  perform  ijts  role 

K^as  the  lead  agency  for  educational  R&D.    However,  as  yet,  we  see 

little  evidence  of  any  of  this  occurring  in  the  near  future* 
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\     and  Carnot  E*  Nelson",  "Federal  Funding^'of  ^dtic^tional  R&^;  R&D 
Funding       Agency,"  Educational  Researcher,  7,  iHo;  6",  June  ^ 

1978";  National  Institute^Of' Education;  106  Databook  The  Status'  ^ 
ot.  Education  Research  and  Development  on  the  United  States  ^ 
'(Washington^:    NXE,  1976)^  and,  for  earlier  estin^ates/  see  ^ 
ofiicg  Education;  Educational  Research  and  Developmenf -jn  the 
^  ,       United  States  (Washington:  - 'OE,  1969)*  '  ^ 

^16.  "This  sur.vey  wss  conducted  by  the  Bureau  of  Social' Science  Re*-  * 
search  I^nc", ,  under  NIE  spon3or5hip>  The  final  report,  should/ 
be  available  in  197^8  or  1979.  ^    ,  . 
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The  Oregon  Studies  in  Research  Development,  Diffusion*  and  * 
iivaXuatlon,  H.  Del  Schalock*  Study  Director  (Monmouth,  uregon: 
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Study  of  Educational  Administration,  1973);  Center  for  New 
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Case  Studies'  (^Chicago:    CSS,  1978)";  and  Center  for  New  Schools, 
Strategies  of  Six  Groups  Thatf  Facilitate  Educational  Change  at 
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For  instance,  see:*   OE,  Educational  Research  and  DeveloMietft  in 
the  United  States,  op.  cit.;  NIE,  1976__Da'teabQ.ok^  op.  cit;  Michael 
Radnor;- Harriet  Spivak,  Earl  C*  Young,  Duruard  Hofler,  and  Ray- 
mbnd  J.  Buckley,  Comparative  Research  Development  and  Innova-  ^ 
tion:    with  Implication^  for  Education^    Abridged  Report  for  the 
National  Instit#e  of  Education  '(Evanston:    Center  for  the  Inter-_ 
disciplinary    s£udy  of  Science  and^Technology,  Northwestern  Uni- 
versity, 1977);  Michael  Radnor,  Harriet  Spivak,  and  Durward 
Hofler,  Research^  Development  and  Innovation:    Contextual  Analy- 
sis (Evans^on;.  Center  for  the  Interddsciplina^ry  Study  of  Sci- 
ence an'd  ?4'cfinology.  Northwester^  Oni^ersity,  1977);  and  this, 
volume .  *  . 

For  instance:    ^tacey  Churchill,  Modelling  A  National  Educational 
R&D  System!    A  Conceptual  Framework  (Washington:    NIE,  1974); 
The  Oregon  Studies,  op^  cit^,  especially  Volumes  I  gnd  III; 
Radnor,  Spivak,  Young,  Hofler,  and  Buckley,  Compa^tive  Research^ 
Development  anfl  Innovation^  op^  cit.;  Mason  and  Craig,  ^'Federal 
Support  for  Education  Research  and  Relafed*  Activities ,  FY  1975-77," 
op^  cit^;, Nelson,  Sawers*,  and  Mason,  A  Composite  Estimate,  op.  cit^ 
Mason,  Nelson,  and  Sawers,  KPU  Function^ -By  ARency>  op.  cit^;  and 
Nelson  and  Mason,  Project  Content  and  Fert^rmera  By  Agency,  op.  cit 

For  instance:    Roa^ci  F.  Campbell  e t  al . ,  R&D  Funding  Policies  of 
the  National  Institute  of  Education:      Review  ^nd  Recommen^iations 
(Washington:    NIE,  1975) ;- Michael  Radnor,  Harriet  Spivak,  Durward 
Hpfler,  and  Earl  C*  Young,  Agency  Field  Relationships  In  the  Educa- 
tional R/D&r  System;    A  Policy  Analysis  for  the  National  Institute 
of  Educatjt-on  (Evanscpni'^   Center  for  the  Interdisicplinary  Study  of 
Science -and  Technology,  Northwestern  University,  1976);  Michael 
Radrwr-,  Diirward  Hofler>  and  Harriet  Spivak,  Strengthening_Funda- 
menttvl  Research  Relevgmt  to  Education  (Evanston:    Center  for  the 
Interdisciplinary^  Study  of  Science    and  Technology/Nprthwestem 
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University,  1977);  and  also  see  Michael  Radnor  and  Durward 
Hofler,  eds * >  Policy  Studies  in  Research^  Development  and  Xnr 
novation  (Evanston:     Center  for  the  Interdisciplinary  Study  of 
Science  and  TechnSlogy,  torthwestern  University,  1977). 

2X*      NIE,  RFP  for  Survey  of  Institutions    Which  Perform  EducatioE^el 
k&£^>  op.  cit>i  NIE,  Program  for  Monitoring  the  Education  KPU 
^System,  op>  cit>    ^  . 

22*      See  above,  footnote  16» 

23.      Campbell^et  al> ,  R&D  Funding  Policies  of  the  National  Institute 
Qf  Education,  op.  cit. 

24 »      OE,  Educational  Research  and  Development  in  the  United  States, 
op.  cit>  ^  ^ 

25^,      See  above,  footnotes  16  and  21* 

26,      Churchill,  Modelling  A  National  Educational  R&D  System,  op.  cit.; 
Burkhart  Holzner,  Jiri  Nehaevajsa,  and  Laslie  Salmon-Cox,  The 
^    Impact  of  the  Federal  Research  and  Development  Center  Proaram 
on  American  Education!    A  Problem  Analysis  and  Design  Paper  for 
a  Prog,ram  of  Studies  (Pittsfergh:    University  of  Pittsburgh,  1974) ; 
and  Peter  H*  Ros&'i,  Assessing  Organizational  Capacity  for  Educa-* 
tional  R&D  in  an  Academic  Institutiorry    Prepared  for  HIE V  R&D 
System  Support  Division,  Reprinted  JLn  Educational  Researcher,  Vol  ^  5, 
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tive Structure  of  Knov/leddfa  Production  and  Utilization  in  Education: 
laterim  Report  (Menlo  Park:    Stanford  Research  Institute^  1974); 
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